Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

FAIL - Test Failed #227

Open
Caztiel opened this issue Nov 21, 2020 · 7 comments
Open

FAIL - Test Failed #227

Caztiel opened this issue Nov 21, 2020 · 7 comments

Comments

@Caztiel
Copy link

Caztiel commented Nov 21, 2020

When executed ./do

image
image
image

@johnsonjh
Copy link

Do you have additional scroll back? Unfortunately that screen-shot shows only passing tests.

@Caztiel
Copy link
Author

Caztiel commented Nov 22, 2020

@johnsonjh Edited to post screenshots showing exact issue.

@johnsonjh
Copy link

Is this from the master or the pktd-v1.2.x branch (or release)?

Could you provide the output of go version and go env? (You should be using Go 1.14.1 at a minimum, but I'd recommend using 1.15.5 currently.)

Also, what architecture and OS? A 64-bit architect? If it's Linux, can you also give the output of cat /etc/*elease and lsb_release -a?

Also, if a 64-bit Linux, is this a distribution provided toolchain? If this is a distribution provided toolchain, can you reproduce the test failure with the official release?

Sorry to ask for so much detail, but it's a test failure I've not encountered and one strange enough that I want to fully understand your build environment.

@johnsonjh
Copy link

@cjdelisle Verified with @Caztiel that whatever the root cause was (bad test or actual deadlock), it's already fixed in develop.

@johnsonjh
Copy link

@cjdelisle safe to close

@Frank-Buss
Copy link

I don't think it is safe to close this issue. I checked the master branch, and there are lots of errors, files with no tests, and low test coverage, see attached file:
test.txt
I started it with ./do --test. In my opinion, it shouldn't be allowed to commit something if a test is broken. Or at least there should be a stable branch where all tests are running. I didn't tried one of the other branches, but I guess it doesn't look much better there. Is the master branch supposed to be the stable branch used for releases? Then all tests should work there.

Also the test output is very noisy with the syncer and gossiper programs etc. The info and debug messages of these programs should be suppressed in test mode, to see the test results more clearly.

@Frank-Buss
Copy link

Instead of fixing all broken tests, they should be at least disabled. Then the remaining tests are useful for regression testing. Because now there are 91 times "FAIL" in the output. How can you find a new FAIL, if you change some code, and it breaks a different test? Of course, all disabled tests should be fixed before the next release, or removed if not relevant anymore.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants