Page MenuHomePhabricator

Fix a bug where the TeamCity build only reports one of the test_runner runs
ClosedPublic

Authored by jasonbcox on Jul 17 2019, 21:48.

Details

Summary

The junit output of each successive test_runner.py run overwrites junit_results.xml.
This leads to a build failure, but tests reporting as passed: https://build.bitcoinabc.org/viewLog.html?buildId=16488&buildTypeId=BitcoinABC_Master_BitcoinAbcMasterAsan&tab=buildResultsDiv
It also leads to incorrect test failure reporting, making it impossible to track flaky or spurious test failures.

This diff fixes that by writing each run to it's own output file.

Test Plan

See the TeamCity build for this diff: https://build.bitcoinabc.org/viewLog.html?buildId=16722&buildTypeId=BitcoinABC_BitcoinAbcStaging&tab=testsInfo
In the "View:" dropdown, select tests without grouping by name

Diff Detail

Repository
rABC Bitcoin ABC
Lint
Automatic diff as part of commit; lint not applicable.
Unit
Automatic diff as part of commit; unit tests not applicable.

Event Timeline

jasonbcox created this revision.Jul 17 2019, 21:48
jasonbcox planned changes to this revision.Jul 17 2019, 21:48
jasonbcox edited the summary of this revision. (Show Details)Jul 17 2019, 21:56
jasonbcox requested review of this revision.Jul 17 2019, 22:08
jasonbcox edited the test plan for this revision. (Show Details)
deadalnix accepted this revision.Jul 17 2019, 23:27

ju is probably about the worse name possible.

contrib/teamcity/build.sh
90 ↗(On Diff #10340)

Why is there a cutoff on master ?

This revision is now accepted and ready to land.Jul 17 2019, 23:27
jasonbcox added inline comments.Jul 18 2019, 01:25
contrib/teamcity/build.sh
90 ↗(On Diff #10340)

There doesn't seem to be a rationale for it here: https://reviews.bitcoinabc.org/D1929 but it's clearly intended to run extended tests.