Commit Graph

127 Commits

Author SHA1 Message Date
Max Hirschhorn
2c451638c2 SERVER-32474 Fix double logging when using --log=buildlogger.
Exposes an additional logger that uses the test's root logger as the
parent for any TestCase instances constructor by the hook. The fixture
logger still continues to be the parent of the hook logger.

Also changes the CleanEveryN hook to explicitly get marked as a failure
if a ServerFailure exception is thrown, rather than relying on
TestReport.combine() to do so implicitly.
2018-01-10 14:15:35 -05:00
Kevin Albertson
af6bd1d39b SERVER-31670 fixture secondary defaults to 0 votes 2018-01-08 10:06:16 -05:00
Judah Schvimer
1038fbaffd SERVER-30538 check that checkpointTimestamp is correct in
PeriodicKillSecondaries hook
2017-12-21 11:03:42 -05:00
Judah Schvimer
5610da9e3e SERVER-30538 PeriodicKillSecondaries hook should account for empty
oplog correctly
2017-12-21 11:03:42 -05:00
Jonathan Abrahams
67e018f8de SERVER-32285 dbtests suite runs no tests in resmoke.py 2017-12-13 16:21:44 -05:00
Judah Schvimer
a49b278699 SERVER-30538 check that oplogTruncateAfterPoint is correct in PeriodicKillSecondaries hook 2017-12-11 15:51:47 -05:00
Kevin Albertson
9c9b303b1a SERVER-27249 add hook to check primary unchanged 2017-12-08 08:57:07 -05:00
Jack Mulrow
51b699b02a SERVER-31194 Add a version of retryable_writes_jscore_passthrough.yml with stepdowns 2017-12-07 14:36:44 -05:00
Max Hirschhorn
26279e8695 SERVER-30979 Run the fuzzer with CSRS primary stepdowns. 2017-12-01 10:20:32 -05:00
Max Hirschhorn
611220640b SERVER-31556 Use fixture logger as parent of hook logger.
This enables the hook logger to log messages to logkeeper when
--log=buildlogger is specified without needing to start a new dynamic
test case.
2017-11-26 12:14:00 -05:00
Jonathan Abrahams
9c6381687e SERVER-30755 KeyError "selector" is raised when no tests or test suites specified to resmoke.py 2017-11-21 09:32:13 -05:00
Yves Duhem
2421e96fa4 SERVER-29924 Display excluded tests in resmoke dry run 2017-11-20 15:56:50 -05:00
Max Hirschhorn
046a5a01c1 SERVER-31470 Move "run tests" logic into evergreen_run_tests.py. 2017-10-18 01:45:51 -04:00
Ian Boros
a7b2cf5c4b SERVER-29522 better error codes when running concurrent tests in resmoke 2017-10-13 10:28:37 -04:00
samantharitter
45d35fe3fc SERVER-31184 Make servers automatically set up config.system.sessions 2017-10-11 00:52:09 -04:00
Max Hirschhorn
8b3694d704 Revert "SERVER-29522 better error codes when running concurrent tests in resmoke"
This reverts commit 1e2626463b.
2017-10-11 00:11:17 -04:00
Ian Boros
1e2626463b SERVER-29522 better error codes when running concurrent tests in resmoke 2017-10-10 10:08:06 -04:00
Ian Boros
51414083ae SERVER-31472 resmoke returns error code when StepDownThread terminates prematurely 2017-10-10 10:04:12 -04:00
Yves Duhem
1170477971 SERVER-30872 Avoid modifying suite from signal handler 2017-10-09 13:19:42 -04:00
Yves Duhem
02e1ac97d8 SERVER-30980 Add tag selector expressions support 2017-09-27 11:11:35 -04:00
Ian Boros
9f8084f2c8 SERVER-30578 resmoke no longer starts more servers than tests 2017-09-07 12:12:22 -04:00
Yves Duhem
c31e309846 SERVER-30684 Add configsvr and shard options to ShardedClusterFixture 2017-09-01 17:46:39 -04:00
Yves Duhem
2f6a2294fe SERVER-30683 Support failovers in ReplicaSetFixture 2017-09-01 17:41:35 -04:00
Yves Duhem
c30149da2e SERVER-30685 New continuous stepdown hook 2017-09-01 16:38:38 -04:00
Sara Golemon
6e2cc35d6d SERVER-27801 define unique KRB5CCNAME per external_auth test 2017-08-28 11:12:47 -04:00
Robert Guo
b136dbce0f SERVER-19541 supporting connecting to an external cluster in resmoke.py 2017-08-21 10:30:59 -04:00
Nick Zolnierz
91f42e4734 SERVER-29593: Integrate the official JSON Schema test corpus into the unit tests 2017-08-11 11:43:45 -04:00
Robert Guo
4d8d1745c9 SERVER-28636 replace --executor with --suite in resmoke.py 2017-06-22 18:29:34 -04:00
Max Hirschhorn
7c92251d7b SERVER-29560 Remove testcases.py now that it has been split up. 2017-06-21 15:42:33 -04:00
Max Hirschhorn
c57ab42219 SERVER-29560 Split testcases.py module into separate files. 2017-06-14 20:44:52 -04:00
Max Hirschhorn
b353d4f012 SERVER-29560 Change fixtures to be registered automatically. 2017-06-14 20:44:52 -04:00
Max Hirschhorn
b8f6239094 SERVER-29560 Split hooks.py module into separate files.
Also defines a generic Registry metaclass for making class declarations
store a reference to the class along with a name so that they can be
looked up later.
2017-06-14 20:44:52 -04:00
Robert Guo
f3b60130e2 SERVER-25293 log hook testcases only to logkeeper 2017-06-14 19:57:10 -04:00
Kimberly Hou
23f38f73d2 SERVER-26443 clean up error reporting in jstestfuzz_concurrent suite 2017-06-08 12:35:55 -07:00
Yves Duhem
0347baa06a SERVER-29192 Prevent 'silentfail' status for dynamic tests 2017-06-05 14:13:07 -04:00
Spencer T Brody
47aad7d695 SERVER-29433 Improve logging during ReplicaSetFixture initialization 2017-06-02 15:55:04 -04:00
Peter Mauldin
19a48549ee SERVER-24783 resmoke.py now prints running tests when encountering timeouts 2017-06-02 11:09:08 -04:00
Cristopher Stauffer
cb31bfd735 SERVER-26027: Updating log statement to include exit code on tear down in situations where process already stopped 2017-05-31 10:26:08 -04:00
Eddie Louie
50ea467d27 SERVER-29061 Add buildscripts/promote_silent_failures.py script to convert silent
test failures into non-silent test failures
2017-05-30 12:06:39 -04:00
Jonathan Abrahams
b6c1b6b6a9 SERVER-28302 resmoke.py parser should accept files that don't end in .js 2017-05-26 13:59:32 -04:00
Max Hirschhorn
835a13294a SERVER-29008 Set TestData.numTestClients property in resmoke.py.
Forwards the value for resmoke.py's --numClientsPerFixture command line
option to the mongo shell running the test. This enables the fuzzer to
know if there are concurrent clients running the test.
2017-05-16 12:33:32 -04:00
Max Hirschhorn
a4d2c52dba SERVER-28991 Eliminate having an AlarmClock thread for each test.
Changes resmoke.py to use its FlushThread for managing all calls to
flush() buildlogger handlers.
2017-05-16 12:10:14 -04:00
Misha Tyulenev
2c18910e75 SERVER-28968: Add causal consistent passthrough suite 2017-05-05 21:34:09 -04:00
Jonathan Abrahams
f34a173b12 SERVER-28783 Add buildscripts/combine_reports.py script for combining report.json files 2017-04-24 21:47:10 -04:00
Mark Benvenuto
c776e095ac SERVER-28308 Integrate python linting for IDL into Evergreen 2017-04-18 18:18:26 -04:00
Jonathan Abrahams
abeacd9572 SERVER-28439 Add "silentfail" test status and --reportFailureStatus option to resmoke.py 2017-04-03 11:33:09 -04:00
Yves Duhem
c8a2af0706 SERVER-28477 Resmoke logging refactoring 2017-03-29 10:48:25 -04:00
Eddie Louie
bc5c3286fb SERVER-26224 Add --staggerJobs option to resmoke.py 2017-03-27 16:57:58 -04:00
Max Hirschhorn
66188320dc SERVER-21539 Release TestReport._lock when recomputing stats. 2017-03-20 13:56:53 -04:00
Robert Guo
761a96d3fc SERVER-27854 initiate replicasets faster in resmoke.py 2017-03-14 13:28:29 -04:00