Commit Graph

157 Commits

Author SHA1 Message Date
Max Hirschhorn
b0f022596c SERVER-34185 Introduce DataConsistencyHook for raising ServerFailures. 2018-03-29 11:49:08 -04:00
Robert Guo
0d0fb80fd6 SERVER-33756 Disable colors in benchmark output in logkeeper 2018-03-26 16:46:44 -04:00
Jonathan Abrahams
36148ad8bb SERVER-23312 Format Python files with yapf 2018-03-26 13:04:25 -04:00
Daniel Gottlieb
6ae04cd9f2 SERVER-29213: Have WiredTiger support recoverToStableTimestamp. 2018-03-24 19:39:13 -04:00
Robert Guo
d0c7c03ee0 SERVER-33746 pipe additional evergreen options into resmoke.py 2018-03-20 10:06:42 -04:00
Andy Schwerin
64e649a622 SERVER-31802 SERVER-31239 Remove master-slave replication and resync command. 2018-03-13 15:09:53 -04:00
Daniel Gottlieb
2b2f4b65da SERVER-33843: Have periodic kill secondaries first do dbhash checks then validate collection. 2018-03-13 09:50:12 -04:00
Robert Guo
e372a68483 SERVER-33202 add hook to generate data file for the perf dashboard 2018-03-12 16:22:26 -04:00
Yves Duhem
a3e22bbb8b SERVER-33811 Clear dbpath after dbtest suite execution 2018-03-12 11:43:11 -04:00
Max Hirschhorn
03892c4032 SERVER-30203 Create FSMWorkloadTestCase for running concurrency tests.
Uses the jstests/concurrency/fsm_libs/resmoke_runner.js file to run an
individual FSM workload directly via resmoke.py.

These changes expose internals of jstests/concurrency/fsm_libs/runner.js
so that both versions of how the concurrency tests are executed by
resmoke.py remain possible for other suite configurations.
2018-03-08 16:52:06 -05:00
Yves Duhem
37eab69b76 SERVER-33737 Fix logger override for DynamicJSTestCase 2018-03-08 14:05:33 -05:00
Max Hirschhorn
efa8782c7b SERVER-31503 Extract JSRunnerFileTestCase from JSONSchemaTestCase.
This reduces the amount of duplicate code when writing another TestCase
subclass that uses a static JavaScript runner file.
2018-03-08 11:58:41 -05:00
Robert Guo
a47c30b73e SERVER-33201 add resmoke.py testcase for Benchmark tests 2018-03-07 12:28:47 -05:00
Yves Duhem
4b80b74a61 SERVER-33665 Call configure on ProcessTestCase 2018-03-07 11:54:58 -05:00
Yves Duhem
d0cadc1fa1 SERVER-33665 Make hook dynamic tests TestCase instances 2018-03-06 16:29:23 -05:00
Yves Duhem
10f2088572 SERVER-33665 New TestCase subclass for process based tests 2018-03-06 16:28:23 -05:00
Yves Duhem
6618ad3025 SERVER-33396 Update fixture teardown to throw ServerFailure 2018-03-02 12:14:51 -05:00
Max Hirschhorn
e25af89eaa SERVER-33504 Add test suite for resmoke.py logging performance.
Runs a configurable number of "yes" processes for the specified amount
of time (in seconds).
2018-02-28 17:52:53 -05:00
Yves Duhem
4a69dcaf78 SERVER-33476 Rename CustomBehavior to Hook 2018-02-27 11:29:46 -05:00
Robert Guo
fbfa9342eb SERVER-33199 Add benchmarks_storage test suite 2018-02-21 15:14:02 -05:00
Vesselina Ratcheva
fdfce7f6c2 SERVER-32143 Remove test coverage for master-slave 2018-02-21 10:38:49 -05:00
Kevin Albertson
8821cdb550 SERVER-25640 check if jstests leave unterminated processes 2018-02-20 09:25:18 -05:00
Eddie Louie
8865f48da8 SERVER-32888 Set a default oplog size for replica sets started by resmoke.py 2018-02-14 12:42:27 -05:00
Jonathan Abrahams
9fd34c78b7 SERVER-31562 Archival for test failures from suites not using a resmoke fixture 2018-02-14 11:38:17 -05:00
Jonathan Abrahams
4cc459b6ee SERVER-26884 Support archiving data files in Evergreen on test failure 2018-02-08 12:19:04 -05:00
Max Hirschhorn
264d971842 SERVER-32691 Add write_concern_majority_passthrough.yml test suite.
Also adds support for using replica set connection strings in resmoke.py
without making all nodes electable.
2018-01-30 19:45:42 -05:00
Mathias Stearn
c52b057749 SERVER-32879 make resmoke clean up after successful dbtest runs 2018-01-29 10:57:53 -05:00
Robert Guo
0aeb5ce7e8 SERVER-32468 Use a 1-node CSRS in non-stepdown sharding passthroughs tests 2018-01-26 11:19:25 -05:00
Judah Schvimer
6a1e6fe87e SERVER-30642 Raise election timeouts in python fixtures 2018-01-23 10:36:37 -05:00
Charlie Swanson
87c9442cc3 SERVER-31785 Use 2 shards in sharded jscore passthrough. 2018-01-19 09:55:59 -05:00
Max Hirschhorn
2c451638c2 SERVER-32474 Fix double logging when using --log=buildlogger.
Exposes an additional logger that uses the test's root logger as the
parent for any TestCase instances constructor by the hook. The fixture
logger still continues to be the parent of the hook logger.

Also changes the CleanEveryN hook to explicitly get marked as a failure
if a ServerFailure exception is thrown, rather than relying on
TestReport.combine() to do so implicitly.
2018-01-10 14:15:35 -05:00
Kevin Albertson
af6bd1d39b SERVER-31670 fixture secondary defaults to 0 votes 2018-01-08 10:06:16 -05:00
Judah Schvimer
1038fbaffd SERVER-30538 check that checkpointTimestamp is correct in
PeriodicKillSecondaries hook
2017-12-21 11:03:42 -05:00
Judah Schvimer
5610da9e3e SERVER-30538 PeriodicKillSecondaries hook should account for empty
oplog correctly
2017-12-21 11:03:42 -05:00
Jonathan Abrahams
67e018f8de SERVER-32285 dbtests suite runs no tests in resmoke.py 2017-12-13 16:21:44 -05:00
Judah Schvimer
a49b278699 SERVER-30538 check that oplogTruncateAfterPoint is correct in PeriodicKillSecondaries hook 2017-12-11 15:51:47 -05:00
Kevin Albertson
9c9b303b1a SERVER-27249 add hook to check primary unchanged 2017-12-08 08:57:07 -05:00
Jack Mulrow
51b699b02a SERVER-31194 Add a version of retryable_writes_jscore_passthrough.yml with stepdowns 2017-12-07 14:36:44 -05:00
Max Hirschhorn
26279e8695 SERVER-30979 Run the fuzzer with CSRS primary stepdowns. 2017-12-01 10:20:32 -05:00
Max Hirschhorn
611220640b SERVER-31556 Use fixture logger as parent of hook logger.
This enables the hook logger to log messages to logkeeper when
--log=buildlogger is specified without needing to start a new dynamic
test case.
2017-11-26 12:14:00 -05:00
Jonathan Abrahams
9c6381687e SERVER-30755 KeyError "selector" is raised when no tests or test suites specified to resmoke.py 2017-11-21 09:32:13 -05:00
Yves Duhem
2421e96fa4 SERVER-29924 Display excluded tests in resmoke dry run 2017-11-20 15:56:50 -05:00
Max Hirschhorn
046a5a01c1 SERVER-31470 Move "run tests" logic into evergreen_run_tests.py. 2017-10-18 01:45:51 -04:00
Ian Boros
a7b2cf5c4b SERVER-29522 better error codes when running concurrent tests in resmoke 2017-10-13 10:28:37 -04:00
samantharitter
45d35fe3fc SERVER-31184 Make servers automatically set up config.system.sessions 2017-10-11 00:52:09 -04:00
Max Hirschhorn
8b3694d704 Revert "SERVER-29522 better error codes when running concurrent tests in resmoke"
This reverts commit 1e2626463b.
2017-10-11 00:11:17 -04:00
Ian Boros
1e2626463b SERVER-29522 better error codes when running concurrent tests in resmoke 2017-10-10 10:08:06 -04:00
Ian Boros
51414083ae SERVER-31472 resmoke returns error code when StepDownThread terminates prematurely 2017-10-10 10:04:12 -04:00
Yves Duhem
1170477971 SERVER-30872 Avoid modifying suite from signal handler 2017-10-09 13:19:42 -04:00
Yves Duhem
02e1ac97d8 SERVER-30980 Add tag selector expressions support 2017-09-27 11:11:35 -04:00