Jonathan Abrahams
c50c68fef1
SERVER-23312 Python linting - Lint using pylint, pydocstyle & mypy
2018-04-05 14:41:58 -04:00
Robert Guo
275c07392a
SERVER-29644 Add test suite for Python unit tests
2018-04-05 01:39:23 -04:00
Robert Guo
7a502a751e
SERVER-34210 fix display of benchmarks with multple arguments
2018-04-03 10:15:45 -04:00
Max Hirschhorn
b0f022596c
SERVER-34185 Introduce DataConsistencyHook for raising ServerFailures.
2018-03-29 11:49:08 -04:00
Robert Guo
0d0fb80fd6
SERVER-33756 Disable colors in benchmark output in logkeeper
2018-03-26 16:46:44 -04:00
Jonathan Abrahams
36148ad8bb
SERVER-23312 Format Python files with yapf
2018-03-26 13:04:25 -04:00
Daniel Gottlieb
6ae04cd9f2
SERVER-29213: Have WiredTiger support recoverToStableTimestamp.
2018-03-24 19:39:13 -04:00
Robert Guo
d0c7c03ee0
SERVER-33746 pipe additional evergreen options into resmoke.py
2018-03-20 10:06:42 -04:00
Andy Schwerin
64e649a622
SERVER-31802 SERVER-31239 Remove master-slave replication and resync command.
2018-03-13 15:09:53 -04:00
Daniel Gottlieb
2b2f4b65da
SERVER-33843: Have periodic kill secondaries first do dbhash checks then validate collection.
2018-03-13 09:50:12 -04:00
Robert Guo
e372a68483
SERVER-33202 add hook to generate data file for the perf dashboard
2018-03-12 16:22:26 -04:00
Yves Duhem
a3e22bbb8b
SERVER-33811 Clear dbpath after dbtest suite execution
2018-03-12 11:43:11 -04:00
Max Hirschhorn
03892c4032
SERVER-30203 Create FSMWorkloadTestCase for running concurrency tests.
...
Uses the jstests/concurrency/fsm_libs/resmoke_runner.js file to run an
individual FSM workload directly via resmoke.py.
These changes expose internals of jstests/concurrency/fsm_libs/runner.js
so that both versions of how the concurrency tests are executed by
resmoke.py remain possible for other suite configurations.
2018-03-08 16:52:06 -05:00
Yves Duhem
37eab69b76
SERVER-33737 Fix logger override for DynamicJSTestCase
2018-03-08 14:05:33 -05:00
Max Hirschhorn
efa8782c7b
SERVER-31503 Extract JSRunnerFileTestCase from JSONSchemaTestCase.
...
This reduces the amount of duplicate code when writing another TestCase
subclass that uses a static JavaScript runner file.
2018-03-08 11:58:41 -05:00
Robert Guo
a47c30b73e
SERVER-33201 add resmoke.py testcase for Benchmark tests
2018-03-07 12:28:47 -05:00
Yves Duhem
4b80b74a61
SERVER-33665 Call configure on ProcessTestCase
2018-03-07 11:54:58 -05:00
Yves Duhem
d0cadc1fa1
SERVER-33665 Make hook dynamic tests TestCase instances
2018-03-06 16:29:23 -05:00
Yves Duhem
10f2088572
SERVER-33665 New TestCase subclass for process based tests
2018-03-06 16:28:23 -05:00
Yves Duhem
6618ad3025
SERVER-33396 Update fixture teardown to throw ServerFailure
2018-03-02 12:14:51 -05:00
Max Hirschhorn
e25af89eaa
SERVER-33504 Add test suite for resmoke.py logging performance.
...
Runs a configurable number of "yes" processes for the specified amount
of time (in seconds).
2018-02-28 17:52:53 -05:00
Yves Duhem
4a69dcaf78
SERVER-33476 Rename CustomBehavior to Hook
2018-02-27 11:29:46 -05:00
Robert Guo
fbfa9342eb
SERVER-33199 Add benchmarks_storage test suite
2018-02-21 15:14:02 -05:00
Vesselina Ratcheva
fdfce7f6c2
SERVER-32143 Remove test coverage for master-slave
2018-02-21 10:38:49 -05:00
Kevin Albertson
8821cdb550
SERVER-25640 check if jstests leave unterminated processes
2018-02-20 09:25:18 -05:00
Eddie Louie
8865f48da8
SERVER-32888 Set a default oplog size for replica sets started by resmoke.py
2018-02-14 12:42:27 -05:00
Jonathan Abrahams
9fd34c78b7
SERVER-31562 Archival for test failures from suites not using a resmoke fixture
2018-02-14 11:38:17 -05:00
Jonathan Abrahams
4cc459b6ee
SERVER-26884 Support archiving data files in Evergreen on test failure
2018-02-08 12:19:04 -05:00
Max Hirschhorn
264d971842
SERVER-32691 Add write_concern_majority_passthrough.yml test suite.
...
Also adds support for using replica set connection strings in resmoke.py
without making all nodes electable.
2018-01-30 19:45:42 -05:00
Mathias Stearn
c52b057749
SERVER-32879 make resmoke clean up after successful dbtest runs
2018-01-29 10:57:53 -05:00
Robert Guo
0aeb5ce7e8
SERVER-32468 Use a 1-node CSRS in non-stepdown sharding passthroughs tests
2018-01-26 11:19:25 -05:00
Judah Schvimer
6a1e6fe87e
SERVER-30642 Raise election timeouts in python fixtures
2018-01-23 10:36:37 -05:00
Charlie Swanson
87c9442cc3
SERVER-31785 Use 2 shards in sharded jscore passthrough.
2018-01-19 09:55:59 -05:00
Max Hirschhorn
2c451638c2
SERVER-32474 Fix double logging when using --log=buildlogger.
...
Exposes an additional logger that uses the test's root logger as the
parent for any TestCase instances constructor by the hook. The fixture
logger still continues to be the parent of the hook logger.
Also changes the CleanEveryN hook to explicitly get marked as a failure
if a ServerFailure exception is thrown, rather than relying on
TestReport.combine() to do so implicitly.
2018-01-10 14:15:35 -05:00
Kevin Albertson
af6bd1d39b
SERVER-31670 fixture secondary defaults to 0 votes
2018-01-08 10:06:16 -05:00
Judah Schvimer
1038fbaffd
SERVER-30538 check that checkpointTimestamp is correct in
...
PeriodicKillSecondaries hook
2017-12-21 11:03:42 -05:00
Judah Schvimer
5610da9e3e
SERVER-30538 PeriodicKillSecondaries hook should account for empty
...
oplog correctly
2017-12-21 11:03:42 -05:00
Jonathan Abrahams
67e018f8de
SERVER-32285 dbtests suite runs no tests in resmoke.py
2017-12-13 16:21:44 -05:00
Judah Schvimer
a49b278699
SERVER-30538 check that oplogTruncateAfterPoint is correct in PeriodicKillSecondaries hook
2017-12-11 15:51:47 -05:00
Kevin Albertson
9c9b303b1a
SERVER-27249 add hook to check primary unchanged
2017-12-08 08:57:07 -05:00
Jack Mulrow
51b699b02a
SERVER-31194 Add a version of retryable_writes_jscore_passthrough.yml with stepdowns
2017-12-07 14:36:44 -05:00
Max Hirschhorn
26279e8695
SERVER-30979 Run the fuzzer with CSRS primary stepdowns.
2017-12-01 10:20:32 -05:00
Max Hirschhorn
611220640b
SERVER-31556 Use fixture logger as parent of hook logger.
...
This enables the hook logger to log messages to logkeeper when
--log=buildlogger is specified without needing to start a new dynamic
test case.
2017-11-26 12:14:00 -05:00
Jonathan Abrahams
9c6381687e
SERVER-30755 KeyError "selector" is raised when no tests or test suites specified to resmoke.py
2017-11-21 09:32:13 -05:00
Yves Duhem
2421e96fa4
SERVER-29924 Display excluded tests in resmoke dry run
2017-11-20 15:56:50 -05:00
Max Hirschhorn
046a5a01c1
SERVER-31470 Move "run tests" logic into evergreen_run_tests.py.
2017-10-18 01:45:51 -04:00
Ian Boros
a7b2cf5c4b
SERVER-29522 better error codes when running concurrent tests in resmoke
2017-10-13 10:28:37 -04:00
samantharitter
45d35fe3fc
SERVER-31184 Make servers automatically set up config.system.sessions
2017-10-11 00:52:09 -04:00
Max Hirschhorn
8b3694d704
Revert "SERVER-29522 better error codes when running concurrent tests in resmoke"
...
This reverts commit 1e2626463b .
2017-10-11 00:11:17 -04:00
Ian Boros
1e2626463b
SERVER-29522 better error codes when running concurrent tests in resmoke
2017-10-10 10:08:06 -04:00