Commit Graph

47 Commits

Author SHA1 Message Date
Yves Duhem
2962ff014a SERVER-34356 Reorganize resmoke.py 2018-04-11 13:49:41 -04:00
Jonathan Abrahams
c50c68fef1 SERVER-23312 Python linting - Lint using pylint, pydocstyle & mypy 2018-04-05 14:41:58 -04:00
Jonathan Abrahams
36148ad8bb SERVER-23312 Format Python files with yapf 2018-03-26 13:04:25 -04:00
Robert Guo
d0c7c03ee0 SERVER-33746 pipe additional evergreen options into resmoke.py 2018-03-20 10:06:42 -04:00
Robert Guo
e372a68483 SERVER-33202 add hook to generate data file for the perf dashboard 2018-03-12 16:22:26 -04:00
Robert Guo
a47c30b73e SERVER-33201 add resmoke.py testcase for Benchmark tests 2018-03-07 12:28:47 -05:00
Robert Guo
9016e62cf3 SERVER-33497 remove support for options file in resmoke.py 2018-02-26 20:44:16 -05:00
Yves Duhem
649502fd59 SERVER-33397 New suitesconfig module 2018-02-23 18:23:48 -05:00
Robert Guo
f19ec3f130 SERVER-33438 ignore benchmarks in burn_in_tests.py 2018-02-22 12:46:29 -05:00
Jonathan Abrahams
4cc459b6ee SERVER-26884 Support archiving data files in Evergreen on test failure 2018-02-08 12:19:04 -05:00
Jonathan Abrahams
9c6381687e SERVER-30755 KeyError "selector" is raised when no tests or test suites specified to resmoke.py 2017-11-21 09:32:13 -05:00
Siyuan Zhou
c8fbc9a231 SERVER-31671 Cancel running elections if the term changes after writing my last vote 2017-11-07 16:38:43 -05:00
Jonathan Abrahams
7d39fcc31b SERVER-30802 Add "with_external_server" to excluded executor_only set in resmoke parser get_named_suites(). 2017-10-25 17:29:19 -04:00
Max Hirschhorn
046a5a01c1 SERVER-31470 Move "run tests" logic into evergreen_run_tests.py. 2017-10-18 01:45:51 -04:00
Ian Boros
65d4cdd857 SERVER-29607 resmoke prints available suites when an invalid one is specified 2017-10-06 13:13:31 -04:00
Yves Duhem
02e1ac97d8 SERVER-30980 Add tag selector expressions support 2017-09-27 11:11:35 -04:00
Henrik Edin
c79b69d1ea SERVER-31095 Adding an evergreen builder to test the legacy transport layer. Fix so resmoke.py can passthrough the --transportLayer option. 2017-09-22 17:16:02 -04:00
Robert Guo
b136dbce0f SERVER-19541 supporting connecting to an external cluster in resmoke.py 2017-08-21 10:30:59 -04:00
Jonathan Reams
1622c6b7a7 SERVER-29402 Implement ServiceExecutor and fixed-size test executor 2017-07-14 16:19:40 -04:00
Robert Guo
4d8d1745c9 SERVER-28636 replace --executor with --suite in resmoke.py 2017-06-22 18:29:34 -04:00
Yves Duhem
af35f24b56 SERVER-29486 Filter test membership map by test_kind 2017-06-21 18:02:39 -04:00
Robert Guo
f3b60130e2 SERVER-25293 log hook testcases only to logkeeper 2017-06-14 19:57:10 -04:00
may
ea8402f7ff SERVER-21299 resmoke should default to --shuffle 2017-06-09 10:20:23 -04:00
Yves Duhem
0347baa06a SERVER-29192 Prevent 'silentfail' status for dynamic tests 2017-06-05 14:13:07 -04:00
Jonathan Abrahams
b6c1b6b6a9 SERVER-28302 resmoke.py parser should accept files that don't end in .js 2017-05-26 13:59:32 -04:00
Jonathan Abrahams
6b44ad3ae2 SERVER-28440 Add support to parse resmoke.py tags from a separate YAML file 2017-04-05 14:09:52 -04:00
Jonathan Abrahams
97691221bc Revert "SERVER-28440 Add support to parse resmoke.py tags from a separate YAML file"
This reverts commit e0c09edaf7.
2017-04-05 12:15:20 -04:00
Jonathan Abrahams
e0c09edaf7 SERVER-28440 Add support to parse resmoke.py tags from a separate YAML file 2017-04-05 11:18:50 -04:00
Jonathan Abrahams
abeacd9572 SERVER-28439 Add "silentfail" test status and --reportFailureStatus option to resmoke.py 2017-04-03 11:33:09 -04:00
Eddie Louie
bc5c3286fb SERVER-26224 Add --staggerJobs option to resmoke.py 2017-03-27 16:57:58 -04:00
Eddie Louie
422a7e6ddd SERVER-27770 Remove other references to EXCLUDE_WITH_ALL_TAGS and
INCLUDE_WITH_ALL_TAGS
2017-03-27 14:33:21 -04:00
Eddie Louie
5e47fab7c9 SERVER-27770 Remove resmoke.py's includeWithAllTags and excludeWithAllTags options 2017-03-27 12:35:11 -04:00
Yves Duhem
e94d22e967 SERVER-23818 Send Evergreen task Id to logkeeper 2017-02-16 09:39:23 -05:00
Robert Guo
a1363d00d0 SERVER-27408 Allow resmoke to take more than one tag-related arguments.
Each tag argument can also be specified more than once and in both the
YAML suite definition and on the command line.

Tag argments will be agnostic to ordering, with each argument narrowing
down test files to be run. No tag is allowed to override another tag.
2017-01-26 15:49:59 -05:00
iwysiu
76fb4530a1 SERVER-24328 modify resmoke for concurrent testcases 2016-07-01 11:52:15 -04:00
Mike Grundy
7af6573341 SERVER-24537 Create a new and modified test running task 2016-06-15 16:50:15 -04:00
Mike Grundy
dd3d9e3077 SERVER-22204 Tests should lower WT cache size 2016-06-13 16:33:56 -04:00
Mike Grundy
686bd5e0ab SERVER-21841 Add mode to resmoke.py to list under what suites a test runs 2016-05-10 09:51:17 -04:00
Mike Grundy
e7e0ef104b SERVER-22198 resmoke.py should obey order of tests specified via command line 2016-04-28 09:58:31 -04:00
Charlie Swanson
caf1dfe036 SERVER-21417 Add command line options to resmoke.py to include or exclude tags 2015-11-13 11:30:16 -05:00
David Storch
df2a33f997 SERVER-20067 SERVER-19572 set readMode in shell based on wire version
"compatibility" readMode now causes the shell to detect whether or not
to use find/getMore commands based on wire version. "commands" mode
forces use of the find/getMore commands, and "legacy" mode forces uses
of legacy OP_QUERY/OP_GET_MORE reads.

Also configures tests to force use of "commands" or "legacy" mode as
appropriate.
2015-09-30 13:25:15 -04:00
Max Hirschhorn
53f0b88ef9 SERVER-20475 Add --preallocJournal option to resmoke.py.
Defaults to off.
2015-09-21 09:06:22 -04:00
Charlie Swanson
ff6326e5ab SERVER-18273 Compute ranges of ports for each job in resmoke.py 2015-09-03 09:15:11 -04:00
David Storch
967422b380 SERVER-19571 configure regression loop to use --readMode commands in suites that don't start mongos
Adds --shellReadMode flag to resmoke.py and changes Evergreen / resmoke configuration files to pass
--readMode commands where appropriate.
2015-07-30 14:56:45 -04:00
Adam Midvidy
cf1a2f6d70 SERVER-19299 add the ability to pass --setParameter arguments on the command line to resmoke.py 2015-07-21 18:14:13 -04:00
Max Hirschhorn
2fb814c60c SERVER-18834 Add --executor command line option to resmoke.py.
Exposes a way to specify how jstests passed in on the command line
should be run. Defaults to starting a standalone mongod.

    --executor=core_small_oplog_rs

is equivalent to smoke.py's --small-oplog-rs

    --executor=no_server

is equivalent to smoke.py's --dont-start-mongod
2015-06-22 20:18:10 -04:00
Max Hirschhorn
424314f65e SERVER-1424 Rewrite smoke.py.
Split out the passthrough tests into separate suites. The MongoDB
deployment is started up by resmoke.py so that we can record the
success/failure of each individual test in MCI.

Added support for parallel execution of tests by dispatching to
multiple MongoDB deployments.

Added support for grouping different kinds of tests (e.g. C++ unit
tests, dbtests, and jstests) so that they can be run together. This
allows for customizability in specifying what tests to execute when
changes are made to a particular part of the code.
2015-05-08 14:49:42 -04:00