Commit Graph

56 Commits

Author SHA1 Message Date
Robert Guo
a3a87f936f SERVER-65672 upgrade python packages to support 3.10 2022-04-24 02:12:33 +00:00
Robert Guo
9c46c72e17 SERVER-55857 Use explicit task definitions for implicit multiversion tasks 2021-10-12 04:46:33 +00:00
Robert Guo
ba5cf359d8 SERVER-55857 remove NAMED_SUITES from resmoke config 2021-10-02 04:55:02 +00:00
Mikhail Shchatko
fcdbc97ec7 SERVER-55858 Enforce transition to requires-fcv after feature flag is changed from disabled to enabled by default 2021-07-23 07:30:05 +00:00
Robert Guo
5d9e1907cc SERVER-57873 support multiple tag files resmoke 2021-06-23 03:24:24 +00:00
Robert Guo
424e574251 SERVER-57778 add QE and QO patch build variants 2021-06-18 15:38:39 +00:00
Carl Raiden Worley
c318aff369 SERVER-48048 Use resmoke tag files for multiversion blacklisting 2020-08-17 17:07:22 +00:00
Daniel Gottlieb
c0be456afe SERVER-48953: Allow resmoke test files to be listed in a replay file. 2020-07-20 19:23:49 +00:00
Mikhail Shchatko
f46630dd3a SERVER-48112 Use Absolute Imports in Resmoke 2020-06-18 10:21:48 +00:00
jannaerin
76823e76d5 SERVER-43333 Ingest drivers server selection tests 2020-04-24 16:10:48 +00:00
A. Jesse Jiryu Davis
6018c34bd2 SERVER-45416 Model-check TLA+ specs in Evergreen 2020-04-06 19:45:52 +00:00
Andrew Morrow
be05c9ea62 SERVER-44546 Remove mobile variants and embedded benchmarks 2019-12-09 19:22:42 +00:00
Lamont Nelson
54ffea6c75 SERVER-43333 Ingest driver SDAM tests 2019-12-05 20:32:53 +00:00
Annie Black
27cf911c3f Revert "SERVER-43333 Ingest driver SDAM tests"
This reverts commit 25d1843463.
2019-12-02 18:36:44 +00:00
Lamont Nelson
25d1843463 SERVER-43333 Ingest driver SDAM tests 2019-11-27 17:40:41 +00:00
Billy Donahue
c8b9b377df SERVER-43659 better diagnostics on resmoke subprocess errors 2019-09-30 06:52:38 +00:00
Roxane
a5b2b781c6 SERVER-41796 Create Evergreen variant for libfuzzer targets 2019-07-23 12:56:16 -04:00
Ian Boros
72f18524e2 Revert "SERVER-41796 Create Evergreen variant for libfuzzer targets"
This reverts commit 51a218fb13.
2019-07-19 13:37:05 -04:00
Roxane
51a218fb13 SERVER-41796 Create Evergreen variant for libfuzzer targets 2019-07-18 15:58:45 -04:00
Mathew Robinson
8dd6d47557 SERVER-32295 Support Python 3 2019-04-08 14:08:49 -04:00
Jonathan Abrahams
7a6d64aa65 SERVER-37373 Fully qualified files in suite YML do not run in Burn_in tests on Windows 2019-01-30 16:06:06 -05:00
Jason Chan
85df2fb7d7 SERVER-38646 Add resmoke test case for genny unit tests. 2018-12-17 16:48:10 -05:00
Shreyas Kalyan
eaee7a35c4 SERVER-37663 Add support for running genny via resmoke.py locally 2018-10-25 18:48:36 -04:00
Jonathan Abrahams
1b897361cd SERVER-26319 Deleting a test results in "ValueError: Unrecognized jstest" 2018-10-25 12:32:07 -04:00
Jonathan Abrahams
a444720202 SERVER-36076 Create new resmoke.py test suite for running mongoebench on a desktop 2018-08-13 12:23:29 -04:00
Martin Neupauer
6acedb1006 WRITING-2731 Build integration test running script for testing the mql-model command line tool 2018-06-09 08:56:32 -04:00
Martin Neupauer
937039a3c9 WRITING-2732 Build test runner for running mql-model declarative tests against an actual MongoDB server 2018-06-06 11:11:32 -04:00
Robert Guo
b107fce3ef SERVER-29999 Implement FSM Scheduler for concurrency_simultaneous 2018-06-04 15:26:56 -04:00
Robert Guo
29c8f66e43 SERVER-33738 Create a runCommand() override method to perform operations inside a transaction 2018-05-24 09:13:56 -04:00
Jonathan Abrahams
c50c68fef1 SERVER-23312 Python linting - Lint using pylint, pydocstyle & mypy 2018-04-05 14:41:58 -04:00
Robert Guo
275c07392a SERVER-29644 Add test suite for Python unit tests 2018-04-05 01:39:23 -04:00
Jonathan Abrahams
36148ad8bb SERVER-23312 Format Python files with yapf 2018-03-26 13:04:25 -04:00
Max Hirschhorn
03892c4032 SERVER-30203 Create FSMWorkloadTestCase for running concurrency tests.
Uses the jstests/concurrency/fsm_libs/resmoke_runner.js file to run an
individual FSM workload directly via resmoke.py.

These changes expose internals of jstests/concurrency/fsm_libs/runner.js
so that both versions of how the concurrency tests are executed by
resmoke.py remain possible for other suite configurations.
2018-03-08 16:52:06 -05:00
Max Hirschhorn
e25af89eaa SERVER-33504 Add test suite for resmoke.py logging performance.
Runs a configurable number of "yes" processes for the specified amount
of time (in seconds).
2018-02-28 17:52:53 -05:00
Robert Guo
fbfa9342eb SERVER-33199 Add benchmarks_storage test suite 2018-02-21 15:14:02 -05:00
Jonathan Abrahams
67e018f8de SERVER-32285 dbtests suite runs no tests in resmoke.py 2017-12-13 16:21:44 -05:00
Yves Duhem
2421e96fa4 SERVER-29924 Display excluded tests in resmoke dry run 2017-11-20 15:56:50 -05:00
Yves Duhem
203c210332 SERVER-30922 Do not fail on non matching selector pattern 2017-10-06 13:14:47 -04:00
Yves Duhem
5d1c412f41 SERVER-30922 Fail on invalid resmoke test file arguments 2017-10-06 11:00:59 -04:00
Yves Duhem
420c06608a SERVER-31309 Fix use of resmoke args for cpp tests 2017-10-03 15:20:08 -04:00
Yves Duhem
f64d3147b9 SERVER-31312 Fix include_suites matching for db_test 2017-10-03 12:26:56 -04:00
Yves Duhem
02e1ac97d8 SERVER-30980 Add tag selector expressions support 2017-09-27 11:11:35 -04:00
Nick Zolnierz
91f42e4734 SERVER-29593: Integrate the official JSON Schema test corpus into the unit tests 2017-08-11 11:43:45 -04:00
Max Hirschhorn
58a3909a3f SERVER-29642 SERVER-29643 Add Python tests for test lifecycle scripts.
For test_failures.py:
  * Replaces HistoryReport with a TestHistory class that has
    get_history_by_revision() and get_history_by_date() methods. They
    both return a list of ReportEntry tuples that can be used to
    construct a Report instance.
  * Adds Python unit test cases for the Report and ReportEntry classes.
  * Creates Wildcard class as separate concept from Missing class.
  * Enables --sinceDate and --untilDate with a warning that the script
    may not return a complete result set.
  * Adds support for running the script with Python 3.

For update_test_lifecycle.py:
  * Introduces Config namedtuple to represent the test lifecycle model.
  * Adds Python unit tests cases for the update_tags() function.
  * Takes advantage of the partial grouping so that computing summaries
    for (test, task, variant), (test, task), and (test,) combinations do
    not require re-processing the entire result set.
2017-07-17 11:09:34 -04:00
Yves Duhem
5fc85a7f11 SERVER-29936 New module for test tags files 2017-07-07 15:49:24 -04:00
Jonathan Abrahams
b6c1b6b6a9 SERVER-28302 resmoke.py parser should accept files that don't end in .js 2017-05-26 13:59:32 -04:00
Jonathan Abrahams
68b0d67207 SERVER-29306 Prevent C++ unit, integration and dbtests from running twice during patch builds 2017-05-26 10:30:41 -04:00
Jonathan Abrahams
6b44ad3ae2 SERVER-28440 Add support to parse resmoke.py tags from a separate YAML file 2017-04-05 14:09:52 -04:00
Jonathan Abrahams
97691221bc Revert "SERVER-28440 Add support to parse resmoke.py tags from a separate YAML file"
This reverts commit e0c09edaf7.
2017-04-05 12:15:20 -04:00
Jonathan Abrahams
e0c09edaf7 SERVER-28440 Add support to parse resmoke.py tags from a separate YAML file 2017-04-05 11:18:50 -04:00