Carl Raiden Worley
c318aff369
SERVER-48048 Use resmoke tag files for multiversion blacklisting
2020-08-17 17:07:22 +00:00
Daniel Gottlieb
c0be456afe
SERVER-48953: Allow resmoke test files to be listed in a replay file.
2020-07-20 19:23:49 +00:00
Mikhail Shchatko
f46630dd3a
SERVER-48112 Use Absolute Imports in Resmoke
2020-06-18 10:21:48 +00:00
jannaerin
76823e76d5
SERVER-43333 Ingest drivers server selection tests
2020-04-24 16:10:48 +00:00
A. Jesse Jiryu Davis
6018c34bd2
SERVER-45416 Model-check TLA+ specs in Evergreen
2020-04-06 19:45:52 +00:00
Andrew Morrow
be05c9ea62
SERVER-44546 Remove mobile variants and embedded benchmarks
2019-12-09 19:22:42 +00:00
Lamont Nelson
54ffea6c75
SERVER-43333 Ingest driver SDAM tests
2019-12-05 20:32:53 +00:00
Annie Black
27cf911c3f
Revert "SERVER-43333 Ingest driver SDAM tests"
...
This reverts commit 25d1843463 .
2019-12-02 18:36:44 +00:00
Lamont Nelson
25d1843463
SERVER-43333 Ingest driver SDAM tests
2019-11-27 17:40:41 +00:00
Billy Donahue
c8b9b377df
SERVER-43659 better diagnostics on resmoke subprocess errors
2019-09-30 06:52:38 +00:00
Roxane
a5b2b781c6
SERVER-41796 Create Evergreen variant for libfuzzer targets
2019-07-23 12:56:16 -04:00
Ian Boros
72f18524e2
Revert "SERVER-41796 Create Evergreen variant for libfuzzer targets"
...
This reverts commit 51a218fb13 .
2019-07-19 13:37:05 -04:00
Roxane
51a218fb13
SERVER-41796 Create Evergreen variant for libfuzzer targets
2019-07-18 15:58:45 -04:00
Mathew Robinson
8dd6d47557
SERVER-32295 Support Python 3
2019-04-08 14:08:49 -04:00
Jonathan Abrahams
7a6d64aa65
SERVER-37373 Fully qualified files in suite YML do not run in Burn_in tests on Windows
2019-01-30 16:06:06 -05:00
Jason Chan
85df2fb7d7
SERVER-38646 Add resmoke test case for genny unit tests.
2018-12-17 16:48:10 -05:00
Shreyas Kalyan
eaee7a35c4
SERVER-37663 Add support for running genny via resmoke.py locally
2018-10-25 18:48:36 -04:00
Jonathan Abrahams
1b897361cd
SERVER-26319 Deleting a test results in "ValueError: Unrecognized jstest"
2018-10-25 12:32:07 -04:00
Jonathan Abrahams
a444720202
SERVER-36076 Create new resmoke.py test suite for running mongoebench on a desktop
2018-08-13 12:23:29 -04:00
Martin Neupauer
6acedb1006
WRITING-2731 Build integration test running script for testing the mql-model command line tool
2018-06-09 08:56:32 -04:00
Martin Neupauer
937039a3c9
WRITING-2732 Build test runner for running mql-model declarative tests against an actual MongoDB server
2018-06-06 11:11:32 -04:00
Robert Guo
b107fce3ef
SERVER-29999 Implement FSM Scheduler for concurrency_simultaneous
2018-06-04 15:26:56 -04:00
Robert Guo
29c8f66e43
SERVER-33738 Create a runCommand() override method to perform operations inside a transaction
2018-05-24 09:13:56 -04:00
Jonathan Abrahams
c50c68fef1
SERVER-23312 Python linting - Lint using pylint, pydocstyle & mypy
2018-04-05 14:41:58 -04:00
Robert Guo
275c07392a
SERVER-29644 Add test suite for Python unit tests
2018-04-05 01:39:23 -04:00
Jonathan Abrahams
36148ad8bb
SERVER-23312 Format Python files with yapf
2018-03-26 13:04:25 -04:00
Max Hirschhorn
03892c4032
SERVER-30203 Create FSMWorkloadTestCase for running concurrency tests.
...
Uses the jstests/concurrency/fsm_libs/resmoke_runner.js file to run an
individual FSM workload directly via resmoke.py.
These changes expose internals of jstests/concurrency/fsm_libs/runner.js
so that both versions of how the concurrency tests are executed by
resmoke.py remain possible for other suite configurations.
2018-03-08 16:52:06 -05:00
Max Hirschhorn
e25af89eaa
SERVER-33504 Add test suite for resmoke.py logging performance.
...
Runs a configurable number of "yes" processes for the specified amount
of time (in seconds).
2018-02-28 17:52:53 -05:00
Robert Guo
fbfa9342eb
SERVER-33199 Add benchmarks_storage test suite
2018-02-21 15:14:02 -05:00
Jonathan Abrahams
67e018f8de
SERVER-32285 dbtests suite runs no tests in resmoke.py
2017-12-13 16:21:44 -05:00
Yves Duhem
2421e96fa4
SERVER-29924 Display excluded tests in resmoke dry run
2017-11-20 15:56:50 -05:00
Yves Duhem
203c210332
SERVER-30922 Do not fail on non matching selector pattern
2017-10-06 13:14:47 -04:00
Yves Duhem
5d1c412f41
SERVER-30922 Fail on invalid resmoke test file arguments
2017-10-06 11:00:59 -04:00
Yves Duhem
420c06608a
SERVER-31309 Fix use of resmoke args for cpp tests
2017-10-03 15:20:08 -04:00
Yves Duhem
f64d3147b9
SERVER-31312 Fix include_suites matching for db_test
2017-10-03 12:26:56 -04:00
Yves Duhem
02e1ac97d8
SERVER-30980 Add tag selector expressions support
2017-09-27 11:11:35 -04:00
Nick Zolnierz
91f42e4734
SERVER-29593: Integrate the official JSON Schema test corpus into the unit tests
2017-08-11 11:43:45 -04:00
Max Hirschhorn
58a3909a3f
SERVER-29642 SERVER-29643 Add Python tests for test lifecycle scripts.
...
For test_failures.py:
* Replaces HistoryReport with a TestHistory class that has
get_history_by_revision() and get_history_by_date() methods. They
both return a list of ReportEntry tuples that can be used to
construct a Report instance.
* Adds Python unit test cases for the Report and ReportEntry classes.
* Creates Wildcard class as separate concept from Missing class.
* Enables --sinceDate and --untilDate with a warning that the script
may not return a complete result set.
* Adds support for running the script with Python 3.
For update_test_lifecycle.py:
* Introduces Config namedtuple to represent the test lifecycle model.
* Adds Python unit tests cases for the update_tags() function.
* Takes advantage of the partial grouping so that computing summaries
for (test, task, variant), (test, task), and (test,) combinations do
not require re-processing the entire result set.
2017-07-17 11:09:34 -04:00
Yves Duhem
5fc85a7f11
SERVER-29936 New module for test tags files
2017-07-07 15:49:24 -04:00
Jonathan Abrahams
b6c1b6b6a9
SERVER-28302 resmoke.py parser should accept files that don't end in .js
2017-05-26 13:59:32 -04:00
Jonathan Abrahams
68b0d67207
SERVER-29306 Prevent C++ unit, integration and dbtests from running twice during patch builds
2017-05-26 10:30:41 -04:00
Jonathan Abrahams
6b44ad3ae2
SERVER-28440 Add support to parse resmoke.py tags from a separate YAML file
2017-04-05 14:09:52 -04:00
Jonathan Abrahams
97691221bc
Revert "SERVER-28440 Add support to parse resmoke.py tags from a separate YAML file"
...
This reverts commit e0c09edaf7 .
2017-04-05 12:15:20 -04:00
Jonathan Abrahams
e0c09edaf7
SERVER-28440 Add support to parse resmoke.py tags from a separate YAML file
2017-04-05 11:18:50 -04:00
Eddie Louie
5e47fab7c9
SERVER-27770 Remove resmoke.py's includeWithAllTags and excludeWithAllTags options
2017-03-27 12:35:11 -04:00
Robert Guo
a1363d00d0
SERVER-27408 Allow resmoke to take more than one tag-related arguments.
...
Each tag argument can also be specified more than once and in both the
YAML suite definition and on the command line.
Tag argments will be agnostic to ordering, with each argument narrowing
down test files to be run. No tag is allowed to override another tag.
2017-01-26 15:49:59 -05:00
Mike Grundy
686bd5e0ab
SERVER-21841 Add mode to resmoke.py to list under what suites a test runs
2016-05-10 09:51:17 -04:00
Charlie Swanson
caf1dfe036
SERVER-21417 Add command line options to resmoke.py to include or exclude tags
2015-11-13 11:30:16 -05:00
Adam Midvidy
2ec075a6d6
SERVER-19448 implement resmoke.py support for c++ integration tests
2015-08-11 13:50:17 -04:00
Max Hirschhorn
424314f65e
SERVER-1424 Rewrite smoke.py.
...
Split out the passthrough tests into separate suites. The MongoDB
deployment is started up by resmoke.py so that we can record the
success/failure of each individual test in MCI.
Added support for parallel execution of tests by dispatching to
multiple MongoDB deployments.
Added support for grouping different kinds of tests (e.g. C++ unit
tests, dbtests, and jstests) so that they can be run together. This
allows for customizability in specifying what tests to execute when
changes are made to a particular part of the code.
2015-05-08 14:49:42 -04:00