Commit Graph

20 Commits

Author SHA1 Message Date
Yves Duhem
2421e96fa4 SERVER-29924 Display excluded tests in resmoke dry run 2017-11-20 15:56:50 -05:00
Yves Duhem
203c210332 SERVER-30922 Do not fail on non matching selector pattern 2017-10-06 13:14:47 -04:00
Yves Duhem
5d1c412f41 SERVER-30922 Fail on invalid resmoke test file arguments 2017-10-06 11:00:59 -04:00
Yves Duhem
420c06608a SERVER-31309 Fix use of resmoke args for cpp tests 2017-10-03 15:20:08 -04:00
Yves Duhem
f64d3147b9 SERVER-31312 Fix include_suites matching for db_test 2017-10-03 12:26:56 -04:00
Yves Duhem
02e1ac97d8 SERVER-30980 Add tag selector expressions support 2017-09-27 11:11:35 -04:00
Nick Zolnierz
91f42e4734 SERVER-29593: Integrate the official JSON Schema test corpus into the unit tests 2017-08-11 11:43:45 -04:00
Max Hirschhorn
58a3909a3f SERVER-29642 SERVER-29643 Add Python tests for test lifecycle scripts.
For test_failures.py:
  * Replaces HistoryReport with a TestHistory class that has
    get_history_by_revision() and get_history_by_date() methods. They
    both return a list of ReportEntry tuples that can be used to
    construct a Report instance.
  * Adds Python unit test cases for the Report and ReportEntry classes.
  * Creates Wildcard class as separate concept from Missing class.
  * Enables --sinceDate and --untilDate with a warning that the script
    may not return a complete result set.
  * Adds support for running the script with Python 3.

For update_test_lifecycle.py:
  * Introduces Config namedtuple to represent the test lifecycle model.
  * Adds Python unit tests cases for the update_tags() function.
  * Takes advantage of the partial grouping so that computing summaries
    for (test, task, variant), (test, task), and (test,) combinations do
    not require re-processing the entire result set.
2017-07-17 11:09:34 -04:00
Yves Duhem
5fc85a7f11 SERVER-29936 New module for test tags files 2017-07-07 15:49:24 -04:00
Jonathan Abrahams
b6c1b6b6a9 SERVER-28302 resmoke.py parser should accept files that don't end in .js 2017-05-26 13:59:32 -04:00
Jonathan Abrahams
68b0d67207 SERVER-29306 Prevent C++ unit, integration and dbtests from running twice during patch builds 2017-05-26 10:30:41 -04:00
Jonathan Abrahams
6b44ad3ae2 SERVER-28440 Add support to parse resmoke.py tags from a separate YAML file 2017-04-05 14:09:52 -04:00
Jonathan Abrahams
97691221bc Revert "SERVER-28440 Add support to parse resmoke.py tags from a separate YAML file"
This reverts commit e0c09edaf7.
2017-04-05 12:15:20 -04:00
Jonathan Abrahams
e0c09edaf7 SERVER-28440 Add support to parse resmoke.py tags from a separate YAML file 2017-04-05 11:18:50 -04:00
Eddie Louie
5e47fab7c9 SERVER-27770 Remove resmoke.py's includeWithAllTags and excludeWithAllTags options 2017-03-27 12:35:11 -04:00
Robert Guo
a1363d00d0 SERVER-27408 Allow resmoke to take more than one tag-related arguments.
Each tag argument can also be specified more than once and in both the
YAML suite definition and on the command line.

Tag argments will be agnostic to ordering, with each argument narrowing
down test files to be run. No tag is allowed to override another tag.
2017-01-26 15:49:59 -05:00
Mike Grundy
686bd5e0ab SERVER-21841 Add mode to resmoke.py to list under what suites a test runs 2016-05-10 09:51:17 -04:00
Charlie Swanson
caf1dfe036 SERVER-21417 Add command line options to resmoke.py to include or exclude tags 2015-11-13 11:30:16 -05:00
Adam Midvidy
2ec075a6d6 SERVER-19448 implement resmoke.py support for c++ integration tests 2015-08-11 13:50:17 -04:00
Max Hirschhorn
424314f65e SERVER-1424 Rewrite smoke.py.
Split out the passthrough tests into separate suites. The MongoDB
deployment is started up by resmoke.py so that we can record the
success/failure of each individual test in MCI.

Added support for parallel execution of tests by dispatching to
multiple MongoDB deployments.

Added support for grouping different kinds of tests (e.g. C++ unit
tests, dbtests, and jstests) so that they can be run together. This
allows for customizability in specifying what tests to execute when
changes are made to a particular part of the code.
2015-05-08 14:49:42 -04:00