Commit Graph

73 Commits

Author SHA1 Message Date
Trevor Guidry
62b78a4fcd SERVER-90409 Use test filtering api in resmoke (#22116)
GitOrigin-RevId: 0cc452c3e98ff63b08b592e1772367fe8fd7c57c
2024-05-23 09:00:27 +00:00
seanzimm
49aec070b5 SERVER-89647 Override drop and assert for magic restore testing (#22460)
GitOrigin-RevId: 34a2d0d2e06953c39c6c10d872cb640100256927
2024-05-22 21:41:52 +00:00
auto-revert-app[bot]
e8e0c79927 Revert "SERVER-89647 Override drop and assert for magic restore testing (#22321)" (#22414)
Co-authored-by: auto-revert-processor <devprod-si-team@mongodb.com>
GitOrigin-RevId: a1ff9bb7595224593c9eff610f5a4e12f0d4cf54
2024-05-21 22:55:37 +00:00
seanzimm
275639fdb1 SERVER-89647 Override drop and assert for magic restore testing (#22321)
[evg
patch](https://spruce.mongodb.com/version/663e5832b144dd0007172e5c/tasks?page=0&sorts=STATUS%3AASC%3BBASE_STATUS%3ADESC)

This PR overrides drops and asserts to make sure we get more coverage
for magic restore testing since the magic restore hook relies on data
existing on the nodes to restore. We found before this PR we were
getting lackluster coverage since most jstests drop their data when the
test ends which leads to little data remaining in nodes when the hook
runs.

GitOrigin-RevId: 2423d1cfd2be22639b1439c3f550bb866d202178
2024-05-21 14:47:46 +00:00
Steve McClure
b4b23946cd SERVER-90570: Enable formatting checks for buildscripts directory, excluding idl (#22254)
GitOrigin-RevId: 9d997a9f44cd43a8dec7c2a17fa2dbcd875e92f6
2024-05-16 22:07:36 +00:00
Alexander Neben
774d062184 SERVER-90498 Allow a single js suite to be run with multiple js files (#22168)
GitOrigin-RevId: b601ddb52bb21681975618429d94ba95384958fe
2024-05-14 18:16:43 +00:00
David Percy
70da849086 SERVER-90138 Speed up resmoke.py find-suites
Profiling showed a lot of the time was spent in two helper functions:
  - glob() which scans the filesystem for filenames that match a pattern
  - get_tags() which parses the "@tags" section of a jstest

Printing the arguments of these functions showed that a lot of the calls
are duplicates, because many suites use the same glob pattern, and many
suites want to know what tags a given test contains.

Since we already assume the resmokeconfig is not changing out from under
us, it makes sense to cache these. I don't think memory usage is a
concern because resmoke is either short-lived (as in find-suites) or it
runs subprocesses that already use a lot of memory (mongod, or a whole
sharded cluster).

On my machine these two changes brought the time down from around
1m 20s to 10s.

GitOrigin-RevId: f4538e44aaca8c1ae11c38cc48b6ec76d2a85d1b
2024-05-03 05:27:58 +00:00
auto-revert-processor
e111f6817e Revert "SERVER-86852 Add support for requires_fcv_tag_latest resmoke suite tag (#19971)"
This reverts commit dd77915a25fdbbd9c015729ebcbf3806642ac197.

GitOrigin-RevId: dc287509f0cdb0be79caf90add1774289dd76124
2024-03-30 07:28:57 +00:00
Trevor
4a3043f4b3 SERVER-86852 Add support for requires_fcv_tag_latest resmoke suite tag (#19971)
GitOrigin-RevId: dd77915a25fdbbd9c015729ebcbf3806642ac197
2024-03-30 03:16:02 +00:00
Juan Gu
6bfd43eda4 SERVER-83592 Add resmoke flag --enable_enterprise_tests enable enterp… (#17169)
(cherry picked from commit d463d338460a26792c33e173c7cd475535842812)

GitOrigin-RevId: a02b6d310bad23cbbdf7edeef7895714b76f6d07
2023-12-08 19:30:23 +00:00
Mikhail Shchatko
c019228589 SERVER-68699 Check that resmoke suite selector config has valid test paths 2023-10-11 13:49:33 +00:00
Steve Gross
3c737e56b6 SERVER-79168 Allow missing excluded file 2023-08-25 22:08:39 +00:00
seanzimm
2d5ecf6ae2 SERVER-76668 multiple cluster fixture bulk write 2023-07-24 23:30:37 +00:00
Trevor Guidry
53837263e1 SERVER-72923 add multiversion reproduce steps to evergreen 2023-06-20 14:53:13 +00:00
Daniel Moody
1450624c71 SERVER-76740 SERVER-69843 added pretty printer tests framework 2023-05-19 18:19:56 +00:00
Tausif Rahman
2dbc2a40b8 SERVER-73479 resmoke should error locally when attempting to run tests that are disabled 2023-03-21 20:07:24 +00:00
Alexander Neben
97ac02fa50 SERVER-68593 Disable low value python warnings 2022-09-02 22:55:09 +00:00
Robert Guo
a3a87f936f SERVER-65672 upgrade python packages to support 3.10 2022-04-24 02:12:33 +00:00
Robert Guo
9c46c72e17 SERVER-55857 Use explicit task definitions for implicit multiversion tasks 2021-10-12 04:46:33 +00:00
Robert Guo
ba5cf359d8 SERVER-55857 remove NAMED_SUITES from resmoke config 2021-10-02 04:55:02 +00:00
Mikhail Shchatko
fcdbc97ec7 SERVER-55858 Enforce transition to requires-fcv after feature flag is changed from disabled to enabled by default 2021-07-23 07:30:05 +00:00
Robert Guo
5d9e1907cc SERVER-57873 support multiple tag files resmoke 2021-06-23 03:24:24 +00:00
Robert Guo
424e574251 SERVER-57778 add QE and QO patch build variants 2021-06-18 15:38:39 +00:00
Carl Raiden Worley
c318aff369 SERVER-48048 Use resmoke tag files for multiversion blacklisting 2020-08-17 17:07:22 +00:00
Daniel Gottlieb
c0be456afe SERVER-48953: Allow resmoke test files to be listed in a replay file. 2020-07-20 19:23:49 +00:00
Mikhail Shchatko
f46630dd3a SERVER-48112 Use Absolute Imports in Resmoke 2020-06-18 10:21:48 +00:00
jannaerin
76823e76d5 SERVER-43333 Ingest drivers server selection tests 2020-04-24 16:10:48 +00:00
A. Jesse Jiryu Davis
6018c34bd2 SERVER-45416 Model-check TLA+ specs in Evergreen 2020-04-06 19:45:52 +00:00
Andrew Morrow
be05c9ea62 SERVER-44546 Remove mobile variants and embedded benchmarks 2019-12-09 19:22:42 +00:00
Lamont Nelson
54ffea6c75 SERVER-43333 Ingest driver SDAM tests 2019-12-05 20:32:53 +00:00
Annie Black
27cf911c3f Revert "SERVER-43333 Ingest driver SDAM tests"
This reverts commit 25d1843463.
2019-12-02 18:36:44 +00:00
Lamont Nelson
25d1843463 SERVER-43333 Ingest driver SDAM tests 2019-11-27 17:40:41 +00:00
Billy Donahue
c8b9b377df SERVER-43659 better diagnostics on resmoke subprocess errors 2019-09-30 06:52:38 +00:00
Roxane
a5b2b781c6 SERVER-41796 Create Evergreen variant for libfuzzer targets 2019-07-23 12:56:16 -04:00
Ian Boros
72f18524e2 Revert "SERVER-41796 Create Evergreen variant for libfuzzer targets"
This reverts commit 51a218fb13.
2019-07-19 13:37:05 -04:00
Roxane
51a218fb13 SERVER-41796 Create Evergreen variant for libfuzzer targets 2019-07-18 15:58:45 -04:00
Mathew Robinson
8dd6d47557 SERVER-32295 Support Python 3 2019-04-08 14:08:49 -04:00
Jonathan Abrahams
7a6d64aa65 SERVER-37373 Fully qualified files in suite YML do not run in Burn_in tests on Windows 2019-01-30 16:06:06 -05:00
Jason Chan
85df2fb7d7 SERVER-38646 Add resmoke test case for genny unit tests. 2018-12-17 16:48:10 -05:00
Shreyas Kalyan
eaee7a35c4 SERVER-37663 Add support for running genny via resmoke.py locally 2018-10-25 18:48:36 -04:00
Jonathan Abrahams
1b897361cd SERVER-26319 Deleting a test results in "ValueError: Unrecognized jstest" 2018-10-25 12:32:07 -04:00
Jonathan Abrahams
a444720202 SERVER-36076 Create new resmoke.py test suite for running mongoebench on a desktop 2018-08-13 12:23:29 -04:00
Martin Neupauer
6acedb1006 WRITING-2731 Build integration test running script for testing the mql-model command line tool 2018-06-09 08:56:32 -04:00
Martin Neupauer
937039a3c9 WRITING-2732 Build test runner for running mql-model declarative tests against an actual MongoDB server 2018-06-06 11:11:32 -04:00
Robert Guo
b107fce3ef SERVER-29999 Implement FSM Scheduler for concurrency_simultaneous 2018-06-04 15:26:56 -04:00
Robert Guo
29c8f66e43 SERVER-33738 Create a runCommand() override method to perform operations inside a transaction 2018-05-24 09:13:56 -04:00
Jonathan Abrahams
c50c68fef1 SERVER-23312 Python linting - Lint using pylint, pydocstyle & mypy 2018-04-05 14:41:58 -04:00
Robert Guo
275c07392a SERVER-29644 Add test suite for Python unit tests 2018-04-05 01:39:23 -04:00
Jonathan Abrahams
36148ad8bb SERVER-23312 Format Python files with yapf 2018-03-26 13:04:25 -04:00
Max Hirschhorn
03892c4032 SERVER-30203 Create FSMWorkloadTestCase for running concurrency tests.
Uses the jstests/concurrency/fsm_libs/resmoke_runner.js file to run an
individual FSM workload directly via resmoke.py.

These changes expose internals of jstests/concurrency/fsm_libs/runner.js
so that both versions of how the concurrency tests are executed by
resmoke.py remain possible for other suite configurations.
2018-03-08 16:52:06 -05:00