Commit Graph

625 Commits

Author SHA1 Message Date
Don Anderson
1707b53973 WT-2360 A large set of changes to implement disjunctive and nested joins.
The join iterator now manages iteration at 'one level' of the join, as
subjoins are iterated, new iterators are created, forming a stack.
Added internal documentation in cursor.h.
2016-04-14 15:42:51 -04:00
Michael Cahill
7b8faf30a5 Merge branch 'wt-2381' into wt-2381-lsm-metadata 2016-03-10 13:29:20 +11:00
Michael Cahill
9a19889494 WT-2381 Rewrite LSM metadata to fix dump / load.
Include all of the WT_SESSION::create config in the ordinary LSM
metadata so it is merged correctly into the dump header.  Provide
an upgrade path for LSM metadata in the old format.

** Backwards bracking change for LSM: ** once metadata is upgraded
to the new format, LSM trees cannot be opened with older versions of
WiredTiger.
2016-03-03 16:04:17 +11:00
Michael Cahill
93afecc49c WT-2428 Add a "json" mode to statistics logging.
This generates statistics in a format that is compatible with MongoDB
so that we can share tools for analysis.
2016-02-25 11:50:55 +11:00
Susan LoVerso
9f6073d277 WT-2349 Make readonly option not supported in reconfigure. 2016-02-18 10:59:54 -05:00
Susan LoVerso
9ba69ab718 WT-2349 Read-only documentation 2016-02-16 15:18:43 -05:00
Susan LoVerso
3bc60a9b2e WT-2349 Initial addition of readonly configuration option. 2016-02-04 13:36:58 -05:00
Keith Bostic
12be963758 WT-2352: Allow build and test without requiring lz4
Remove support for the bzip2 compression engine.
2016-01-28 12:44:09 -05:00
Michael Cahill
f4e5ae0bb8 WT-2333 Update "lock_fail" warning for clarity. 2016-01-22 16:34:32 +11:00
Michael Cahill
c4487d4bff WT-2333 Add a "no_wait" mode to WT_SESSION::drop. 2016-01-21 15:54:19 +11:00
Keith Bostic
1df86bfb7a WT-2287: Add support for a WT_SESSION.rebalance method that rebuilds the
underlying btree, correcting any imbalance.
2015-12-17 12:29:08 -05:00
Alex Gorrod
8677edeed2 WT-2262 Split btree walk into separate walk functions.
Allow a value of 0 to next_random_sample_size, it's the default so
it doesn't make sense to disallow it.
2015-12-14 04:53:23 +00:00
Keith Bostic
f38bd7a327 Change the parameter to be called "sample_size" and to be a count of the
number of samples the application will perform (which might be 1000, or 0.1%).
2015-12-12 10:34:59 -05:00
Keith Bostic
2d2456b373 WT-2262: Add the new next_random_sample_percent configuration that
specifies a percentage of the tree to skip over before retrieving each
new record.  If next_random_sample_percent is configured, we first
retrieve a random record from the tree as a whole, and on subsequent
retrievals, skip forward the specified percentage of the tree; if
next_random_sample_percent is not configured, we use the previous method
of choosing a new leaf page from the entire tree on each retrieval.

Clarify bulk and next-random cursor documentation: there are several
methods allowed on bulk and next-random cursors (for example, reset,
reconfigure and close), don't try to list them. Instead reference the
principle method the application is expected to use (insert for bulk
cursors, next for next-random cursors).

Make cursor-open with next_random configured fail for column-store
objects, waiting until the next method is called seems unkind.

Rework the static random-cursor tests to smoke-test both forms of random
cursors.
2015-12-11 10:37:58 -05:00
Don Anderson
ee33b0875a Merge branch 'develop' into wt-1315-join-cursor 2015-11-17 10:35:01 -05:00
Michael Cahill
1b9c3da26a WT-2212 Add a "use_environment" config to "wiredtiger_open" 2015-11-12 13:45:10 +11:00
Don Anderson
c73ee1b0a4 Merge branch 'develop' into wt-1315-join-cursor 2015-11-10 11:06:42 -05:00
Michael Cahill
b1141548ad WT-2200 Edit wording of direct_io docs, don't allow write_through on read-only checkpoints. 2015-11-06 17:39:59 +11:00
Mark Benvenuto
310023deba WT-2200 Change WiredTiger caching strategy on Windows 2015-11-05 16:57:23 -05:00
Don Anderson
4126e77abe Merge branch 'develop' into wt-1315-join-cursor 2015-11-04 06:44:25 -05:00
Don Anderson
4d204910b2 WT-1315. Added support for join cursors:
- "join:" URI handling added to WT_SESSION::open_cursor, added WT_SESSION::join.
- Added support for in-memory bloom filters.
- Minor fix to cur_dump_close CURSOR_API_CALL.
- Some refactoring in __wt_{curindex,curtable}_get_value() to allow them
    to be called internally.
- Use new macro JOINABLE_CURSOR_API_CALL() instead of CURSOR_API_CALL()
    to trap illegal calls to joined cursor.
- __wt_curtable_open now takes an owning cursor arg.
- Added __wt_struct_unpack_size() and __wt_struct_repack()
2015-11-03 13:22:11 -05:00
Michael Cahill
3a89c33f77 Fix "in_memory" configuration -- respect WIREDTIGER_CONFIG. 2015-10-21 13:23:00 +11:00
Alex Gorrod
e08b3d47e5 Disable new in_memory configuration as default 2015-10-20 15:45:49 +11:00
Michael Cahill
337ce237b8 Add support for an undocumented "in_memory" mode to wiredtiger_open. 2015-10-20 13:51:09 +11:00
Susan LoVerso
fc51ae17d2 WT-2151 Add logging reconfiguration support and testing. 2015-09-30 16:08:34 -04:00
Susan LoVerso
cce60f8be3 WT-2151 Add zero_fill config to manually zero out log files. 2015-09-29 12:52:59 -04:00
Alex Gorrod
56a7e83969 Update split_deepen_min_child description, even though it isn't
publicly documented.
2015-09-25 00:33:48 +00:00
Alex Gorrod
65b77c975b WT-2127 Deepen the tree more regularly to avoid wide internal pages.
I was seeing internal pages grow to contain over 70,000 entries. Which
makes reconciliation of child pages very expensive. Be more aggressive
about splitting internal pages.
2015-09-23 07:36:25 +00:00
Susan LoVerso
d2111ffac0 WT-2104 Write up commit and log_flush options.
Also add large default value for transaction_sync.
2015-09-16 14:02:50 -04:00
Susan LoVerso
e6c7d06b47 WT-2104 Change naming of config for log_flush. 2015-09-16 10:45:03 -04:00
Susan LoVerso
75136ee778 WT-2104 Set 'sync' as the default. Unused var. 2015-09-15 14:17:35 -04:00
Susan LoVerso
366fc17e0b WT-2104 New log_flush API to control the flushing or syncing of the log. 2015-09-15 13:35:11 -04:00
Alex Gorrod
69732eebe1 Shared cache review nits. 2015-08-27 17:14:57 +10:00
Alex Gorrod
f02f2ce85b Shared cache quota improvements:
Fix a bug when a quota isn't specified
Improve description of configuration setting.
2015-08-27 02:25:28 +00:00
Alex Gorrod
5d488cf41e WT-2065 Add a quota to shared cache configuration.
That provides the ability to limit how much cache a single
participant in a shared cache can be allocated.
2015-08-27 02:14:43 +00:00
Michael Cahill
6cffaf62f5 Minor cleanup of documentation changes. 2015-08-20 13:22:03 +10:00
David Hows
cea2c7df19 SERVER-18356 - Update documentation 2015-08-19 16:06:57 +10:00
David Hows
bc48bb4092 CR Changes 2015-07-08 10:25:15 +10:00
David Hows
9957d152d5 Make 0 a valid value within close_idle_time 2015-07-07 11:54:00 +10:00
Susan LoVerso
0efd205d6b Fix docs for sync. begin_transaction -> commit_transaction 2015-06-24 11:47:28 -04:00
David Hows
fb88162109 WT-1728 WT_SESSION.reset 2015-06-22 09:44:50 +10:00
Keith Bostic
b3e3f19a08 Add the "strict" configuration option to WT_SESSION.verify, default
false, don't error if we leak blocks unless strict is configured.

Reference WT-1959.
2015-06-06 13:23:21 -04:00
Keith Bostic
d4fc69a23d Merge pull request #2012 from wiredtiger/stat-size
Add a "statistics=(size)" mode to statistics cursors
2015-06-05 20:50:40 -04:00
Michael Cahill
74cea8701c Add a "statistics=(size)" mode to statistics cursors that just gets the filesize without opening anything.
refs SERVER-17078
2015-06-05 16:01:51 -04:00
Alex Gorrod
e075e2c944 Add an eviction_dirty_trigger configuration setting.
Allows applications to maintain a low proportion of dirty pages in
the cache, while allowing clean pages to utilize the cache.

While here, alter the minimum allowed dirty trigger and target to
be set as low as 5 percent. Which may be desired for huge caches.

refs SERVER-16737, WT-1350

e Please enter the commit message for your changes. Lines starting
2015-06-05 02:49:46 +00:00
Alex Gorrod
0840cee04a Split LSM verbose into two categories.
Messages from the work queue management can be overwhelming.
2015-06-02 05:02:06 +00:00
Michael Cahill
8ce8f23476 Rename the config key for partial logging to log=(enabled) to match wiredtiger_open. 2015-05-29 15:29:38 +10:00
Michael Cahill
62e5ee40ad Merge branch 'develop' into partial-logging 2015-05-28 17:35:17 +10:00
Susan LoVerso
474ff612e8 Merge branch 'develop' into transaction-background
Conflicts:
	src/config/config_def.c
	src/include/config.h
	src/include/txn.h
	src/log/log.c
	src/session/session_api.c
2015-05-27 12:15:11 -04:00
Susan LoVerso
d3b914224f Make default transaction_sync timeout to be forever. WT-1908 2015-05-27 11:13:02 -04:00