agirbal
0592a5f6d6
SERVER-3167: during final reduce in sharded environment, all results are loaded into an in memory map
2011-06-14 00:11:25 -07:00
agirbal
ebd06a579b
SERVER-2761: Confusing Map / Reduce output when sharded
2011-06-13 16:19:06 -07:00
agirbal
ec68f3c6d5
SERVER-2531: added M/R output to shard collection for mode REPLACE
2011-06-13 14:33:38 -07:00
dwight
37204c7ca0
cleaning and a small insert optimization
2011-05-29 00:31:17 -04:00
agirbal
5cc563b581
- Added option for read only objects in JS invoke method
...
- map function uses RO input object which speeds up MR quite a bit
- added a flag in RO objects so that the BSON can be used as is when converting back
2011-05-25 17:41:40 -07:00
dwight
afd23f33f9
make a noreturn version of insert, would be faster unless cmopiler is very smart.
...
cleaning in insert()
2011-05-24 10:05:31 -04:00
Aaron
859bb3ad16
SERVER-2977 generate cursor in NamespaceDetailsTransient, and short circuit some simple queries
2011-05-17 22:54:22 -07:00
Aaron
dc922edc31
SERVER-2977 Use query optimizer cursor in map reduce
2011-05-17 12:20:09 -07:00
agirbal
51011c187b
SERVER-2976: added fallback to mixed mode in case an emit key is an object
2011-05-13 16:25:29 -07:00
agirbal
d43037f198
SERVER-3092: M/R threshold for running reduces and dumping data to disk are too low, resulting in more CPU and disk I/O
2011-05-13 16:25:29 -07:00
agirbal
0f391def94
SERVER-2976: added fallback from js to mixed mode, added reduce steps within js mode
2011-05-13 15:00:11 -07:00
agirbal
b7509f5433
SERVER-2976: fix segv in m/r if ns doesnt exist
2011-05-12 11:16:06 -07:00
agirbal
fddb4b44db
SERVER-2976: jsMode now works with inline output
2011-05-12 11:16:06 -07:00
agirbal
dad6b228f7
SERVER-2976: cleaner JS
2011-05-12 11:16:06 -07:00
agirbal
860369c353
SERVER-2976: slightly better js function. Cleanup of js objects.
2011-05-12 11:16:05 -07:00
agirbal
54ca9c202c
Additional M/R output lines
2011-05-12 11:16:05 -07:00
agirbal
acb028bdcd
SERVER-2976: fixed the emit count in js mode
2011-05-12 11:16:05 -07:00
agirbal
d47de50498
fix passing data pointer for native functions with spidermonkey
2011-05-10 20:05:30 -07:00
agirbal
088f11a6d6
fix compile
2011-05-10 19:15:18 -07:00
agirbal
13e71279c9
SERVER-2579: added readonly object for lazy v8 objects, which makes them much faster to access
...
SERVER-2976: further implementation of jsMode for M/R. Can be turned on using temp flag jsMode:true
2011-05-10 15:30:02 -07:00
agirbal
8d13203c40
SERVER-2976: added M/R pure jsMode with collection output
2011-05-10 15:30:01 -07:00
agirbal
1725803c20
SERVER-2579: all v8 object creation is now lazy.
...
Correct allocation and freeing of underlying C++ object.
Correct ordering of object properties even when new ones are added within JS.
Supports deletion of properties with lazzy wrapper.
Also removed scope->setThis in favor of passing it in the invoke() command.
2011-05-02 16:08:41 -07:00
Eliot Horowitz
df30db031c
better error message in mr
2011-04-20 09:06:43 -04:00
Eliot Horowitz
c2956f1d8b
initialize _dupCount SERVER-2551
2011-03-31 08:23:40 -04:00
Eliot Horowitz
8cd20b51fd
fix m/r handling of undefined SERVER-2861
2011-03-30 03:23:37 -04:00
Aaron
fce112398b
SERVER-1465 remove replica pairs
2011-03-29 16:56:53 -07:00
Eliot Horowitz
ca198bc64f
fix race condition between dropping database or colletion and map/reduce cleanup SERVER-2542
2011-02-12 17:39:44 -05:00
Mathias Stearn
4e77ed6771
Missing commitIfNeeded in mapReduce
2011-02-11 19:27:08 -05:00
Eliot Horowitz
922f614d0f
fix memory leak on exception in State::reduceInMemory SERVER-2522
2011-02-10 00:56:53 -05:00
Mathias Stearn
3174e3fc0d
Don't mix malloc and smart pointers
2011-02-09 23:16:57 -05:00
Eliot Horowitz
e0c8d9a6fc
don't use new[] for boost shared ptr SERVER-2504
2011-02-09 23:03:03 -05:00
agirbal
34f8e800ce
[CACHE-2398]: for inline mapreduce, all emitted objects are kept in RAM before the 1st reduce, potential high memory usage
2011-01-25 15:20:07 -08:00
agirbal
58bbafbc57
[SERVER-2333]: mapreduce: if results are inline vs into collection, it seems the execution may differ (different optimization?)
...
This was fixed, now reduce() isnt called for unique keys even when output to collection.
Added many comments all around mr.cpp
2011-01-24 15:07:54 -08:00
Eliot Horowitz
ef2657b9b6
remove Snapshot as it was extraneous
2011-01-24 11:39:12 -05:00
Eliot Horowitz
e2b9ab610d
fix m/r when a sharded connection for a non-sharded collection
2011-01-23 18:42:14 -05:00
Eliot Horowitz
2c5795d620
ability to take a chunk snapshot so you have a consistent view
2011-01-23 02:53:31 -05:00
Eliot Horowitz
32198fddd9
check for un-owned docs for sharded map/reduce
2011-01-22 00:27:28 -05:00
Eliot Horowitz
5d45bcfdd4
better error messages for m/r errors
2011-01-21 14:19:49 -05:00
agirbal
1830f9cb5e
[SERVER-1951]: support for output to other DB with sharding. Test in jstests/sharding/bigMapReduce.js
2011-01-19 00:16:29 -08:00
Eliot Horowitz
593819743e
create index on internal collection before hand so won't block SERVER-2372
2011-01-17 21:56:08 -05:00
Eliot Horowitz
418423388c
handle null finalize in m/r SERVER-2199
2011-01-16 00:51:19 -05:00
Eliot Horowitz
bbf5abc04a
reduce to an empty collection works SERVER-2272
2011-01-16 00:38:18 -05:00
agirbal
80fecd37e3
[SERVER-2286]: change to allow operations on slave if not replSet
2011-01-06 12:48:25 -08:00
agirbal
da0bc29177
[SERVER-1951]: M/R output param should allow us to use db.collection not only collection
2011-01-05 22:06:04 -08:00
Mathias Stearn
49af28aa00
Fix map reduce segfault
2011-01-05 12:43:05 -05:00
agirbal
f5e2323933
[SERVER-2286]: slaveOk is ignored for group() and mapReduce(), these are allowed to run on slave always
2011-01-04 23:17:22 -08:00
Eliot Horowitz
d5d2da55de
if using inline mr, don't put an empty "result" SERVER-2311
2011-01-04 01:52:54 -05:00
Eliot Horowitz
b828d21630
ran astyle SERVER-2304
2011-01-04 00:40:41 -05:00
Eliot Horowitz
b043cc1272
remove unused tempShort
2010-12-21 16:56:18 -05:00
Eliot Horowitz
5801ff1cda
better error handling for wrong types for query/sort SERVER-2228
2010-12-17 11:07:10 -05:00