Commit Graph

90 Commits

Author SHA1 Message Date
agirbal
2fb57a8d5e SERVER-3630: 'this' supplied to map function not read only 2011-10-04 16:30:26 -07:00
Tony Hannan
8e75d326a6 SERVER-3345: Read-only users can't output mapReduce to existing collection 2011-09-29 19:41:05 -04:00
agirbal
b88a62a838 SERVER-2535: Need to print progress in MR post-process 2011-09-21 18:09:15 -07:00
agirbal
c0d758f4c9 SERVER-2428: Make the MR inline limits equal to general object size limit 2011-09-20 14:11:24 -07:00
agirbal
8f74943b01 fix error code 2011-09-13 15:03:53 -07:00
agirbal
cf953c1648 SERVER-2581: MR locks server for a long time in merge and reduce modes with many keys 2011-09-13 09:47:16 -07:00
gregs
a19bd10c50 handle m/r errors via assertion exceptions to keep consistent error interface SERVER-3478 2011-08-05 12:22:30 -04:00
gregs
b96bd28ad5 don't throw error with unfulfillable query in mr SERVER-3478 2011-08-05 12:22:30 -04:00
Eliot Horowitz
e78187243d cleaning and fix minor memory leak 2011-07-29 03:06:30 -04:00
gregs
e5d902202f full API change to command interface, add options SERVER-3405 2011-07-27 15:59:27 -04:00
Mathias Stearn
5a1d526d7a Clean up cursor if exception thrown in reduce 2011-07-08 18:15:36 -04:00
agirbal
7868057763 SERVER-2531: bug with finishMapReduce command, trying to create temp collection twice 2011-06-29 15:45:35 -07:00
agirbal
4fdb96d392 SERVER-3108: namespace too long for temporary collections in Map Reduce 2011-06-27 14:10:38 -07:00
agirbal
fd3938aba4 SERVER-2531: REPLACE mode now uses the finishMapReduce cmd on each shard, so that the replace is atomic. 2011-06-27 13:30:19 -07:00
agirbal
1388ecbdb7 SERVER-2531: added REDUCE mode for M/R to sharded output collection 2011-06-26 19:00:52 -07:00
agirbal
0592a5f6d6 SERVER-3167: during final reduce in sharded environment, all results are loaded into an in memory map 2011-06-14 00:11:25 -07:00
agirbal
ebd06a579b SERVER-2761: Confusing Map / Reduce output when sharded 2011-06-13 16:19:06 -07:00
agirbal
ec68f3c6d5 SERVER-2531: added M/R output to shard collection for mode REPLACE 2011-06-13 14:33:38 -07:00
dwight
37204c7ca0 cleaning and a small insert optimization 2011-05-29 00:31:17 -04:00
agirbal
5cc563b581 - Added option for read only objects in JS invoke method
- map function uses RO input object which speeds up MR quite a bit
- added a flag in RO objects so that the BSON can be used as is when converting back
2011-05-25 17:41:40 -07:00
dwight
afd23f33f9 make a noreturn version of insert, would be faster unless cmopiler is very smart.
cleaning in insert()
2011-05-24 10:05:31 -04:00
Aaron
859bb3ad16 SERVER-2977 generate cursor in NamespaceDetailsTransient, and short circuit some simple queries 2011-05-17 22:54:22 -07:00
Aaron
dc922edc31 SERVER-2977 Use query optimizer cursor in map reduce 2011-05-17 12:20:09 -07:00
agirbal
51011c187b SERVER-2976: added fallback to mixed mode in case an emit key is an object 2011-05-13 16:25:29 -07:00
agirbal
d43037f198 SERVER-3092: M/R threshold for running reduces and dumping data to disk are too low, resulting in more CPU and disk I/O 2011-05-13 16:25:29 -07:00
agirbal
0f391def94 SERVER-2976: added fallback from js to mixed mode, added reduce steps within js mode 2011-05-13 15:00:11 -07:00
agirbal
b7509f5433 SERVER-2976: fix segv in m/r if ns doesnt exist 2011-05-12 11:16:06 -07:00
agirbal
fddb4b44db SERVER-2976: jsMode now works with inline output 2011-05-12 11:16:06 -07:00
agirbal
dad6b228f7 SERVER-2976: cleaner JS 2011-05-12 11:16:06 -07:00
agirbal
860369c353 SERVER-2976: slightly better js function. Cleanup of js objects. 2011-05-12 11:16:05 -07:00
agirbal
54ca9c202c Additional M/R output lines 2011-05-12 11:16:05 -07:00
agirbal
acb028bdcd SERVER-2976: fixed the emit count in js mode 2011-05-12 11:16:05 -07:00
agirbal
d47de50498 fix passing data pointer for native functions with spidermonkey 2011-05-10 20:05:30 -07:00
agirbal
088f11a6d6 fix compile 2011-05-10 19:15:18 -07:00
agirbal
13e71279c9 SERVER-2579: added readonly object for lazy v8 objects, which makes them much faster to access
SERVER-2976: further implementation of jsMode for M/R. Can be turned on using temp flag jsMode:true
2011-05-10 15:30:02 -07:00
agirbal
8d13203c40 SERVER-2976: added M/R pure jsMode with collection output 2011-05-10 15:30:01 -07:00
agirbal
1725803c20 SERVER-2579: all v8 object creation is now lazy.
Correct allocation and freeing of underlying C++ object.
Correct ordering of object properties even when new ones are added within JS.
Supports deletion of properties with lazzy wrapper.

Also removed scope->setThis in favor of passing it in the invoke() command.
2011-05-02 16:08:41 -07:00
Eliot Horowitz
df30db031c better error message in mr 2011-04-20 09:06:43 -04:00
Eliot Horowitz
c2956f1d8b initialize _dupCount SERVER-2551 2011-03-31 08:23:40 -04:00
Eliot Horowitz
8cd20b51fd fix m/r handling of undefined SERVER-2861 2011-03-30 03:23:37 -04:00
Aaron
fce112398b SERVER-1465 remove replica pairs 2011-03-29 16:56:53 -07:00
Eliot Horowitz
ca198bc64f fix race condition between dropping database or colletion and map/reduce cleanup SERVER-2542 2011-02-12 17:39:44 -05:00
Mathias Stearn
4e77ed6771 Missing commitIfNeeded in mapReduce 2011-02-11 19:27:08 -05:00
Eliot Horowitz
922f614d0f fix memory leak on exception in State::reduceInMemory SERVER-2522 2011-02-10 00:56:53 -05:00
Mathias Stearn
3174e3fc0d Don't mix malloc and smart pointers 2011-02-09 23:16:57 -05:00
Eliot Horowitz
e0c8d9a6fc don't use new[] for boost shared ptr SERVER-2504 2011-02-09 23:03:03 -05:00
agirbal
34f8e800ce [CACHE-2398]: for inline mapreduce, all emitted objects are kept in RAM before the 1st reduce, potential high memory usage 2011-01-25 15:20:07 -08:00
agirbal
58bbafbc57 [SERVER-2333]: mapreduce: if results are inline vs into collection, it seems the execution may differ (different optimization?)
This was fixed, now reduce() isnt called for unique keys even when output to collection.

Added many comments all around mr.cpp
2011-01-24 15:07:54 -08:00
Eliot Horowitz
ef2657b9b6 remove Snapshot as it was extraneous 2011-01-24 11:39:12 -05:00
Eliot Horowitz
e2b9ab610d fix m/r when a sharded connection for a non-sharded collection 2011-01-23 18:42:14 -05:00