Commit Graph

40 Commits

Author SHA1 Message Date
Alex Gorrod
e776e1832f Update wtperf graphing script to support running from a different directory. 2014-01-31 15:09:59 +11:00
Susan LoVerso
d935bfba7e Typo 2014-01-29 15:23:20 -05:00
Susan LoVerso
5cf6a1fb9f Add code to skip unused operations. 2014-01-29 14:04:16 -05:00
Susan LoVerso
10be01edc1 Rework to plot multiple wtperf monitor and latency files in one
directory.
2014-01-29 12:59:32 -05:00
Susan LoVerso
a5578b8b58 Output latencies in usecs. 2014-01-28 16:10:05 -05:00
Keith Bostic
5b509b7220 Update copyright notices for 2014.
Move lang/java and lang/python into the public domain.
2014-01-07 10:30:12 -05:00
Michael Cahill
391ee3aff7 Improve D3 stats graphs:
- assume a zero Y value if a series is missing a value at a timestamp
- support an optional right Y axis (with "--right" arguments, not yet rendered well)
2013-12-18 18:46:55 +11:00
Susan LoVerso
ca12d55181 Fix args to chart functions to use H:M:S when appropriate. 2013-12-17 12:23:25 -05:00
Keith Bostic
948ba0ca92 Add spinlock statistics for __wt_spin_trylock() calls.
Add spinlock statistics for the number of lock attempts made from each
location.

Spinlock graphs are always per-second, but aren't listed in the
automatically generated file, add explicit tests in the scripts.
2013-12-11 17:42:35 -05:00
Michael Cahill
ed99862b8a Improve the install instructions from wtstats.py if python-nvd3 is not found. 2013-12-11 11:23:19 +11:00
Michael Cahill
75efa8deb1 Add an alternative script to turn statistics logs into graphs using D3.
This is just a starting point, but I'm finding it useful and I don't want to lose it.  Rework the auto-generated list of unscaled statistics so it can be used from multiple scripts.
2013-12-04 15:25:55 +11:00
Keith Bostic
30b50f1e06 Use the same timestamp format in wtperf output as in statistics_log
output, that way it's easy to match the graphs against each other.

Fix a couple of trivial typos in statistics strings.
2013-11-27 14:01:34 -05:00
Keith Bostic
89ab46599f Track average, minimum and maximum latencies on a per operation basis. 2013-11-26 17:25:57 -05:00
Keith Bostic
87adb67a95 Graph average, minimum and maximum latencies. 2013-11-26 11:59:34 -05:00
Keith Bostic
f60a7c57bc renamed: wtperf.py -> wtperf_graph.py 2013-11-25 07:11:32 -05:00
Keith Bostic
c73f1fe70d Add a connection statistic when checkpoint is running so statlog will
track checkpoints.
2013-11-24 11:19:44 -05:00
Keith Bostic
028baec8a0 Add support for tracking operation latency in wtperf. 2013-11-23 15:08:03 -05:00
Keith Bostic
955cb2ae90 Handle when a checkpoint is happening as the run finishes. 2013-11-22 10:31:37 -05:00
Keith Bostic
d105ebd495 Add support for running a specific number of workload operations instead
of running for a specific period of time, based on new configuration
string run_ops.  API change is that both run_time and run_ops default to
0, and one must be specified.

Convert sample output to ops/second, not ops/sample-interval.

Increase the size of the png window.

A couple of minor bug fixes to avoid possible thread races.
2013-11-22 10:22:29 -05:00
Keith Bostic
59b0593162 Minor labeling/format changes. 2013-11-21 12:59:45 -05:00
Keith Bostic
693ad802d9 Graph thousands of ops per second. 2013-11-21 12:06:25 -05:00
Keith Bostic
81dab3f793 Merge branch 'develop' into wtperf-745 2013-11-21 11:55:03 -05:00
Keith Bostic
1f566daa0c Replace the stat_worker/stat_interval function/interval pair (that
dumped out run-tracking information) with the monitor/sample_interval
function/interval pair that logs performance data at per-second
intervals.

Add new tools script to plot the output of the wtperf monitor function.

Don't free per-thread information, it could race with monitoring thread.

Merge g_util_running and g_running variables into g_stop, replace
g_threads_quit/increment with g_error/assignment, declare variables
volatile so we don't cache them.
2013-11-21 10:51:02 -05:00
Michael Cahill
5d1c4134ab Cleanup warnings from s_all. 2013-11-21 16:16:35 +11:00
Alex Gorrod
fbceae85e6 Merge branch 'develop' into fine-grained-durability
Conflicts:
	src/conn/conn_log.c
	src/include/wiredtiger.in
	src/log/log.c
2013-11-18 13:05:36 +11:00
Keith Bostic
cc81a90184 Rename block manager statistics with "block manager" prefix so they sort
together.

Add a statistic for block manager memory allocations while holding the
system locked.
2013-11-17 13:13:09 -05:00
Alex Gorrod
51970260a3 Add statistics to log buffering and general review cleanup. 2013-10-25 07:25:17 +11:00
Keith Bostic
7781195afd I can't figure out how to keep long titles from being truncated in the
plot output, textwrap them in the python script.
2013-10-17 16:41:13 -04:00
Keith Bostic
020f937591 Avoid divide-by-zero. 2013-10-17 10:36:23 -04:00
Keith Bostic
aa71f64435 With spinlock logging, there will is potentially a lot more reports we skip,
number the reports sequentially instead of using an absolute number.
2013-10-14 13:44:08 -04:00
Keith Bostic
423b6ee8c1 Add a comment that the list of graphs we don't want to scale per second
is auto-generated.
2013-05-01 08:58:18 -04:00
Keith Bostic
ba47343283 Reverse the sense of the "scale" option, make it "no_scale" instead
(there are 100+ entries that scale, roughly 30 that don't).
2013-04-30 22:28:25 -04:00
Keith Bostic
9213cc4af1 Add support for aggregating data-source statistics, currently only
used by the LSM tree.

Add support for automatically updating the list of statistics that
are to be "scaled per second" by statlog.py.
2013-04-30 19:57:37 -04:00
Michael Cahill
868f664eed When generating statistics graphs, scale event counts to per second graphs. 2013-04-29 22:22:02 +10:00
Keith Bostic
c4f458a3a0 Put the raw files in a subdirectory, reports/raw. 2013-04-23 17:18:16 -04:00
Keith Bostic
4756df0f90 Now there are multiple sets of objects, sort them so objects group
together.
2013-03-21 10:59:11 -04:00
Keith Bostic
b178693dc2 Optionally dump statistics for a list of objects as part of statistics
logging.
2013-03-20 13:49:17 -04:00
Keith Bostic
cc662ee7a3 If we're eating multiple files, the entries aren't in order and gnuplot
doesn't sort them -- sort on the leading timestamp.
2013-02-20 13:56:47 -05:00
Keith Bostic
6607210164 Support multiple files. 2013-02-20 13:36:39 -05:00
Keith Bostic
78fc8cb94b Add a new server thread that can be configured to periodically output
statistics to a file.
2013-02-20 12:25:47 -05:00