Commit Graph
126 Commits
Author SHA1 Message Date
Benjamin Bannier b252531bde Serialize command parameters to data output files
This patch adds any parameter used to data output files (currently JSON
and CSV files). With that users have direct access to both input values
(i.e., benchmark parameters) and the resulting timings which should
simplify follow-up analyses.
2019-01-18 07:45:32 +01:00
Colin Wahl 0878544ba8 update help text for cleanup command 2019-01-14 20:21:50 +01:00
Colin Wahl 5af43cfc7b add cleanup command which is executed at the end of each benchmark 2019-01-14 20:21:50 +01:00
Hugo Locurcio aa429fea70 Fix a typo in the command-line help 2019-01-02 19:32:22 +01:00
sharkdp 51fe31e7d2 Improve progress bar 'experience' 2018-12-12 19:45:15 +01:00
tcmal 048506bed4 Show (dimmed) # of runs along with range.
Fixes #78
2018-12-05 14:43:29 +01:00
Peter Steinbach 1dcefd9082 refined help text of export flags to separate summary results from summary+raw timings 2018-12-05 14:37:16 +01:00
sharkdp a4cf1eaa29 Format source code 2018-11-21 19:55:58 +01:00
Jason Peacock 3aa26a3e27 Moved types::Second and types::Unit to new unit module
Also review feedback.
2018-11-04 10:15:05 +01:00
Jason Peacock f0b6f130ea Add option to set time units for CLI & Markdown, closes #80
Add option to set the time units to either `MilliSecond` or `Second`
for both CLI output and Markdown export, overriding the default logic.
2018-11-04 10:15:05 +01:00
Jason Peacock 01581f60e0 Add option to set the shell, closes #61
Allow the user to set the shell used for executing benchmark commands.

The option (-S/--shell) can be overridden, when there are duplicate
options the last option's value will be used.
2018-10-31 18:02:37 +01:00
Jason Peacock 0b18446c0c Addressed review feedback 2018-10-28 08:46:01 +01:00
Jason Peacock 29804c54c9 Change markdown export to use seconds, closes #71
The markdown results exporter was using milliseconds, but the other
results exporters are using the default seconds unit.

Apply some refactoring so the same logic used to select units for the
CLI output can be used to select the units for the markdown exporter.

Now the units of the markdown exporter match that of the CLI.

When there are multiple benchmarks, the CLI will choose the
appropriate unit for each benchmark separately. In this case, the
markdown exporter will use the first benchmark to select the units for
all the results.

*This will change the markdown results for all users from milliseconds
to seconds, a UX breaking change.*

Add unit tests for the markdown exporter to verify the output.

Issue #80 proposes a new option to choose the units used for both the
CLI report and results export.
2018-10-28 08:46:01 +01:00
sharkdp df171392ec Change color override part 2018-09-28 21:57:53 +02:00
sharkdp 681e506a3f Remove newline 2018-09-28 21:57:53 +02:00
Jason Peacock 3246ec27e1 Compact output, add -s color option, closes #70
Strip the empty lines within the results for each benchmark, but keep
the empty line between each benchmark, and before the summary.

Add `color` style option to show color but not be interactive (no
progress bar).
2018-09-28 21:57:53 +02:00
sharkdp f85e61dc39 cargo fmt 2018-09-27 23:07:24 +02:00
Sergey "Shnatsel" Davidoff 156933489b Better-sounding final performance report 2018-09-15 20:53:31 +02:00
Sergey "Shnatsel" Davidoff dc04fe8513 Compute and print standard deviation of the speed ratio 2018-09-15 20:53:31 +02:00
Diogo Sousa 0466a1d7cf Addressed review comments. 2018-09-09 23:18:18 +02:00
Diogo Sousa d78c33b864 Added options to specify the max/exact numbers of runs.
Fixes #77.
2018-09-09 23:18:18 +02:00
Ta Thanh Dinh bdccc10a61 change windows cmd interpreter 2018-08-27 20:03:55 +02:00
Tuomas Siipola 5ccf1a4d61 Support Rust 1.20.0 2018-07-05 19:12:41 +02:00
Tuomas Siipola fb9b30c7f8 Support parameter in preparation command 2018-07-05 19:12:41 +02:00
Felix Yan 4d68c5f72c Fix a typo in main.rs 2018-06-15 20:59:46 +02:00
sharkdp 22491e2385 Run 'cargo fmt' 2018-05-22 22:57:51 +02:00
sharkdp e6d31f5914 Add comment about --show-output option 2018-05-22 22:57:16 +02:00
Christian Duerr 556788c160 Print stderr with --show-output flag
The `--print-stdout` flag has been changed to `--show-output` and now
both stderr and stdout are forwarded when this option is specified.
2018-05-22 22:54:08 +02:00
Christian Duerr e53726d3f7 Fix windows 2018-05-22 22:54:08 +02:00
Christian Duerr 4be435436e Allow forwarding benchmark's stdout to hyperfine
This change makes it possible to forward the stdout of the command the
user tries to benchmark to hyperfine's stdout using the `--print-stdout`
flag.

This should be irrelevant for most use-cases, however it makes it
possible to get some crude benchmarks of terminal emulators similar to
what's currently often done with `time cat file`.
2018-05-22 22:54:08 +02:00
sharkdp 1011eef7f3 Indentation 2018-05-14 18:43:17 +02:00
Steve Pentland 6b19af9415 All parsing of arguments now split out. 2018-04-24 21:20:05 +02:00
sharkdp 697deb6d88 Rename 'Result Comparison' 2018-03-24 21:38:32 +01:00
sharkdp 355765e7bf Update Markdown format 2018-03-24 21:23:55 +01:00
sharkdp be09ae413f Clean up the --help text 2018-03-24 20:41:35 +01:00
sharkdp d677901341 Allow for negative numbers 2018-03-24 20:33:50 +01:00
sharkdp 07f142528e Rename parameter to '--parameter-scan' 2018-03-24 20:33:50 +01:00
sharkdp e862cf8567 Implement '--parameter-range var min max', see #19 2018-03-24 20:33:50 +01:00
Steve Pentland 3966bf05c1 Add comparison output when 2 or more commands are run
This also includes a restructure to the internal types used
2018-03-24 19:20:09 +01:00
sharkdp 3351f52b1b Add newline to JSON output, closes #49 2018-03-21 22:56:01 +01:00
sharkdp 0756558d53 Use skip_serializing_if 2018-03-21 07:59:09 +01:00
sharkdp 8a25885714 Export list of runtimes to JSON 2018-03-21 07:59:09 +01:00
Steve Pentland 5fb66db100 Change to export-markdown long opt, update help text 2018-03-20 23:19:06 +01:00
Steve Pentland 5602c17bef Add backticks around benchmark command to render as code 2018-03-20 23:19:06 +01:00
Steve Pentland 8b933dc64d Add markdown support.
Don't create Strings to convert to bytes later, just serialize directly
to bytes in the first place
2018-03-20 23:19:06 +01:00
sharkdp 97920d5b74 Help message update 2018-03-20 22:00:11 +01:00
sharkdp 1bd5436109 Proper error handling for the exporter 2018-03-20 21:40:06 +01:00
sharkdp 9b5dd60a92 Refactored ExporterManager 2018-03-20 21:40:06 +01:00
sharkdp 4b8cc34815 Use String instead of bytes, change error handling 2018-03-20 21:40:06 +01:00
sharkdp bd81fe65a2 create_export_manager -> ExportManager::new 2018-03-20 21:40:06 +01:00