diff --git a/docs/design-document.md b/docs/design-document.md index ad41837..7c1964e 100644 --- a/docs/design-document.md +++ b/docs/design-document.md @@ -258,17 +258,16 @@ The timestamp is the date (unix epoch) when the result was received by the serve About the json files -------------------- -If you check the JSON data files generated by the bots you will see that -the following: - - - The value for a test is as follows. There are two possibilities: +If you check the JSON data files generated by the bots you will see the +following format: +The value for a test is as follows. There are two possibilities: +```pre { ${NameOfTest}: {metrics: { ${NameOfMetric} : { current : [ list of values ] } } } } { ${NameOfTest}: {metrics: { ${NameOfMetric} : [ AggregationAlgorithm ] }}} - +``` The first option indicates that this specific test has real values for that metric produced from the browser while running it. @@ -280,7 +279,6 @@ A test can also contain subtests. Its mandatory that a test with aggreated value contain subtests. - This is explained better with an example: @@ -303,7 +301,7 @@ Here we have: * Main test suite with name SpeedometerExample with two metrics: Score and Time. * The metric "Score" for SpeedometerExample is calculated directly: we take the list of values in current and we calculate the mean (arithmetic mean) - * The metric "Time" for SpeedometerExample is an aggregated value that is calculated using the "Total" agregation algorithm with the values of the subtests. + * The metric "Time" for SpeedometerExample is an aggregated value that is calculated using the "Total" agregation algorithm with the values of the subtests. * Subtest AngularJS-TodoMV has one metric Time of aggregated value Total with the values of the subtests @@ -318,20 +316,17 @@ Here we have: * Subtests Sync has one metric Time with current values: we calculate the mean of the values. - - -Check the attached file speedometerexample.result that contains the above example, and run: +Check the attached file [sample-files/speedometerexample.result](sample-files/speedometerexample.result) that contains +the above example, and run the example script ```read-json-results``` from this directory (```docs```) * To generate a python dictionary with all the values calculated and print it: - -./read-json-results -print-results-dict speedometerexample.result +```pre +./read-json-results -print-results-dict sample-files/speedometerexample.result +``` * To print the results on plain text: - -./read-json-results -print-results-text speedometerexample.result - ```pre -$ ./read-json-results -print-results-text speedometerexample.result +$ ./read-json-results -print-results-text sample-files/speedometerexample.result SpeedometerExample:Score: 142.000pt stdev=0.7% :Time:Total: 674.220ms stdev=9.8% AngularJS-TodoMVC:Time:Total: 674.220ms stdev=9.8% @@ -343,11 +338,23 @@ SpeedometerExample:Score: 142.000pt stdev=0.7% Sync:Time: 429.160ms stdev=12.3% ``` +* To print the results on a format like what is inserted into this application database use : +```pre +./read-json-results -print-results-db sample-files/speedometerexample.result +Name=SpeedometerExample Metric=Score\None Unit=pt Value=142.0 Stdev=0.00704225352113 +Name=SpeedometerExample Metric=Time\Total Unit=ms Value=674.22 Stdev=0.098284410446 +Name=SpeedometerExample\AngularJS-TodoMVC Metric=Time\Total Unit=ms Value=674.22 Stdev=0.098284410446 +Name=SpeedometerExample\AngularJS-TodoMVC\Adding100Items Metric=Time\Total Unit=ms Value=217.81 Stdev=0.0290934151339 +Name=SpeedometerExample\AngularJS-TodoMVC\Adding100Items\Async Metric=Time\None Unit=ms Value=11.25 Stdev=0.173561103909 +Name=SpeedometerExample\AngularJS-TodoMVC\Adding100Items\Sync Metric=Time\None Unit=ms Value=206.56 Stdev=0.0294749686776 +Name=SpeedometerExample\AngularJS-TodoMVC\Adding200Items Metric=Time\Total Unit=ms Value=456.41 Stdev=0.136262489719 +Name=SpeedometerExample\AngularJS-TodoMVC\Adding200Items\Async Metric=Time\None Unit=ms Value=27.25 Stdev=0.395773479085 +Name=SpeedometerExample\AngularJS-TodoMVC\Adding200Items\Sync Metric=Time\None Unit=ms Value=429.16 Stdev=0.122973388375 +``` + +On the ```sample-files``` diretory there are more example of json files that were generated on the bots. -I have attached more json files, this time real ones generated on the bots -that you can run use as input to start programming the application. -You can also use the attached read-json-results script to parse and -process them. +You can use the ```read-json-results``` script in this directory to see how to parse and process them. Frontend @@ -411,7 +418,8 @@ Examples of browser performance related graphs: Format of the JSON files and what to store in the database ----------------------------------------------------------- -I'm not sure what is the best thing to do here. +This are the design considerations that were taken into account when +designing the format for storing the data on the database. We want the application to be fast. That it can draw the graphs quickly. @@ -431,7 +439,8 @@ I do this with the "-print-results-dict" output of ./read-json-results. By using the keyword "None" for real values, and indicating the aggregation algorithm for the others. -./read-json-results -print-results-dict speedometerexample.result +```pre +./read-json-results -print-results-dict sample-files/speedometerexample.result {u'SpeedometerExample': {'metrics': {u'Score': {None: {'mean_value': 142.0, 'raw_values': [142.0, @@ -444,7 +453,7 @@ algorithm for the others. u'Time': {u'Total': {'mean_value': 674.22, 'raw_values': [642.0, [....] - +``` Here we see: @@ -453,12 +462,13 @@ Here we see: The algorithm for aggregation are 3: +```pre aggregators = { 'Total': (lambda values: sum(values)), 'Arithmetic': (lambda values: sum(values) / len(values)), 'Geometric': (lambda values: math.exp(sum(map(math.log, values)) / len(values))), } - +``` So I think that we can store this on the DB, have an aggregation field that indicates how the value was generated. For real values we can use a keyword @@ -473,3 +483,22 @@ We have two options: * Do this step on the bots, and send to the server the JSON file already calculated. Something similar to what the command -print-results-dict-json already outputs. + +Final implementation: + + * On the ```benchmark_results.py``` file the method ```_generate_db_entries``` is used to +format the data from the json files to the database format. You can see it on the screen +by executing the script ```./read-json-results``` from this directory (```docs```) as follows: + +```pre +./read-json-results -print-results-db sample-files/speedometerexample.result +Name=SpeedometerExample Metric=Score\None Unit=pt Value=142.0 Stdev=0.00704225352113 +Name=SpeedometerExample Metric=Time\Total Unit=ms Value=674.22 Stdev=0.098284410446 +Name=SpeedometerExample\AngularJS-TodoMVC Metric=Time\Total Unit=ms Value=674.22 Stdev=0.098284410446 +Name=SpeedometerExample\AngularJS-TodoMVC\Adding100Items Metric=Time\Total Unit=ms Value=217.81 Stdev=0.0290934151339 +Name=SpeedometerExample\AngularJS-TodoMVC\Adding100Items\Async Metric=Time\None Unit=ms Value=11.25 Stdev=0.173561103909 +Name=SpeedometerExample\AngularJS-TodoMVC\Adding100Items\Sync Metric=Time\None Unit=ms Value=206.56 Stdev=0.0294749686776 +Name=SpeedometerExample\AngularJS-TodoMVC\Adding200Items Metric=Time\Total Unit=ms Value=456.41 Stdev=0.136262489719 +Name=SpeedometerExample\AngularJS-TodoMVC\Adding200Items\Async Metric=Time\None Unit=ms Value=27.25 Stdev=0.395773479085 +Name=SpeedometerExample\AngularJS-TodoMVC\Adding200Items\Sync Metric=Time\None Unit=ms Value=429.16 Stdev=0.122973388375 +``` diff --git a/docs/read-json-results b/docs/read-json-results new file mode 100755 index 0000000..8e2926d --- /dev/null +++ b/docs/read-json-results @@ -0,0 +1,71 @@ +#!/usr/bin/env python +import sys +import os +import json +import argparse +utils_dir = os.path.join(os.path.dirname(os.path.realpath(__file__)), '..', 'dashboard', 'core', 'bots', 'reports', 'utils') +sys.path.append(utils_dir) +from benchmark_results import BenchmarkResults +from pprint import pprint + + +if __name__ == '__main__': + parser = argparse.ArgumentParser(description='Read the results from the browser based performance benchmarks.') + group = parser.add_mutually_exclusive_group(required=True) + group.add_argument('-cleanfile', dest='clean_file', action='store_true', + help='Rewrite the JSON file without the debugOutput entries.') + group.add_argument('-print-raw', dest='print_raw', action='store_true', + help='Print the JSON file in raw format.') + group.add_argument('-print-results-dict', dest='print_results_dict', action='store_true', + help='Parse the JSON file, generate aggregated results, store them in a dict and print it.') + group.add_argument('-print-results-dict-json', dest='print_results_dict_json', action='store_true', + help='Parse the JSON file, generate aggregated results, store them in a dict, convert to JSON and print it.') + group.add_argument('-print-results-text', dest='print_results_text', action='store_true', + help='Parse the JSON file, generate aggregated results, print them to stdout.') + group.add_argument('-print-results-db', dest='print_results_db', action='store_true', + help='Parse the JSON file, generate aggregated results, and output a format appropiated for the DB.') + group.add_argument('-print-results-db-noaggregated', dest='print_results_db_noaggregated', action='store_true', + help='Parse the JSON file, generate aggregated results, and output a format appropiated for the DB skipping the aggregated results.') + group.add_argument('-print-results-text-scaled', dest='print_results_text_scaled', action='store_true', + help='Parse the JSON file, generate aggregated results, print them to stdout with the metric unit scaled.') + parser.add_argument('json_file', type=str, help='Specify file you want to format') + args = parser.parse_args() + + if not os.path.isfile(args.json_file): + print ('ERROR: Cat find the file %s' % args.json_file) + sys.exit(1) + + results_json = json.load(open(args.json_file, 'r')) + + if 'debugOutput' in results_json: + del results_json['debugOutput'] + if args.clean_file: + json.dump(results_json,open(args.json_file, 'w')) + print('Wrote new file without debugOutput: %s ' %args.json_file) + sys.exit(0) + else: + if args.clean_file: + print('File already clean from debugOutput') + sys.exit(0) + + if args.print_raw: + pprint(results_json) + sys.exit(0) + + # Generate the aggregated results + results = BenchmarkResults(results_json) + + if args.print_results_dict: + pprint(results.format_dict()) + elif args.print_results_dict_json: + print results.format_json() + elif args.print_results_text: + print results.format(False) + elif args.print_results_text_scaled: + print results.format(True) + elif args.print_results_db: + results.print_db_entries() + elif args.print_results_db_noaggregated: + results.print_db_entries(skip_aggregated=True) + else: + raise RuntimError("This should have not been reached") diff --git a/docs/sample-files/chromium/animometer.result b/docs/sample-files/chromium/animometer.result new file mode 100644 index 0000000..d9b1e53 --- /dev/null +++ b/docs/sample-files/chromium/animometer.result @@ -0,0 +1 @@ +{"Animometer": {"metrics": {"Score": ["Geometric"]}, "tests": {"Paths": {"metrics": {"Score": {"current": [5800.795054279303]}}}, "Canvas Arcs": {"metrics": {"Score": {"current": [1529.5914541827824]}}}, "Canvas Lines": {"metrics": {"Score": {"current": [6873.021198301258]}}}, "Leaves": {"metrics": {"Score": {"current": [998.5338266024603]}}}, "Focus": {"metrics": {"Score": {"current": [114.31134208429782]}}}, "Suits": {"metrics": {"Score": {"current": [1165.9160558579822]}}}, "Multiply": {"metrics": {"Score": {"current": [817.6559338497497]}}}, "Design": {"metrics": {"Score": {"current": [132.6417027974514]}}}, "Images": {"metrics": {"Score": {"current": [140.60988923798013]}}}}}} \ No newline at end of file diff --git a/docs/sample-files/chromium/dromaeo.result b/docs/sample-files/chromium/dromaeo.result new file mode 100644 index 0000000..5e85fbe --- /dev/null +++ b/docs/sample-files/chromium/dromaeo.result @@ -0,0 +1 @@ +{"Dromaeo": {"tests": {"DOM Core Tests": {"metrics": {"Runs": {"current": [3402.1613029819678]}}, "tests": {"DOM Modification": {"metrics": {"Runs": {"current": [956.6854850452467]}}, "tests": {"appendChild": {"metrics": {"Runs": {"current": [[2451, 2485, 2487, 2775, 2818]]}}}, "insertBefore": {"metrics": {"Runs": {"current": [[2161, 2192, 2194, 2220, 2451]]}}}, "innerHTML": {"metrics": {"Runs": {"current": [[285.42914171656685, 294.7052947052947, 299.4011976047904, 301, 307]]}}}, "cloneNode": {"metrics": {"Runs": {"current": [[434, 440, 451, 458, 461.53846153846155]]}}}, "createElement": {"metrics": {"Runs": {"current": [[1036, 1055, 1105, 1143.7125748502995, 1150]]}}}, "createTextNode": {"metrics": {"Runs": {"current": [[878, 880, 898, 903, 917.0829170829171]]}}}}}, "DOM Attributes": {"metrics": {"Runs": {"current": [1175.4404688619516]}}, "tests": {"element.expando": {"metrics": {"Runs": {"current": [[651.3486513486514, 665, 673, 676, 676.3236763236763]]}}}, "getAttribute": {"metrics": {"Runs": {"current": [[2862, 2908, 3342, 3350, 3433]]}}}, "setAttribute": {"metrics": {"Runs": {"current": [[890, 890, 893, 901, 907]]}}}, "element.expando = value": {"metrics": {"Runs": {"current": [[289.4211576846307, 349.65034965034965, 352.64735264735265, 360.9172482552343, 378]]}}}, "element.property = value": {"metrics": {"Runs": {"current": [[1065, 1066, 1068, 1069, 1080]]}}}, "element.property": {"metrics": {"Runs": {"current": [[3112, 3120, 4077, 4166, 4233]]}}}}}, "DOM Query": {"metrics": {"Runs": {"current": [38354.1053584363]}}, "tests": {"getElementsByTagName(div)": {"metrics": {"Runs": {"current": [[254920, 256896, 258120, 258123, 260343]]}}}, "getElementsByTagName(*)": {"metrics": {"Runs": {"current": [[257542, 259110, 259930, 260917, 261255]]}}}, "getElementsByName": {"metrics": {"Runs": {"current": [[1547, 1565, 1580, 1713, 1723]]}}}, "getElementsByName (not in document)": {"metrics": {"Runs": {"current": [[5475, 5736, 5771, 5810, 5846]]}}}, "getElementsByTagName(a)": {"metrics": {"Runs": {"current": [[253046, 256726, 258291, 258494, 263442]]}}}, "getElementById (not in document)": {"metrics": {"Runs": {"current": [[5718, 5780, 5811, 5813, 5833]]}}}, "getElementById": {"metrics": {"Runs": {"current": [[1480, 1500, 1501, 1508, 1516]]}}}, "getElementsByTagName(p)": {"metrics": {"Runs": {"current": [[260104, 265495, 267041, 270858, 271925]]}}}, "getElementsByTagName (not in document)": {"metrics": {"Runs": {"current": [[438372, 485741, 492375, 493133, 496124]]}}}}}, "DOM Traversal": {"metrics": {"Runs": {"current": [713.0177669831319]}}, "tests": {"nextSibling": {"metrics": {"Runs": {"current": [[901, 905, 914, 915, 920]]}}}, "lastChild": {"metrics": {"Runs": {"current": [[531, 533.9321357285429, 534, 537, 542]]}}}, "childNodes": {"metrics": {"Runs": {"current": [[764, 804.1958041958042, 815, 819, 827]]}}}, "previousSibling": {"metrics": {"Runs": {"current": [[858, 877, 878, 882.1178821178821, 887]]}}}, "firstChild": {"metrics": {"Runs": {"current": [[528, 529, 537, 539, 541]]}}}}}}}}}} \ No newline at end of file diff --git a/docs/sample-files/chromium/es6bench.result b/docs/sample-files/chromium/es6bench.result new file mode 100644 index 0000000..547a544 --- /dev/null +++ b/docs/sample-files/chromium/es6bench.result @@ -0,0 +1 @@ +{"ES6SampleBench": {"metrics": {"Time": ["Geometric"]}, "tests": {"Air": {"metrics": {"Time": ["Geometric"]}, "tests": {"firstIteration": {"metrics": {"Time": {"current": [107.415, 99.51000000000002, 104.96500000000002, 93.09, 100.35000000000001, 97.72500000000001, 95.08000000000001, 104.81, 99.72999999999999, 92.15, 97.705, 95.2, 107.57000000000002, 98.85500000000002, 97.00500000000001, 88.11500000000001, 104.395, 82.285, 81.72500000000001, 82.57000000000001]}}}, "averageWorstCase": {"metrics": {"Time": {"current": [49.64000000000002, 54.64000000000016, 64.95499999999994, 57.88624999999996, 45.2950000000003, 63.459999999999965, 53.60249999999969, 54.008750000000106, 65.31875000000002, 56.163750000000036, 46.97000000000011, 57.50499999999993, 56.28999999999999, 56.22000000000008, 56.70375000000005, 60.73999999999981, 51.97875000000002, 57.09999999999999, 54.542499999999876, 56.809999999999974]}}}, "steadyState": {"metrics": {"Time": {"current": [6092.549999999999, 6067.549999999998, 6772.594999999993, 6097.7899999999945, 6007.975000000007, 6712.109999999992, 6048.034999999993, 6325.635000000001, 6423.775, 6377.940000000007, 6192.425000000004, 6300.775000000001, 6266.119999999997, 6117.800000000002, 6115.4800000000005, 6106.674999999999, 5993.119999999999, 5959.774999999998, 6011.970000000001, 6085.980000000002]}}}}}, "Basic": {"metrics": {"Time": ["Geometric"]}, "tests": {"firstIteration": {"metrics": {"Time": {"current": [60.06, 62.04000000000001, 63.575, 47.565, 50.89, 48.395, 50.825, 47.980000000000004, 48.83000000000001, 49.905, 52.265, 62.08500000000001, 50.845000000000006, 49.074999999999996, 50.30500000000001, 47.545, 48.47500000000001, 57.97500000000001, 52.21000000000001, 50.86000000000001]}}}, "averageWorstCase": {"metrics": {"Time": {"current": [35.652500000000245, 42.625, 40.2, 36.33124999999984, 59.980000000000246, 42.4699999999999, 39.88499999999987, 40.551249999999754, 38.663750000000164, 39.42999999999985, 56.42500000000007, 44.93875000000021, 33.836250000000064, 36.63749999999994, 43.381249999999625, 41.43250000000003, 34.932499999999806, 35.02374999999996, 46.68375000000011, 33.50374999999976]}}}, "steadyState": {"metrics": {"Time": {"current": [6217.300000000001, 6615.145, 6118.130000000005, 6167.294999999999, 7033.114999999998, 6615.430000000004, 6455.940000000006, 6583.979999999998, 6395.294999999998, 6367.709999999994, 6682.0400000000045, 6401.580000000004, 6240.095, 6144.97, 6165.3250000000035, 6169.5700000000015, 6157.165000000003, 6147.645000000006, 6177.770000000002, 6264.240000000001]}}}}}}}} \ No newline at end of file diff --git a/docs/sample-files/chromium/jetstream.result b/docs/sample-files/chromium/jetstream.result new file mode 100644 index 0000000..ed3fae2 --- /dev/null +++ b/docs/sample-files/chromium/jetstream.result @@ -0,0 +1 @@ +{"JetStream": {"metrics": {"Score": ["Geometric"]}, "tests": {"quicksort.c": {"metrics": {"Score": {"current": [[311.83879093198993, 318.2519280205656, 308.7281795511222], [304.9261083743842, 312.62626262626264, 312.62626262626264], [315.0127226463104, 306.43564356435644, 311.83879093198993], [307.96019900497515, 300.4854368932039, 306.43564356435644], [287.90697674418607, 296.8824940047962, 301.9512195121951]]}}}, "date-format-xparb": {"metrics": {"Score": {"current": [[145.94594594594594, 150, 154.28571428571428], [145.94594594594594, 144.64285714285714, 152.83018867924528], [140.8695652173913, 151.40186915887853, 150], [135, 145.94594594594594, 140.8695652173913], [135, 157.28155339805824, 148.62385321100916]]}}}, "n-body.c": {"metrics": {"Score": {"current": [[366.4167916041979, 358.88399412628485, 368.62745098039215], [373.70030581039754, 365.321375186846, 365.8682634730539], [365.321375186846, 373.70030581039754, 331.16531165311653], [365.8682634730539, 311.734693877551, 366.4167916041979], [360.4719764011799, 357.83308931185945, 371.42857142857144]]}}}, "cdjs": {"metrics": {"Score": {"current": [[109.48105977665851, 113.72036163075, 108.31889081455788], [100.7277580519251, 112.87955751213455, 107.59919300605253], [111.56978690170705, 111.98208286674135, 84.18925745074922], [108.58352787882076, 106.76061600875421, 108.80208900010871], [96.30895914092392, 109.73936899862825, 112.2365947417155]]}}}, "delta-blue": {"metrics": {"Score": {"current": [[482.2867853795689, 454.2642924086221, 466.0262417994376], [460.9184629803187, 448.9222118088096, 468.697282099344], [446.672914714152, 470.05623242736635, 451.40581068416105], [417.0103092783506, 449.4845360824741, 465.41705716963463], [458.2005623242737, 453.6082474226805, 463.07403936269924]]}}}, "gcc-loops.cpp": {"metrics": {"Score": {"current": [[643.7544610992148, 654.7368421052631, 637.1600141292829], [639.4186458702587, 653.0774800868935, 638.965639390719], [646.5232974910394, 634.9172826469553, 611.0433604336043], [621.5713301171605, 655.9272727272727, 622.8591160220994], [638.0615493455961, 580.7469414037347, 632.468443197756]]}}}, "code-multi-load": {"metrics": {"Score": {"current": [[87.67132843556126, 90.04507555492214, 89.18077323846961], [88.80384353480277, 89.98364655785475, 89.2978689688333], [90.07726514611585, 89.46686609287066, 82.66776584280782], [84.5405501012664, 83.34990792827247, 90.50419964903637], [89.98203536255018, 88.0541421504341, 87.70437257672505]]}}}, "regex-dna": {"metrics": {"Score": {"current": [[158.58585858585857, 160.20408163265304, 161.8556701030928], [157, 153.921568627451, 158.58585858585857], [160.20408163265304, 153.921568627451, 158.58585858585857], [153.921568627451, 155.44554455445544, 161.8556701030928], [150.96153846153845, 161.8556701030928, 163.54166666666669]]}}}, "crypto-md5": {"metrics": {"Score": {"current": [[139.53488372093022, 146.34146341463415, 146.34146341463415], [142.85714285714286, 133.33333333333334, 122.44897959183673], [146.34146341463415, 125, 139.53488372093022], [117.64705882352942, 136.36363636363635, 142.85714285714286], [120, 142.85714285714286, 146.34146341463415]]}}}, "tagcloud": {"metrics": {"Score": {"current": [[123.3050847457627, 129.33333333333334, 122.26890756302521], [122.78481012658229, 126.52173913043478, 127.63157894736841], [120.24793388429752, 120.74688796680498, 127.63157894736841], [132.27272727272728, 125.43103448275862, 111.49425287356321], [106.98529411764706, 121.25, 113.671875]]}}}, "hash-map": {"metrics": {"Score": {"current": [[169.66966966966967, 201.78571428571428, 205.45454545454547], [198.94366197183098, 204.71014492753622, 206.20437956204378], [210.82089552238807, 201.067615658363, 198.94366197183098], [207.72058823529412, 201.78571428571428, 212.406015037594], [205.45454545454547, 196.86411149825784, 196.18055555555554]]}}}, "towers.c": {"metrics": {"Score": {"current": [[295.8174904942966, 311.2, 309.9601593625498], [300.3861003861004, 311.2, 311.2], [308.73015873015873, 314.97975708502025, 308.73015873015873], [295.8174904942966, 299.2307692307692, 298.08429118773944], [291.38576779026215, 305.0980392156863, 309.9601593625498]]}}}, "base64": {"metrics": {"Score": {"current": [[133.33333333333334, 123.52941176470588, 127.27272727272728], [113.5135135135135, 113.5135135135135, 125.3731343283582], [113.5135135135135, 127.27272727272728, 129.23076923076923], [103.70370370370371, 113.5135135135135, 135.48387096774192], [112, 115.06849315068493, 116.66666666666666]]}}}, "3d-raytrace": {"metrics": {"Score": {"current": [[122.90076335877865, 129.83870967741936, 123.84615384615387], [121.969696969697, 110.27397260273975, 127.7777777777778], [113.38028169014086, 120.1492537313433, 129.83870967741936], [123.84615384615387, 120.1492537313433, 120.1492537313433], [123.84615384615387, 120.1492537313433, 126.77165354330711]]}}}, "code-first-load": {"metrics": {"Score": {"current": [[90.87507582383921, 92.2242005299212, 92.07064121603895], [89.45205225195038, 95.15267941435187, 94.59396496385814], [87.19613976946633, 92.46664580148256, 86.95129644249663], [86.59852647345737, 89.97501836193689, 91.96200879305417], [89.42803147723428, 90.11651238177028, 91.91602033975646]]}}}, "navier-stokes": {"metrics": {"Score": {"current": [[180.52692307692297, 182.093505297098, 186.13309767155923], [185.76194493442742, 173.5956351340967, 186.72444205844], [175.96153846153854, 184.0204206970672, 173.07692307692307], [176.923076923077, 187.09751786674866, 182.45769230769233], [174.82587064676625, 180.34657650042254, 184.7994478104148]]}}}, "box2d": {"metrics": {"Score": {"current": [[399.0786852589642, 399.4765702891324, 399.4765702891324], [384.54394693200663, 384.16169648774024, 390.9770687936187], [354.49933466400546, 403.1135531135527, 381.71641791044766], [381.71641791044766, 401.5091210613598, 385.69527611443783], [371.51530272787704, 368.67930805056534, 389.30833333333305]]}}}, "proto-raytracer": {"metrics": {"Score": {"current": [[342.0062695924768, 357.05329153605044, 348.2758620689657], [349.21630094043906, 359.2476489028215, 328.8401253918499], [347.6489028213168, 349.8432601880881, 333.855799373041], [326.959247648903, 325.07836990595627, 340.12539184953], [322.57053291536084, 328.2131661442007, 347.02194357366784]]}}}, "typescript": {"metrics": {"Score": {"current": [[131.88073394495416, 127.21238938053095, 134.03263403263395], [127.63596004439518, 127.07182320441987, 122.08067940552009], [124.5937161430119, 121.95121951219504, 120.67156348373554], [124.3243243243244, 128.6353467561521, 122.73212379935971], [125.272331154684, 117.46680286006134, 118.55670103092774]]}}}, "float-mm.c": {"metrics": {"Score": {"current": [[506.4516129032258, 482.6401446654611, 513.2692307692307], [502.63653483992465, 509.35114503816794, 422.9793977812995], [454.6848381601363, 493.3456561922366, 469.8943661971831], [474.9110320284698, 512.2840690978887, 489.72477064220186], [499.812734082397, 497.02048417132215, 508.3809523809524]]}}}, "regexp-2010": {"metrics": {"Score": {"current": [[391.7530576587071, 402.4016707274623, 395.27531292237137], [397.0878865380146, 407.220852412821, 386.0141083192443], [408.035294117647, 361.86391223155925, 399.85367281240843], [338.0014033446381, 401.0508394974756, 392.9201472048602], [400.65098821183517, 368.72880364869593, 385.6319161327899]]}}}, "bigfib.cpp": {"metrics": {"Score": {"current": [[457.93650793650795, 478.1767955801105, 469.1056910569106], [408.25471698113205, 476.8595041322314, 461.6], [430.5970149253731, 467.8378378378378, 457.93650793650795], [441.5816326530612, 459.15119363395223, 462.83422459893046], [428.46534653465346, 464.0750670241287, 459.15119363395223]]}}}, "splay": {"metrics": {"Score": {"current": [[250.4535681186282, 238.474142724745, 251.93938832252084], [264.75458758109363, 257.60407784986097, 248.96774791473587], [264.56886005560705, 251.93938832252084, 255.39854029196007], [259.27562557923994, 237.45264133456902, 243.86024096385543], [242.46728452270617, 247.76051899907324, 245.6246524559776]]}}}, "container.cpp": {"metrics": {"Score": {"current": [[334.9908480780964, 339.5485466914038, 335.60513447432766], [333.1614077669903, 341.5552099533437, 336.22167789344763], [298.8840500816549, 337.0472682627379, 318.56686974180445], [311.78307779670644, 331.4518563235738, 317.2782432822884], [309.32394366197184, 333.06035790112225, 308.5417252037089]]}}}, "gbemu": {"metrics": {"Score": {"current": [[400.78585461689516, 412.52446183952964, 385.15624999999966], [385.15624999999966, 404.76190476190425, 389.3385982230994], [373.33333333333326, 419.0854870775344, 387.80727630285116], [377.7777777777772, 412.12121212121207, 397.6608187134502], [379.28286852589633, 392.8286852589635, 402.3668639053252]]}}}, "richards": {"metrics": {"Score": {"current": [[231.6058563792703, 235.16151522193812, 239.2516848710203], [237.64815245177778, 235.55658842667916, 234.71996281663962], [240.57634208691618, 242.644666511736, 225.67975830815715], [206.76272368115266, 237.90378805484545, 227.9107599349292], [236.25377643504538, 229.23541715082496, 241.2735300952824]]}}}, "mandreel": {"metrics": {"Score": {"current": [[277.0393171960262, 272.50206440957896, 263.45449422372525], [280.89090651156215, 275.1528627015008, 274.08637873754157], [245.77572964669747, 278.12895069532243, 258.1090407177363], [266.34382566585987, 264.2362583015403, 276.4976958525348], [273.82104826441713, 273.82104826441713, 257.8599007170435]]}}}, "crypto-aes": {"metrics": {"Score": {"current": [[194.11764705882354, 188.57142857142858, 206.25], [212.90322580645162, 206.25, 159.03614457831324], [206.25, 180.82191780821918, 194.11764705882354], [203.07692307692307, 197.01492537313433, 206.25], [203.07692307692307, 194.11764705882354, 206.25]]}}}, "crypto-sha1": {"metrics": {"Score": {"current": [[93.18181818181816, 93.18181818181816, 91.1111111111111], [93.18181818181816, 91.1111111111111, 91.1111111111111], [91.1111111111111, 93.18181818181816, 78.84615384615384], [89.13043478260869, 87.23404255319147, 80.3921568627451], [89.13043478260869, 83.67346938775509, 91.1111111111111]]}}}, "zlib": {"metrics": {"Score": {"current": [[355.5407209612819, 360.84010840108385, 359.3792172739544], [357.44966442953, 356.01604278074865, 353.6520584329351], [362.8065395095368, 361.3297150610586, 334.5477386934672], [344.05684754521945, 335.3904282115866, 350.85638998682475], [331.6313823163137, 349.01703800786356, 349.01703800786356]]}}}, "crypto": {"metrics": {"Score": {"current": [[181.93158216336093, 183.5153836246577, 183.0603115275879], [182.66899081364403, 178.44365759571434, 180.70736650960873], [166.82870574045654, 186.75519103245156, 176.0911765190616], [174.67365683878396, 185.89502731675697, 183.71527001171634], [178.9991143207004, 184.1547287757009, 178.49531487417357]]}}}, "n-body": {"metrics": {"Score": {"current": [[285.7142857142857, 300, 260.8695652173913], [300, 260.8695652173913, 240], [272.7272727272727, 272.7272727272727, 272.7272727272727], [250, 260.8695652173913, 260.8695652173913], [300, 240, 260.8695652173913]]}}}, "earley-boyer": {"metrics": {"Score": {"current": [[168.20536921648315, 175.1846774192644, 176.6969907139963], [169.59000258012236, 176.39342880134234, 165.78336485764257], [161.96546077750392, 171.56199073259944, 165.91675415108128], [168.61639221711644, 174.3305351642047, 172.05766826172166], [169.03235993585878, 166.58878038784462, 166.1991946210334]]}}}, "dry.c": {"metrics": {"Score": {"current": [[422.636815920398, 423.6907730673317, 417.44471744471747], [409.3975903614458, 418.4729064039409, 400.70754716981133], [394.199535962877, 421.5880893300248, 382.65765765765764], [401.6548463356974, 417.44471744471747, 407.4340527577938], [417.44471744471747, 402.60663507109007, 421.5880893300248]]}}}, "mandreel-latency": {"metrics": {"Score": {"current": [[258.86046319499934, 253.6427415002698, 245.97526428522013], [257.15731735675143, 251.08849533883705, 256.7920121293241], [214.395099540582, 252.66779560788132, 232.20924923357896], [241.9201391720357, 232.5915665956698, 258.73933388384347], [253.41708678187265, 248.5063184053302, 232.10327291693864]]}}}, "date-format-tofte": {"metrics": {"Score": {"current": [[159.2, 164.46280991735537, 163.11475409836063], [159.2, 163.11475409836063, 164.46280991735537], [159.2, 164.46280991735537, 160.48387096774192], [149.62406015037593, 151.90839694656486, 155.46874999999997], [161.78861788617883, 161.78861788617883, 157.93650793650792]]}}}, "splay-latency": {"metrics": {"Score": {"current": [[778.8274320328859, 801.513970833803, 791.771234668266], [864.9316549540486, 794.4107529169825, 713.9315815567638], [759.5537621647275, 791.0163147114907, 778.2101167315187], [807.506822684959, 724.0061674599419, 752.9280535415492], [684.8187534981768, 786.9036745591303, 790.4859371140237]]}}}, "pdfjs": {"metrics": {"Score": {"current": [[261.33004926108396, 248.94012944983803, 246.0901259111993], [260.55992141453805, 253.11780190852252, 254.37334656084641], [243.42838413634863, 253.36791831357058, 262.884043607532], [234.27379784102084, 255.64140910601537, 244.38960184271133], [231.99708454810505, 244.63109354413703, 255.64140910601537]]}}}, "3d-cube": {"metrics": {"Score": {"current": [[114.0625, 112.3076923076923, 119.672131147541], [109.77443609022556, 113.17829457364341, 122.68907563025209], [109.77443609022556, 125.86206896551724, 123.72881355932202], [117.74193548387096, 119.672131147541, 118.69918699186991], [112.3076923076923, 113.17829457364341, 119.672131147541]]}}}}}} \ No newline at end of file diff --git a/docs/sample-files/chromium/jsbench.result b/docs/sample-files/chromium/jsbench.result new file mode 100644 index 0000000..f4f10cf --- /dev/null +++ b/docs/sample-files/chromium/jsbench.result @@ -0,0 +1 @@ +{"JSBench": {"metrics": {"Time": ["Geometric"]}, "tests": {"amazon/safari": {"metrics": {"Time": {"current": [32, 32, 30, 33, 31, 33, 33, 36, 32, 33, 32, 31, 33, 37, 33, 43, 35, 33, 37, 34]}}}, "google/chrome": {"metrics": {"Time": {"current": [181, 177, 172, 177, 210, 209, 236, 194, 194, 172, 185, 177, 171, 175, 198, 182, 198, 185, 187, 196]}}}, "twitter/firefox": {"metrics": {"Time": {"current": [23, 22, 20, 22, 23, 30, 25, 21, 22, 24, 23, 23, 23, 22, 23, 22, 23, 27, 26, 22]}}}, "amazon/chrome": {"metrics": {"Time": {"current": [31, 30, 32, 31, 31, 32, 34, 34, 30, 30, 38, 33, 31, 31, 33, 31, 33, 35, 34, 36]}}}, "facebook/firefox": {"metrics": {"Time": {"current": [126, 145, 128, 126, 130, 145, 144, 131, 131, 135, 128, 137, 130, 131, 133, 146, 139, 144, 155, 138]}}}, "amazon/firefox-win": {"metrics": {"Time": {"current": [25, 26, 23, 24, 25, 24, 30, 26, 23, 24, 24, 25, 35, 24, 25, 42, 26, 26, 24, 25]}}}, "facebook/chrome": {"metrics": {"Time": {"current": [215, 242, 217, 215, 219, 242, 239, 233, 226, 220, 217, 219, 220, 215, 234, 236, 238, 236, 222, 230]}}}, "yahoo/chrome-win": {"metrics": {"Time": {"current": [82, 80, 88, 85, 81, 92, 83, 82, 87, 83, 85, 81, 83, 84, 87, 83, 96, 85, 85, 88]}}}, "google/chrome-win": {"metrics": {"Time": {"current": [176, 164, 173, 184, 169, 197, 184, 192, 172, 169, 186, 169, 170, 196, 185, 209, 195, 184, 198, 187]}}}, "twitter/chrome-win": {"metrics": {"Time": {"current": [50, 51, 50, 52, 52, 54, 86, 57, 70, 59, 51, 51, 50, 55, 54, 57, 60, 57, 55, 56]}}}, "facebook/chrome-win": {"metrics": {"Time": {"current": [338, 325, 335, 335, 339, 361, 342, 326, 336, 319, 336, 317, 331, 370, 365, 364, 365, 369, 345, 351]}}}, "yahoo/firefox": {"metrics": {"Time": {"current": [105, 103, 114, 107, 103, 116, 119, 116, 105, 103, 115, 104, 121, 120, 114, 111, 126, 112, 114, 126]}}}, "facebook/safari": {"metrics": {"Time": {"current": [394, 347, 319, 358, 316, 350, 402, 342, 326, 326, 323, 330, 323, 322, 338, 367, 349, 354, 342, 347]}}}, "yahoo/firefox-win": {"metrics": {"Time": {"current": [52, 52, 61, 54, 52, 65, 59, 56, 54, 52, 54, 54, 54, 53, 59, 59, 60, 57, 65, 55]}}}, "google/firefox-win": {"metrics": {"Time": {"current": [120, 123, 116, 122, 124, 150, 144, 125, 129, 157, 138, 129, 123, 136, 138, 136, 149, 139, 137, 141]}}}, "google/safari": {"metrics": {"Time": {"current": [163, 155, 155, 151, 153, 173, 164, 158, 161, 158, 155, 153, 166, 184, 179, 175, 173, 168, 169, 186]}}}, "twitter/chrome": {"metrics": {"Time": {"current": [51, 53, 51, 52, 54, 87, 60, 52, 55, 53, 54, 53, 51, 70, 57, 56, 60, 58, 57, 54]}}}, "twitter/firefox-win": {"metrics": {"Time": {"current": [21, 22, 22, 24, 22, 24, 26, 21, 23, 22, 21, 21, 31, 24, 23, 27, 29, 23, 24, 22]}}}, "facebook/firefox-win": {"metrics": {"Time": {"current": [74, 66, 67, 68, 69, 69, 71, 63, 64, 63, 66, 64, 65, 68, 70, 67, 73, 73, 72, 76]}}}, "twitter/safari": {"metrics": {"Time": {"current": [24, 24, 23, 24, 24, 26, 26, 25, 23, 25, 24, 26, 25, 26, 24, 27, 27, 30, 26, 26]}}}, "yahoo/safari": {"metrics": {"Time": {"current": [77, 84, 79, 82, 81, 97, 88, 78, 94, 86, 78, 78, 79, 82, 98, 92, 88, 81, 88, 83]}}}, "google/firefox": {"metrics": {"Time": {"current": [108, 108, 109, 138, 114, 130, 118, 113, 116, 119, 117, 117, 113, 121, 122, 119, 123, 126, 121, 126]}}}, "amazon/chrome-win": {"metrics": {"Time": {"current": [31, 31, 32, 31, 31, 30, 34, 33, 31, 30, 31, 30, 30, 30, 32, 36, 32, 35, 33, 32]}}}, "amazon/firefox": {"metrics": {"Time": {"current": [25, 25, 26, 25, 26, 24, 26, 24, 26, 23, 25, 25, 27, 25, 25, 27, 27, 28, 27, 27]}}}, "yahoo/chrome": {"metrics": {"Time": {"current": [105, 103, 106, 104, 121, 112, 118, 108, 106, 112, 107, 116, 114, 106, 126, 127, 118, 155, 118, 136]}}}}}} \ No newline at end of file diff --git a/docs/sample-files/chromium/kraken.result b/docs/sample-files/chromium/kraken.result new file mode 100644 index 0000000..a12fccd --- /dev/null +++ b/docs/sample-files/chromium/kraken.result @@ -0,0 +1 @@ +{"Kraken": {"metrics": {"Time": ["Total"]}, "tests": {"ai-astar": {"metrics": {"Time": {"current": [[113, 120, 129, 134, 137, 119, 131, 133, 113, 140], [127, 120, 115, 117, 115, 120, 122, 134, 126, 119], [96, 119, 140, 118, 124, 142, 118, 144, 131, 112], [112, 126, 126, 127, 125, 126, 126, 126, 110, 108], [106, 111, 130, 107, 108, 140, 130, 111, 123, 105]]}}}, "imaging-gaussian-blur": {"metrics": {"Time": {"current": [[50, 52, 52, 52, 52, 52, 52, 52, 52, 50], [52, 53, 55, 53, 53, 52, 53, 53, 54, 51], [53, 64, 53, 52, 54, 55, 53, 53, 50, 52], [52, 50, 50, 49, 49, 53, 52, 52, 52, 53], [52, 51, 48, 53, 51, 52, 50, 50, 49, 49]]}}}, "audio-beat-detection": {"metrics": {"Time": {"current": [[56, 60, 66, 69, 58, 61, 63, 58, 66, 62], [64, 57, 64, 60, 70, 54, 61, 65, 63, 68], [60, 56, 61, 53, 63, 69, 66, 67, 74, 58], [51, 61, 61, 64, 56, 56, 53, 55, 65, 50], [56, 54, 54, 56, 54, 71, 56, 52, 52, 55]]}}}, "json-stringify-tinderbox": {"metrics": {"Time": {"current": [[23, 22, 22, 21, 23, 21, 20, 21, 21, 21], [21, 20, 21, 21, 23, 21, 21, 22, 21, 21], [21, 21, 22, 22, 22, 23, 22, 21, 23, 20], [20, 21, 21, 19, 21, 20, 20, 21, 21, 20], [20, 21, 22, 20, 21, 21, 22, 26, 19, 21]]}}}, "imaging-darkroom": {"metrics": {"Time": {"current": [[117, 116, 115, 114, 113, 114, 117, 112, 116, 110], [114, 117, 118, 117, 118, 118, 122, 113, 115, 111], [113, 119, 114, 115, 116, 118, 115, 117, 116, 121], [112, 109, 112, 109, 112, 108, 113, 109, 112, 109], [120, 108, 111, 107, 111, 114, 110, 108, 112, 109]]}}}, "stanford-crypto-pbkdf2": {"metrics": {"Time": {"current": [[77, 73, 74, 73, 80, 69, 75, 69, 88, 73], [70, 84, 72, 73, 83, 72, 75, 72, 68, 71], [70, 72, 69, 69, 73, 72, 71, 73, 77, 81], [68, 73, 70, 70, 67, 70, 91, 73, 67, 68], [67, 68, 69, 66, 68, 72, 71, 68, 70, 68]]}}}, "json-parse-financial": {"metrics": {"Time": {"current": [[44, 38, 44, 45, 46, 48, 40, 41, 53, 44], [39, 48, 44, 44, 46, 52, 42, 43, 44, 42], [45, 43, 46, 44, 45, 44, 47, 47, 43, 43], [37, 38, 39, 41, 42, 42, 43, 39, 42, 42], [45, 42, 44, 38, 45, 37, 44, 43, 42, 41]]}}}, "stanford-crypto-sha256-iterative": {"metrics": {"Time": {"current": [[33, 33, 34, 35, 32, 30, 32, 30, 32, 33], [33, 32, 34, 32, 32, 33, 30, 33, 33, 32], [32, 32, 32, 33, 32, 33, 33, 33, 31, 32], [32, 30, 31, 29, 31, 33, 30, 30, 31, 31], [32, 31, 32, 31, 29, 33, 32, 31, 30, 30]]}}}, "audio-fft": {"metrics": {"Time": {"current": [[29, 29, 28, 29, 34, 29, 30, 30, 30, 30], [30, 29, 30, 29, 29, 32, 40, 33, 29, 31], [31, 30, 29, 30, 29, 29, 29, 28, 30, 29], [27, 28, 32, 28, 28, 29, 27, 28, 28, 28], [29, 29, 27, 28, 30, 29, 29, 30, 27, 28]]}}}, "audio-dft": {"metrics": {"Time": {"current": [[88, 85, 86, 92, 91, 87, 86, 91, 84, 93], [82, 92, 94, 91, 97, 98, 95, 92, 85, 83], [83, 86, 89, 91, 91, 103, 91, 118, 89, 85], [83, 97, 88, 84, 88, 86, 90, 92, 86, 84], [85, 85, 92, 86, 90, 91, 79, 86, 87, 86]]}}}, "stanford-crypto-ccm": {"metrics": {"Time": {"current": [[50, 50, 50, 56, 54, 51, 58, 50, 56, 52], [51, 51, 52, 49, 52, 53, 53, 54, 50, 52], [54, 49, 50, 54, 49, 51, 52, 49, 58, 54], [49, 49, 53, 48, 49, 49, 48, 51, 49, 48], [49, 47, 52, 58, 49, 51, 50, 48, 48, 46]]}}}, "audio-oscillator": {"metrics": {"Time": {"current": [[34, 34, 35, 35, 33, 33, 35, 34, 34, 34], [31, 33, 33, 32, 32, 38, 35, 52, 32, 33], [35, 33, 32, 33, 33, 34, 32, 32, 34, 34], [31, 33, 32, 31, 31, 34, 33, 31, 31, 32], [32, 33, 31, 34, 32, 33, 32, 32, 32, 33]]}}}, "stanford-crypto-aes": {"metrics": {"Time": {"current": [[42, 49, 44, 44, 49, 56, 45, 43, 43, 43], [44, 45, 46, 45, 51, 47, 52, 49, 45, 44], [43, 55, 47, 44, 50, 52, 43, 46, 44, 55], [77, 45, 54, 43, 40, 43, 46, 51, 48, 41], [44, 42, 40, 44, 46, 50, 43, 44, 43, 44]]}}}, "imaging-desaturate": {"metrics": {"Time": {"current": [[53, 48, 58, 52, 54, 51, 51, 49, 51, 50], [52, 50, 53, 53, 52, 56, 55, 53, 53, 48], [58, 47, 51, 51, 50, 49, 49, 51, 51, 52], [47, 49, 51, 51, 51, 51, 50, 49, 56, 46], [53, 51, 48, 72, 46, 47, 51, 52, 46, 46]]}}}}}} \ No newline at end of file diff --git a/docs/sample-files/chromium/octane.result b/docs/sample-files/chromium/octane.result new file mode 100644 index 0000000..b5e372e --- /dev/null +++ b/docs/sample-files/chromium/octane.result @@ -0,0 +1 @@ +{"Octane": {"metrics": {"Score": {"current": [38244.836232614776, 38073.40554826222, 38549.03811880995, 38421.408277062714, 38195.85876354253]}}, "tests": {"Mandreel": {"metrics": {"Score": {"current": [29386.391464597487, 28135.872566371712, 29997.395643564385, 27408.220689655183, 29616.197067448713]}}}, "MandreelLatency": {"metrics": {"Score": {"current": [84494.91525423729, 81724.59016393444, 85951.72413793109, 79130.15873015876, 83086.6666666667]}}}, "DeltaBlue": {"metrics": {"Score": {"current": [65827.08080000003, 68855.2852, 68504.85980000003, 67129.60540000003, 68709.82560000003]}}}, "NavierStokes": {"metrics": {"Score": {"current": [28083.66533864542, 26188.23529411767, 28464.335664335686, 28584.03193612774, 28732.135728542915]}}}, "EarleyBoyer": {"metrics": {"Score": {"current": [45930.181426490686, 45562.1863364882, 45217.963893901455, 45804.60144921157, 45325.29255314274]}}}, "SplayLatency": {"metrics": {"Score": {"current": [32582.231208373007, 35289.37266520678, 32970.441689734056, 38352.42895142098, 30708.597690841838]}}}, "CodeLoad": {"metrics": {"Score": {"current": [17754.539083053955, 18929.396025713693, 19032.384985918998, 18259.147889893844, 17849.295000526225]}}}, "Crypto": {"metrics": {"Score": {"current": [31558.57247656684, 31692.467167095136, 31239.413738673506, 32129.24949619165, 30884.338051227292]}}}, "Splay": {"metrics": {"Score": {"current": [24129.485100000013, 24822.158600000006, 23298.27690000002, 24162.08150000001, 24536.850549450555]}}}, "Gameboy": {"metrics": {"Score": {"current": [76941.69365853659, 79817.90127326152, 79506.41678048784, 75781.70457256463, 80053.12102161102]}}}, "Typescript": {"metrics": {"Score": {"current": [49021.78431372555, 46484.01786365299, 45537.736071428626, 44180.755717255706, 44597.99265477441]}}}, "Box2D": {"metrics": {"Score": {"current": [72799.35919999998, 61267.96846307387, 72581.61435692929, 70956.65284147557, 71968.20756972117]}}}, "Richards": {"metrics": {"Score": {"current": [36195.14060000003, 35863.301800000016, 36113.94600000002, 36293.98620000001, 36145.71780000001]}}}, "RegExp": {"metrics": {"Score": {"current": [5480.284516765283, 5353.397908366536, 5262.662350597609, 5449.561316051851, 5056.01189296333]}}}, "PdfJS": {"metrics": {"Score": {"current": [25833.94955839061, 29867.023598820073, 28814.789892051038, 28730.20636007831, 29362.2709]}}}, "zlib": {"metrics": {"Score": {"current": [73645.85445783143, 73966.67376573096, 72218.87901701324, 72907.99045801528, 74543.97463414639]}}}, "RayTrace": {"metrics": {"Score": {"current": [83248.76250000001, 77550.84720000006, 84950.73720000003, 84950.73720000003, 83396.76030000002]}}}}}} \ No newline at end of file diff --git a/docs/sample-files/chromium/speedometer.result b/docs/sample-files/chromium/speedometer.result new file mode 100644 index 0000000..663da6a --- /dev/null +++ b/docs/sample-files/chromium/speedometer.result @@ -0,0 +1 @@ +{"Speedometer": {"metrics": {"Score": {"current": [[142.82313734825038, 141.4603422666664, 143.4845216072317, 141.1423117766454, 143.28407090514577], [139.90253456758452, 139.2974763940525, 140.87790413929474, 147.71879967923928, 137.60498523203705], [139.67734533228253, 144.4006085454216, 143.36061167194293, 143.5573511617895, 139.8829645862961], [144.70359019943254, 141.6284916059827, 139.24644465699777, 144.359661785935, 135.98570207475387], [143.71454185857104, 134.02451691341523, 141.88997445980465, 142.25811040584193, 137.78646051187755]]}, "Time": ["Total"]}, "tests": {"FlightJS-TodoMVC": {"metrics": {"Time": ["Total"]}, "tests": {"DeletingAllItems": {"metrics": {"Time": ["Total"]}, "tests": {"Async": {"metrics": {"Time": {"current": [[4.130000000000109, 4.160000000000764, 4.104999999999563, 4.144999999998618, 4.114999999997963], [4.105000000000473, 4.1250000000009095, 4.1599999999998545, 4.164999999999054, 4.105000000003201], [4.110000000000582, 4.145000000000437, 4.1599999999980355, 4.259999999998399, 6.470000000001164], [4.1349999999997635, 4.094999999999345, 4.100000000000364, 4.525000000001455, 4.709999999999127], [4.115000000000691, 4.180000000000291, 4.0900000000001455, 4.19499999999789, 4.489999999997963]]}}}, "Sync": {"metrics": {"Time": {"current": [[40.2450000000008, 40.99999999999909, 45.05000000000109, 39.8650000000016, 54.06999999999971], [43.11499999999978, 43.93499999999949, 44.00500000000102, 42.3700000000008, 43.904999999998836], [40.409999999999854, 41.10999999999967, 43.70000000000073, 43.75500000000102, 44.23500000000058], [40.36500000000024, 42.08000000000084, 47.719999999999345, 40.965000000000146, 49.18000000000029], [42.13500000000022, 41.75, 45.94999999999891, 42.51000000000022, 40.909999999999854]]}}}}}, "CompletingAllItems": {"metrics": {"Time": ["Total"]}, "tests": {"Async": {"metrics": {"Time": {"current": [[5.830000000000837, 6.3100000000004, 6.700000000000728, 6.540000000000873, 6.694999999999709], [6.010000000000218, 6.005000000000109, 6.209999999999127, 6.319999999999709, 6.31000000000131], [6.335000000000946, 6.585000000000946, 6.75, 6.949999999998909, 6.13999999999578], [6.099999999999909, 6.194999999999709, 5.944999999999709, 6.205000000001746, 6.205000000001746], [6.2800000000002, 5.904999999999745, 6.365000000001601, 6.059999999999491, 6.549999999999272]]}}}, "Sync": {"metrics": {"Time": {"current": [[46.76499999999942, 46.37500000000091, 45.04000000000087, 50.034999999999854, 50.51000000000204], [46.039999999999964, 43.68499999999949, 44.905000000000655, 45.47999999999956, 44.72999999999956], [49.914999999999054, 44.32499999999982, 45.544999999998254, 48.150000000001455, 44.890000000003056], [44.750000000000455, 45.220000000000255, 48.6200000000008, 47.55499999999847, 49.77499999999418], [45.86000000000058, 45.475000000000364, 46.54500000000007, 47.31500000000051, 49.719999999997526]]}}}}}, "Adding100Items": {"metrics": {"Time": ["Total"]}, "tests": {"Async": {"metrics": {"Time": {"current": [[8.0600000000004, 7.765000000000327, 7.844999999999345, 7.549999999999272, 7.959999999999127], [7.350000000000364, 7.705000000000837, 8.145000000000437, 7.645000000000437, 7.969999999997526], [7.879999999999654, 8.150000000000546, 7.559999999999491, 8.3700000000008, 8.279999999998836], [7.9650000000001455, 7.614999999999782, 8.049999999999272, 8.710000000000946, 8.180000000000291], [8.349999999999454, 7.410000000000764, 7.68500000000131, 7.690000000000509, 8.584999999999127]]}}}, "Sync": {"metrics": {"Time": {"current": [[60.79999999999927, 62.94499999999971, 61.39000000000124, 61.030000000000655, 68.39500000000044], [57.654999999999745, 61.10499999999956, 62.034999999999854, 62.43499999999949, 56.88000000000102], [58.08499999999958, 54.43000000000029, 57.405000000000655, 58.72999999999956, 59.460000000002765], [61.85500000000002, 55.75500000000011, 58.590000000001965, 62.41500000000087, 62.97999999999956], [56.59999999999991, 62.69500000000062, 55.68499999999949, 71.13500000000022, 58.54000000000087]]}}}}}}}, "EmberJS-TodoMVC": {"metrics": {"Time": ["Total"]}, "tests": {"CompletingAllItems": {"metrics": {"Time": ["Total"]}, "tests": {"Async": {"metrics": {"Time": {"current": [[5.940000000000055, 5.5349999999998545, 5.875, 5.680000000000291, 6.125], [6.254999999999882, 5.715000000001055, 6.3700000000008, 6.010000000000218, 5.654999999998836], [6.459999999999809, 5.724999999999454, 5.585000000000946, 5.864999999999782, 5.604999999999563], [6.130000000000109, 5.799999999999272, 5.764999999997599, 6.194999999999709, 5.555000000000291], [5.954999999999927, 5.805000000000291, 6.010000000000218, 5.644999999998618, 5.819999999999709]]}}}, "Sync": {"metrics": {"Time": {"current": [[93.36999999999989, 96.78999999999905, 103.65500000000065, 104.30999999999949, 106.59499999999935], [109.60000000000014, 90.97499999999945, 104.29500000000007, 87.60000000000036, 105.70999999999913], [110.68499999999995, 93.89000000000033, 119.91500000000087, 89.89999999999964, 103.96999999999935], [91.03999999999996, 100.92500000000018, 115.95500000000175, 89.52999999999884, 94.58499999999913], [107.85000000000014, 91.3100000000004, 94.08500000000095, 98.84000000000196, 105.40499999999884]]}}}}}, "Adding100Items": {"metrics": {"Time": ["Total"]}, "tests": {"Async": {"metrics": {"Time": {"current": [[9.970000000000027, 9.210000000000946, 9.595000000001164, 10.135000000000218, 9.405000000000655], [10.929999999999836, 10.655000000000655, 9.579999999999927, 9.359999999998763, 10.454999999999927], [11.089999999999918, 9.479999999999563, 10.520000000000437, 9.350000000002183, 9.520000000000437], [9.7650000000001, 9.585000000000036, 9.764999999999418, 9.345000000001164, 9.31499999999869], [10.054999999999836, 9.980000000000473, 10.159999999999854, 10.219999999999345, 10.44000000000051]]}}}, "Sync": {"metrics": {"Time": {"current": [[433.475, 439.40499999999975, 452.83000000000084, 446.375, 403.65499999999884], [440.20000000000016, 468.4200000000001, 421.71999999999935, 405.70500000000175, 479.77000000000044], [442.7800000000001, 455.0749999999998, 452.47000000000025, 432.48499999999876, 495.3200000000015], [437.11, 434.7400000000007, 468.78499999999985, 404.5649999999987, 432.0400000000009], [437.43500000000006, 457.3149999999996, 410.40000000000146, 410.1150000000016, 418.7999999999993]]}}}}}, "DeletingItems": {"metrics": {"Time": ["Total"]}, "tests": {"Async": {"metrics": {"Time": {"current": [[4.309999999999718, 4.109999999999673, 4.105000000001382, 4.150000000001455, 6.885000000000218], [4.134999999999991, 4.149999999999636, 4.1200000000008, 4.140000000001237, 4.425000000001091], [4.099999999999909, 4.139999999999418, 4.170000000000073, 4.134999999998399, 4.119999999998981], [5.639999999999873, 4.1799999999993815, 4.559999999999491, 4.164999999999054, 4.099999999998545], [5.539999999999964, 4.125, 4.109999999998763, 4.140000000001237, 4.104999999999563]]}}}, "Sync": {"metrics": {"Time": {"current": [[164.3950000000002, 147.375, 146.59999999999854, 142.6999999999989, 153.04500000000007], [159.94499999999994, 142.34000000000015, 157.20999999999913, 134.71999999999935, 159.26999999999862], [139.55000000000018, 143.92000000000098, 149.39999999999964, 150.09000000000015, 156.32999999999993], [159.4949999999999, 140.84500000000116, 147.23000000000138, 156.78499999999985, 160.15500000000065], [145.06500000000005, 138.7550000000001, 154.36999999999898, 150.15000000000146, 160.27000000000044]]}}}}}}}, "BackboneJS-TodoMVC": {"metrics": {"Time": ["Total"]}, "tests": {"DeletingAllItems": {"metrics": {"Time": ["Total"]}, "tests": {"Async": {"metrics": {"Time": {"current": [[4.130000000000109, 4.150000000000546, 4.059999999999491, 4.149999999999636, 4.190000000000509], [4.1400000000001, 5.0600000000004, 4.135000000000218, 6.019999999998618, 4.094999999999345], [4.9849999999999, 4.100000000000364, 4.115000000001601, 6.259999999998399, 4.149999999999636], [4.089999999999918, 4.0700000000006185, 4.149999999999636, 4.170000000000073, 4.144999999998618], [4.164999999999964, 4.155000000001564, 6.559999999999491, 6.350000000000364, 6.050000000001091]]}}}, "Sync": {"metrics": {"Time": {"current": [[58.444999999999936, 58.75999999999931, 53.11499999999978, 58.780000000000655, 61.29000000000269], [60.63499999999999, 58.14499999999953, 58.26000000000022, 54.10499999999956, 67.47500000000218], [61.51999999999998, 58.034999999999854, 53.35499999999956, 56.100000000000364, 64.43499999999949], [59.07999999999993, 60.905000000000655, 58.29000000000087, 57.31499999999869, 56.75500000000102], [55.985000000000355, 54.904999999999745, 59.29000000000087, 59.73999999999978, 60.72999999999956]]}}}}}, "CompletingAllItems": {"metrics": {"Time": ["Total"]}, "tests": {"Async": {"metrics": {"Time": {"current": [[8.099999999999909, 8.30999999999949, 7.914999999999054, 8.265000000001237, 8.105000000001382], [8.02000000000021, 7.990000000000691, 8.4950000000008, 7.959999999999127, 8.2549999999992], [8.1550000000002, 8.50500000000011, 8.339999999998327, 7.940000000000509, 8.0049999999992], [7.934999999999945, 8.359999999999673, 7.8700000000008, 8.704999999999927, 8.385000000000218], [8.745000000000118, 7.9350000000004, 8.089999999998327, 8.209999999999127, 8.635000000000218]]}}}, "Sync": {"metrics": {"Time": {"current": [[81.75500000000011, 83.90499999999975, 79.4900000000016, 88.60999999999876, 88.40500000000065], [84.5, 78.17500000000018, 104.01000000000022, 77.27500000000146, 81.20499999999993], [81.39499999999975, 89.59000000000015, 78.3700000000008, 80.56999999999971, 79.32500000000073], [86.92999999999984, 84.28000000000065, 81.83500000000095, 84.26500000000124, 98.82500000000073], [87.23999999999978, 85.03499999999894, 85.27500000000146, 82.81500000000051, 81.1200000000008]]}}}}}, "Adding100Items": {"metrics": {"Time": ["Total"]}, "tests": {"Async": {"metrics": {"Time": {"current": [[7.470000000000027, 7.659999999998945, 7.809999999999491, 7.999999999998181, 8.270000000000437], [7.979999999999791, 8.284999999999854, 7.895000000000437, 8.489999999999782, 8.069999999999709], [7.779999999999973, 7.605000000001382, 7.865000000001601, 8.579999999999927, 8.010000000000218], [8.019999999999982, 7.8400000000001455, 7.370000000002619, 8.050000000001091, 7.739999999999782], [7.585000000000264, 7.914999999999054, 7.719999999999345, 8.520000000000437, 8.349999999998545]]}}}, "Sync": {"metrics": {"Time": {"current": [[77.61999999999989, 78.39500000000044, 76.59000000000015, 79.36000000000058, 79.71999999999935], [84.5600000000004, 76.99000000000069, 83.71999999999935, 74.14500000000044, 78.53999999999905], [81.82999999999993, 76.38500000000022, 79.70499999999993, 73.06500000000051, 82.47000000000116], [76.68000000000006, 82.82999999999993, 76.7549999999992, 77.1200000000008, 79.98999999999978], [77.56499999999983, 81.35000000000127, 76.32999999999993, 87.10000000000036, 80.60000000000036]]}}}}}}}, "AngularJS-TodoMVC": {"metrics": {"Time": ["Total"]}, "tests": {"DeletingAllItems": {"metrics": {"Time": ["Total"]}, "tests": {"Async": {"metrics": {"Time": {"current": [[4.3849999999997635, 4.170000000000073, 5.9649999999983265, 4.850000000002183, 6.270000000000437], [4.754999999999654, 4.089999999999236, 4.135000000000218, 4.079999999999927, 5.200000000000728], [4.0949999999998, 4.125, 5.200000000000728, 4.0900000000001455, 8.179999999996653], [4.434999999999945, 4.1250000000009095, 5.174999999999272, 4.169999999998254, 4.144999999996799], [4.130000000000564, 4.099999999999454, 4.700000000000728, 4.1299999999992, 4.119999999998981]]}}}, "Sync": {"metrics": {"Time": {"current": [[111.29499999999962, 112.4399999999996, 126.38500000000022, 114.86499999999978, 110.32999999999447], [120.12500000000045, 121.56000000000131, 121.42499999999927, 118.65499999999702, 117.86999999999898], [133.69999999999982, 116.70500000000084, 122.41500000000087, 117.7549999999992, 120.2599999999984], [116.93499999999995, 115.53999999999905, 118.98500000000058, 114.29999999999927, 121.84000000000015], [110.7800000000002, 121.16000000000076, 125.10999999999876, 115.5, 127.30999999999767]]}}}}}, "CompletingAllItems": {"metrics": {"Time": ["Total"]}, "tests": {"Async": {"metrics": {"Time": {"current": [[12.375, 13.055000000000291, 14.989999999997963, 12.269999999998618, 11.695000000003347], [12.169999999999618, 5.900000000000546, 14.260000000000218, 12.795000000000073, 12.789999999997235], [13.074999999999818, 12.80999999999949, 16.125, 13.079999999999927, 11.744999999998981], [11.860000000000127, 12.720000000000255, 12.694999999999709, 12.079999999998108, 12.674999999999272], [12.050000000000182, 12.0600000000004, 12.040000000000873, 12.219999999999345, 13.529999999998836]]}}}, "Sync": {"metrics": {"Time": {"current": [[127.38999999999987, 129.27499999999964, 130.01500000000124, 125.79500000000007, 118.71500000000015], [122.46000000000049, 127.52499999999964, 144.4549999999981, 126.56999999999971, 131.85000000000218], [122.05500000000029, 133.03000000000065, 135.65000000000146, 122.29500000000189, 127.07500000000437], [117.30000000000018, 152.98499999999967, 130.10499999999956, 126.26500000000124, 129.71999999999753], [122.875, 152.64000000000124, 129.6999999999989, 121.52499999999964, 127.80500000000029]]}}}}}, "Adding100Items": {"metrics": {"Time": ["Total"]}, "tests": {"Async": {"metrics": {"Time": {"current": [[9.75, 11.934999999998581, 10.460000000000946, 12.25, 14.590000000000146], [9.215000000000146, 17.299999999999272, 12.269999999998618, 8.669999999998254, 11.735000000000582], [9.449999999999363, 12.61999999999989, 10.090000000000146, 8.950000000000728, 9.434999999997672], [9.279999999999745, 12.2549999999992, 12.805000000000291, 8.520000000000437, 9.735000000000582], [9.579999999999472, 17.350000000000364, 9.734999999998763, 8.744999999998981, 8.744999999998981]]}}}, "Sync": {"metrics": {"Time": {"current": [[207.23000000000002, 198.97500000000036, 214.85499999999956, 203.8799999999992, 210.2400000000016], [205.85999999999967, 234.01500000000033, 219.92000000000007, 193.2900000000027, 219.42999999999665], [203.0350000000003, 203.88500000000113, 209.0699999999997, 197.22499999999854, 202.90999999999985], [195.62500000000045, 212.5699999999997, 210.1750000000011, 263.35499999999956, 220.38500000000022], [196.5350000000003, 208.90999999999985, 217.96000000000095, 203.8150000000005, 209.75499999999738]]}}}}}}}, "VanillaJS-TodoMVC": {"metrics": {"Time": ["Total"]}, "tests": {"DeletingAllItems": {"metrics": {"Time": ["Total"]}, "tests": {"Async": {"metrics": {"Time": {"current": [[4.394999999999982, 4.0900000000001455, 4.115000000000691, 4.2850000000016735, 4.149999999999636], [4.139999999999986, 4.295000000000073, 4.164999999999054, 4.254999999997381, 4.125], [4.125, 4.154999999999745, 4.315000000000509, 4.524999999997817, 4.165000000000873], [4.149999999999977, 5.385000000000218, 4.144999999999527, 4.195000000001528, 5.735000000000582], [4.165000000000077, 4.364999999999782, 4.359999999999673, 4.2849999999998545, 4.084999999999127]]}}}, "Sync": {"metrics": {"Time": {"current": [[24.11500000000001, 19.19499999999971, 29.659999999999854, 18.049999999999272, 20.109999999998763], [21.0150000000001, 18.25999999999931, 24.13000000000011, 16.704999999999927, 18.079999999999927], [22.875, 19.045000000000073, 23.659999999998945, 18.26000000000022, 19.094999999997526], [19.269999999999982, 17.625, 19.69499999999971, 17.610000000000582, 17.92500000000109], [19.43500000000006, 18.859999999999673, 19.154999999999745, 19.394999999998618, 18.13000000000102]]}}}}}, "CompletingAllItems": {"metrics": {"Time": ["Total"]}, "tests": {"Async": {"metrics": {"Time": {"current": [[6, 5.415000000000873, 7.919999999999163, 5.055000000000291, 5.43999999999869], [5.509999999999877, 5.375, 5.305000000000291, 4.9650000000019645, 5.429999999998472], [5.2999999999999545, 5.095000000000255, 5.290000000000873, 5.174999999999272, 5.274999999999636], [5.434999999999945, 5.220000000000255, 5.235000000000582, 5.3400000000001455, 5.319999999999709], [5.490000000000009, 5.454999999999927, 5.540000000001783, 5.005000000001019, 5.704999999999927]]}}}, "Sync": {"metrics": {"Time": {"current": [[36.79500000000007, 35.36999999999898, 30.9399999999996, 30.31999999999971, 29.25], [33.90000000000009, 37.44499999999971, 34.54499999999916, 28.484999999998763, 36.25], [36.26999999999998, 33.779999999999745, 30.419999999999163, 30.55500000000029, 35.585000000000946], [34.3599999999999, 44.905000000000655, 29.6899999999996, 29.320000000001528, 30.140000000001237], [39.184999999999945, 46.50500000000011, 34.85999999999876, 32.56500000000051, 30.57499999999891]]}}}}}, "Adding100Items": {"metrics": {"Time": ["Total"]}, "tests": {"Async": {"metrics": {"Time": {"current": [[50.39500000000004, 7.859999999999673, 7.519999999999527, 7.030000000000655, 7.390000000001237], [22.050000000000068, 7.169999999999163, 6.835000000000036, 6.7549999999992, 7.204999999999927], [24.394999999999982, 7.005000000000109, 7.144999999999527, 7.2150000000001455, 7.299999999999272], [29.024999999999977, 6.8149999999996, 7.354999999999563, 11.724999999996726, 7.0349999999998545], [23.370000000000005, 6.949999999999818, 7.209999999999127, 7.260000000000218, 7.234999999998763]]}}}, "Sync": {"metrics": {"Time": {"current": [[82.85500000000008, 81.19000000000051, 75.74999999999909, 67.76499999999942, 70.27499999999964], [75.49000000000001, 73.5600000000004, 68.55999999999949, 74.00000000000182, 68.13500000000022], [77.20500000000004, 67.05999999999949, 74.51999999999953, 69.93499999999767, 70.45000000000073], [76.55499999999995, 75.23499999999967, 70.54500000000007, 68.78500000000167, 65.92499999999927], [78.59999999999991, 78.07499999999982, 70.92500000000018, 67.11000000000058, 68.72499999999854]]}}}}}}}, "jQuery-TodoMVC": {"metrics": {"Time": ["Total"]}, "tests": {"DeletingAllItems": {"metrics": {"Time": ["Total"]}, "tests": {"Async": {"metrics": {"Time": {"current": [[4.130000000000109, 4.149999999999636, 4.149999999999636, 4.125000000001819, 4.110000000000582], [4.144999999999982, 6.0600000000004, 4.100000000000364, 4.095000000001164, 4.075000000000728], [4.1150000000002365, 4.149999999999636, 4.104999999999563, 8.350000000000364, 4.125], [4.1349999999997635, 4.160000000000764, 4.0900000000019645, 4.149999999999636, 4.0899999999983265], [4.099999999999454, 4.109999999999673, 4.079999999999927, 6.235000000000582, 17.710000000002765]]}}}, "Sync": {"metrics": {"Time": {"current": [[3.150000000000091, 3.074999999999818, 2.719999999999345, 2.875000000001819, 2.845000000001164], [3.1549999999997453, 3.119999999999891, 2.9400000000005093, 2.904999999998836, 2.959999999995489], [3.244999999999436, 2.9899999999997817, 2.9949999999989814, 3.4099999999998545, 3.5050000000010186], [3.0700000000001637, 3.175000000000182, 3.139999999999418, 3.110000000000582, 2.8649999999997817], [2.985000000000582, 3.144999999999527, 2.9249999999992724, 3.1749999999992724, 2.984999999996944]]}}}}}, "CompletingAllItems": {"metrics": {"Time": ["Total"]}, "tests": {"Async": {"metrics": {"Time": {"current": [[11.039999999999964, 11.819999999999709, 10.784999999999854, 11.06499999999869, 11.299999999999272], [11.534999999999854, 11.86999999999989, 12.350000000000364, 11.505000000001019, 11.339999999996508], [11.835000000000036, 11.704999999999927, 11.56500000000051, 11.534999999999854, 11.514999999999418], [11.465000000000146, 11.355000000000473, 11.524999999997817, 11.1200000000008, 11.614999999999782], [11.414999999999964, 11.275000000000546, 11.229999999999563, 11.534999999999854, 12.340000000000146]]}}}, "Sync": {"metrics": {"Time": {"current": [[281.105, 278.3200000000006, 265.4850000000006, 310.53499999999985, 301.95000000000255], [289.3699999999999, 294.83500000000004, 277.97999999999956, 309.34000000000015, 318.9300000000021], [291.6199999999999, 280.90499999999975, 269.15500000000065, 269.6700000000001, 309.9750000000022], [282.07000000000016, 276.10499999999956, 278.6849999999995, 263.375, 333.8700000000008], [284.2249999999999, 272.96000000000004, 292.7900000000009, 319.1299999999992, 331.6100000000024]]}}}}}, "Adding100Items": {"metrics": {"Time": ["Total"]}, "tests": {"Async": {"metrics": {"Time": {"current": [[9.254999999999654, 9.295000000000982, 9.055000000000291, 9.31499999999869, 9.399999999999636], [9.4350000000004, 10.1850000000004, 9.2400000000016, 9.100000000000364, 9.225000000000364], [9.484999999999673, 9.335000000000036, 9.209999999999127, 9.645000000000437, 9.235000000000582], [9.335000000000491, 9.260000000000218, 9.425000000001091, 9.455000000001746, 9.289999999999054], [9.125, 9.229999999999563, 9.56500000000051, 9.195000000001528, 9.194999999999709]]}}}, "Sync": {"metrics": {"Time": {"current": [[158.40000000000032, 163.01499999999942, 152.40500000000065, 174.6750000000011, 173.9449999999997], [170.27499999999964, 157.08500000000095, 162.57999999999993, 146.6999999999989, 179.3799999999992], [162.99500000000012, 160.17499999999927, 156.63000000000102, 157.0649999999987, 173.3149999999987], [157.65499999999975, 151.54999999999927, 158.11499999999796, 155.16500000000087, 176.51000000000022], [165.48000000000025, 156.0550000000003, 163.30499999999847, 172.64999999999964, 158.78000000000065]]}}}}}}}, "React-TodoMVC": {"metrics": {"Time": ["Total"]}, "tests": {"DeletingAllItems": {"metrics": {"Time": ["Total"]}, "tests": {"Async": {"metrics": {"Time": {"current": [[4.160000000000309, 4.230000000000473, 4.199999999998909, 4.100000000002183, 4.145000000000437], [4.1150000000002365, 4.109999999999673, 4.149999999999636, 5.170000000000073, 4.130000000001019], [4.154999999999745, 4.170000000000073, 5.31499999999869, 5.664999999999054, 4.120000000002619], [4.140000000000327, 4.150000000000546, 4.179999999998472, 4.0900000000001455, 4.18999999999869], [4.105000000000018, 7.329999999999927, 8.69000000000051, 4.150000000001455, 4.165000000000873]]}}}, "Sync": {"metrics": {"Time": {"current": [[153.97999999999956, 174.27999999999884, 156.57999999999993, 171.46999999999935, 161.38999999999942], [176.375, 174.21500000000106, 163.51000000000022, 174.1150000000016, 164.54499999999825], [173.26999999999998, 163.96000000000004, 163.1750000000011, 195.89500000000044, 156.92499999999927], [158.5349999999994, 177.4449999999997, 178.60000000000218, 166.38500000000022, 160.67499999999927], [161.41500000000042, 212.85000000000036, 176.7549999999992, 167.73999999999978, 164.3399999999965]]}}}}}, "CompletingAllItems": {"metrics": {"Time": ["Total"]}, "tests": {"Async": {"metrics": {"Time": {"current": [[8.175000000000182, 7.489999999999782, 8.069999999999709, 9.790000000000873, 19.540000000000873], [7.5, 8.284999999999854, 7.070000000001528, 8.015000000001237, 9.429999999996653], [8.364999999999782, 8.43499999999949, 7.545000000000073, 8.854999999999563, 7.9650000000037835], [8.139999999999418, 7.280000000000655, 7.975000000000364, 9.56499999999869, 6.43999999999869], [8.425000000000637, 8.919999999999163, 7.475000000000364, 7.369999999998981, 7.440000000002328]]}}}, "Sync": {"metrics": {"Time": {"current": [[289.9300000000003, 328.53499999999985, 292.60499999999956, 309.7599999999984, 283.47999999999956], [312.7000000000007, 319.9349999999995, 306.47999999999956, 300.53499999999985, 297.3100000000013], [330.8299999999999, 297.6300000000001, 289.7900000000009, 330.8349999999991, 286.12499999999636], [293.89500000000044, 321.85499999999956, 329.53999999999905, 300.4400000000005, 300.8899999999994], [302.46500000000015, 353.7950000000001, 323.39999999999964, 301.4400000000005, 350.62499999999636]]}}}}}, "Adding100Items": {"metrics": {"Time": ["Total"]}, "tests": {"Async": {"metrics": {"Time": {"current": [[9.840000000000146, 10.175000000000182, 10.420000000000073, 8.859999999998763, 10.209999999999127], [12.804999999999836, 9.4350000000004, 9.8799999999992, 9.854999999999563, 10.5], [10.115000000000236, 11.419999999999163, 10.474999999998545, 12.69000000000051, 10.639999999999418], [10.7199999999998, 10.319999999999709, 11.670000000000073, 10.510000000000218, 9.880000000004657], [10.125, 10.469999999999345, 9.505000000001019, 10.579999999999927, 11.164999999997235]]}}}, "Sync": {"metrics": {"Time": {"current": [[215.7449999999999, 239.51499999999942, 230.3249999999989, 223.0550000000021, 213.03499999999985], [218.81500000000005, 236.03999999999996, 221.75, 218.73499999999876, 225.46500000000015], [214.2550000000001, 219.1900000000005, 216.88500000000204, 218.4300000000003, 212.85499999999956], [218.01000000000022, 218.14999999999964, 231.32999999999993, 225.78499999999985, 295.04499999999825], [215.875, 291.1850000000004, 220.3050000000003, 226.875, 233.00000000000364]]}}}}}}}}}} \ No newline at end of file diff --git a/docs/sample-files/chromium/sunspider.result b/docs/sample-files/chromium/sunspider.result new file mode 100644 index 0000000..fd2dc4b --- /dev/null +++ b/docs/sample-files/chromium/sunspider.result @@ -0,0 +1 @@ +{"SunSpider": {"metrics": {"Time": ["Total"]}, "tests": {"math-spectral-norm": {"metrics": {"Time": {"current": [[1, 2, 2, 1, 1, 1, 1, 2, 2, 2], [1, 1, 2, 1, 1, 2, 2, 2, 1, 1], [2, 1, 1, 2, 1, 2, 2, 1, 1, 2], [1, 2, 2, 2, 2, 1, 1, 1, 2, 2], [1, 2, 1, 2, 2, 1, 2, 1, 1, 2]]}}}, "bitops-3bit-bits-in-byte": {"metrics": {"Time": {"current": [[1, 1, 1, 1, 1, 1, 1, 1, 1, 1], [0, 1, 1, 1, 1, 1, 1, 1, 1, 1], [1, 1, 1, 1, 1, 1, 1, 1, 1, 1], [1, 1, 1, 1, 1, 1, 1, 1, 1, 1], [1, 1, 2, 1, 0, 2, 2, 1, 0, 1]]}}}, "date-format-xparb": {"metrics": {"Time": {"current": [[6, 6, 6, 6, 7, 6, 6, 6, 10, 6], [7, 6, 7, 6, 6, 6, 6, 6, 6, 6], [6, 6, 6, 6, 6, 6, 6, 6, 6, 6], [6, 6, 6, 7, 6, 7, 6, 9, 6, 7], [6, 6, 7, 7, 6, 6, 6, 6, 6, 6]]}}}, "3d-morph": {"metrics": {"Time": {"current": [[8, 7, 10, 7, 7, 6, 6, 7, 10, 9], [7, 6, 6, 6, 10, 6, 6, 6, 9, 6], [10, 10, 10, 7, 6, 6, 7, 6, 9, 6], [10, 6, 10, 8, 7, 6, 6, 6, 7, 10], [8, 9, 7, 7, 8, 10, 6, 6, 5, 10]]}}}, "controlflow-recursive": {"metrics": {"Time": {"current": [[2, 2, 2, 1, 1, 1, 2, 2, 2, 2], [1, 2, 2, 1, 1, 2, 2, 2, 1, 1], [2, 1, 2, 2, 2, 1, 2, 1, 2, 2], [2, 1, 1, 2, 2, 1, 1, 1, 2, 2], [1, 2, 2, 2, 2, 2, 1, 1, 1, 2]]}}}, "string-base64": {"metrics": {"Time": {"current": [[4, 5, 4, 4, 4, 4, 4, 4, 4, 4], [4, 4, 4, 4, 4, 4, 4, 4, 4, 4], [4, 4, 4, 4, 5, 4, 4, 5, 4, 4], [4, 4, 4, 4, 4, 4, 4, 4, 4, 4], [4, 4, 5, 4, 4, 4, 4, 4, 4, 4]]}}}, "access-fannkuch": {"metrics": {"Time": {"current": [[6, 6, 5, 6, 6, 5, 5, 4, 5, 6], [4, 5, 5, 5, 5, 5, 5, 4, 5, 5], [6, 5, 5, 5, 5, 6, 5, 5, 5, 6], [5, 5, 6, 5, 5, 5, 6, 6, 5, 5], [5, 5, 5, 5, 5, 6, 6, 5, 5, 5]]}}}, "access-nsieve": {"metrics": {"Time": {"current": [[3, 2, 3, 2, 2, 3, 3, 3, 2, 3], [3, 2, 2, 3, 2, 3, 3, 2, 2, 2], [2, 3, 2, 3, 3, 3, 2, 2, 2, 3], [3, 2, 3, 2, 2, 3, 3, 3, 3, 3], [2, 3, 2, 3, 3, 2, 2, 3, 3, 3]]}}}, "crypto-md5": {"metrics": {"Time": {"current": [[4, 3, 3, 3, 3, 3, 3, 4, 3, 3], [3, 3, 4, 4, 3, 3, 3, 3, 3, 3], [3, 3, 3, 3, 3, 3, 3, 3, 3, 3], [3, 3, 3, 3, 3, 3, 3, 3, 3, 3], [3, 4, 3, 3, 3, 3, 3, 3, 3, 3]]}}}, "bitops-nsieve-bits": {"metrics": {"Time": {"current": [[3, 2, 3, 2, 3, 2, 3, 3, 3, 2], [3, 3, 2, 3, 2, 2, 2, 3, 3, 2], [4, 4, 2, 2, 2, 3, 2, 3, 3, 2], [3, 3, 3, 3, 2, 2, 3, 3, 2, 3], [3, 3, 3, 3, 2, 2, 2, 2, 3, 3]]}}}, "access-binary-trees": {"metrics": {"Time": {"current": [[1, 2, 1, 1, 1, 1, 2, 1, 2, 2], [1, 2, 1, 2, 1, 2, 1, 1, 1, 1], [1, 1, 1, 1, 1, 1, 1, 1, 1, 1], [1, 2, 2, 2, 1, 1, 2, 1, 1, 1], [1, 1, 2, 1, 1, 2, 1, 2, 2, 1]]}}}, "bitops-bitwise-and": {"metrics": {"Time": {"current": [[2, 3, 3, 2, 3, 2, 3, 3, 3, 2], [2, 2, 3, 4, 3, 2, 2, 2, 3, 3], [2, 4, 2, 2, 3, 3, 3, 3, 2, 3], [3, 3, 3, 2, 2, 3, 3, 2, 3, 2], [2, 3, 3, 3, 3, 2, 2, 3, 2, 3]]}}}, "string-validate-input": {"metrics": {"Time": {"current": [[7, 6, 6, 6, 7, 6, 7, 6, 6, 11], [7, 7, 6, 6, 6, 6, 7, 10, 7, 6], [7, 7, 6, 7, 6, 7, 7, 6, 6, 7], [6, 7, 6, 6, 6, 6, 7, 7, 6, 7], [6, 6, 6, 6, 6, 6, 6, 7, 7, 7]]}}}, "3d-raytrace": {"metrics": {"Time": {"current": [[8, 9, 9, 8, 9, 8, 8, 9, 9, 10], [10, 8, 9, 8, 8, 8, 9, 8, 8, 9], [9, 8, 9, 9, 8, 8, 9, 8, 9, 9], [9, 8, 8, 13, 9, 8, 11, 9, 9, 8], [8, 9, 8, 8, 8, 11, 8, 9, 8, 9]]}}}, "string-fasta": {"metrics": {"Time": {"current": [[10, 11, 11, 10, 11, 11, 11, 11, 11, 10], [11, 10, 10, 10, 11, 11, 10, 11, 11, 11], [14, 11, 12, 10, 11, 11, 10, 10, 11, 11], [11, 11, 11, 10, 11, 10, 11, 10, 13, 11], [10, 10, 10, 11, 10, 10, 10, 11, 11, 10]]}}}, "regexp-dna": {"metrics": {"Time": {"current": [[5, 6, 5, 5, 6, 5, 6, 5, 6, 5], [5, 6, 6, 5, 5, 5, 6, 6, 6, 5], [6, 6, 5, 6, 6, 5, 5, 6, 5, 6], [6, 5, 6, 6, 5, 6, 5, 6, 6, 5], [6, 6, 6, 6, 5, 5, 6, 5, 5, 6]]}}}, "math-partial-sums": {"metrics": {"Time": {"current": [[7, 7, 7, 8, 6, 7, 7, 6, 10, 7], [8, 7, 6, 7, 8, 7, 6, 6, 7, 8], [7, 8, 7, 7, 7, 7, 7, 7, 7, 7], [7, 7, 8, 7, 7, 7, 8, 7, 7, 7], [8, 7, 7, 7, 7, 7, 7, 7, 7, 8]]}}}, "access-nbody": {"metrics": {"Time": {"current": [[2, 2, 1, 1, 2, 1, 2, 2, 1, 2], [1, 1, 2, 2, 2, 1, 1, 1, 2, 2], [2, 2, 1, 1, 2, 1, 2, 1, 1, 1], [1, 1, 2, 2, 2, 1, 2, 2, 2, 1], [2, 1, 1, 2, 1, 1, 1, 1, 1, 1]]}}}, "string-tagcloud": {"metrics": {"Time": {"current": [[15, 16, 15, 15, 16, 16, 16, 15, 16, 15], [16, 16, 15, 16, 16, 16, 14, 16, 17, 15], [15, 16, 25, 15, 15, 15, 15, 16, 15, 14], [15, 15, 16, 16, 15, 15, 16, 16, 15, 15], [16, 16, 15, 16, 14, 15, 15, 16, 16, 16]]}}}, "bitops-bits-in-byte": {"metrics": {"Time": {"current": [[3, 4, 3, 3, 4, 4, 3, 4, 3, 3], [4, 3, 3, 4, 3, 3, 4, 4, 3, 3], [4, 5, 3, 4, 4, 4, 4, 4, 4, 4], [4, 3, 4, 4, 5, 4, 4, 3, 4, 3], [4, 5, 3, 4, 3, 4, 3, 4, 4, 4]]}}}, "string-unpack-code": {"metrics": {"Time": {"current": [[17, 17, 16, 17, 17, 25, 19, 17, 17, 22], [17, 17, 18, 17, 18, 17, 17, 18, 19, 17], [17, 17, 26, 17, 18, 17, 17, 17, 17, 17], [17, 17, 16, 16, 17, 17, 17, 17, 17, 17], [16, 16, 18, 17, 17, 17, 17, 16, 16, 17]]}}}, "crypto-aes": {"metrics": {"Time": {"current": [[4, 4, 4, 4, 5, 4, 4, 4, 4, 4], [4, 4, 4, 5, 4, 4, 4, 4, 4, 4], [4, 4, 4, 4, 4, 4, 4, 4, 4, 4], [4, 4, 4, 4, 4, 4, 4, 4, 4, 4], [5, 4, 4, 4, 4, 4, 4, 4, 4, 4]]}}}, "crypto-sha1": {"metrics": {"Time": {"current": [[3, 3, 4, 3, 3, 3, 3, 3, 3, 3], [3, 3, 3, 3, 3, 3, 3, 3, 3, 3], [3, 3, 3, 3, 3, 3, 3, 3, 3, 3], [3, 3, 3, 3, 3, 3, 3, 3, 3, 3], [3, 3, 3, 3, 3, 3, 3, 4, 3, 3]]}}}, "date-format-tofte": {"metrics": {"Time": {"current": [[7, 7, 7, 7, 7, 7, 7, 7, 7, 7], [8, 12, 7, 7, 8, 7, 7, 7, 7, 7], [7, 7, 6, 7, 6, 7, 7, 7, 7, 7], [7, 7, 7, 7, 7, 7, 8, 7, 7, 7], [7, 7, 7, 7, 7, 7, 7, 7, 7, 7]]}}}, "math-cordic": {"metrics": {"Time": {"current": [[4, 3, 4, 3, 3, 3, 3, 4, 4, 3], [3, 3, 3, 3, 5, 3, 3, 3, 3, 3], [3, 3, 3, 3, 4, 4, 3, 3, 3, 3], [3, 3, 4, 4, 3, 3, 3, 3, 3, 3], [3, 3, 3, 3, 4, 4, 3, 3, 3, 3]]}}}, "3d-cube": {"metrics": {"Time": {"current": [[11, 8, 8, 8, 7, 9, 7, 9, 9, 8], [9, 8, 7, 8, 8, 8, 8, 8, 7, 7], [9, 8, 9, 8, 8, 7, 10, 8, 9, 9], [8, 8, 8, 10, 8, 8, 8, 7, 7, 8], [9, 11, 7, 8, 7, 8, 7, 9, 8, 12]]}}}}}} \ No newline at end of file diff --git a/docs/sample-files/minibrowser-gtk/animometer.result b/docs/sample-files/minibrowser-gtk/animometer.result new file mode 100644 index 0000000..379c506 --- /dev/null +++ b/docs/sample-files/minibrowser-gtk/animometer.result @@ -0,0 +1 @@ +{"Animometer": {"metrics": {"Score": ["Geometric"]}, "tests": {"Paths": {"metrics": {"Score": {"current": [898.6858128956474]}}}, "Canvas Arcs": {"metrics": {"Score": {"current": [251.94623218197282]}}}, "Canvas Lines": {"metrics": {"Score": {"current": [871.206693453393]}}}, "Leaves": {"metrics": {"Score": {"current": [101.77153542904863]}}}, "Focus": {"metrics": {"Score": {"current": [211.9234170550923]}}}, "Suits": {"metrics": {"Score": {"current": [181.91975476813016]}}}, "Multiply": {"metrics": {"Score": {"current": [335.41278407113873]}}}, "Design": {"metrics": {"Score": {"current": [47.84977960868452]}}}, "Images": {"metrics": {"Score": {"current": [199.28169278994972]}}}}}} \ No newline at end of file diff --git a/docs/sample-files/minibrowser-gtk/dromaeo.result b/docs/sample-files/minibrowser-gtk/dromaeo.result new file mode 100644 index 0000000..01bf095 --- /dev/null +++ b/docs/sample-files/minibrowser-gtk/dromaeo.result @@ -0,0 +1 @@ +{"Dromaeo": {"tests": {"DOM Core Tests": {"metrics": {"Runs": {"current": [9175.357547433443]}}, "tests": {"DOM Modification": {"metrics": {"Runs": {"current": [1147.2715128719615]}}, "tests": {"appendChild": {"metrics": {"Runs": {"current": [[3477, 3491, 3498, 3507, 3510]]}}}, "insertBefore": {"metrics": {"Runs": {"current": [[3192, 3193, 3205, 3227, 3361]]}}}, "innerHTML": {"metrics": {"Runs": {"current": [[280.71928071928073, 296.11166500498507, 298.40319361277443, 299.7002997002997, 302]]}}}, "cloneNode": {"metrics": {"Runs": {"current": [[391.2175648702595, 454.0918163672655, 481.3466787989081, 484.64491362763914, 485.1024208566108]]}}}, "createElement": {"metrics": {"Runs": {"current": [[1854.2857142857142, 1857.0066730219257, 1880.4347826086957, 1884.8015488867377, 1992]]}}}, "createTextNode": {"metrics": {"Runs": {"current": [[766, 777.7777777777778, 786.9177403369673, 791, 801]]}}}}}, "DOM Attributes": {"metrics": {"Runs": {"current": [11719.167953695693]}}, "tests": {"element.expando": {"metrics": {"Runs": {"current": [[68405, 84279, 86624, 86854, 87536]]}}}, "getAttribute": {"metrics": {"Runs": {"current": [[23884, 168631, 169853, 171804, 172372]]}}}, "setAttribute": {"metrics": {"Runs": {"current": [[1955, 1994, 2012, 2013, 2023]]}}}, "element.expando = value": {"metrics": {"Runs": {"current": [[5010, 5052.73631840796, 5077, 5100, 6002.988047808765]]}}}, "element.property = value": {"metrics": {"Runs": {"current": [[2934, 3079, 3111, 3116, 3130]]}}}, "element.property": {"metrics": {"Runs": {"current": [[6731, 6790, 6806, 6950, 7065]]}}}}}, "DOM Query": {"metrics": {"Runs": {"current": [87174.01855978124]}}, "tests": {"getElementsByTagName(div)": {"metrics": {"Runs": {"current": [[489337, 499486, 503565, 504223, 506114]]}}}, "getElementsByTagName(*)": {"metrics": {"Runs": {"current": [[489142, 489679, 489992, 496622, 504256]]}}}, "getElementsByName": {"metrics": {"Runs": {"current": [[7029, 7071, 7228, 7232, 7266]]}}}, "getElementsByName (not in document)": {"metrics": {"Runs": {"current": [[10177, 10297, 10332, 10367, 10429]]}}}, "getElementsByTagName(a)": {"metrics": {"Runs": {"current": [[491272, 518087, 521967, 524784, 527011]]}}}, "getElementById (not in document)": {"metrics": {"Runs": {"current": [[9022, 9070, 9070, 9121, 9186]]}}}, "getElementById": {"metrics": {"Runs": {"current": [[7528, 7766, 7784, 7792, 7822]]}}}, "getElementsByTagName(p)": {"metrics": {"Runs": {"current": [[494056, 497347, 508203, 517043, 517656]]}}}, "getElementsByTagName (not in document)": {"metrics": {"Runs": {"current": [[856870, 858644, 860125, 866153, 872930]]}}}}}, "DOM Traversal": {"metrics": {"Runs": {"current": [1441.01094032782]}}, "tests": {"nextSibling": {"metrics": {"Runs": {"current": [[1399, 1453, 1454, 1460, 1460]]}}}, "lastChild": {"metrics": {"Runs": {"current": [[1210, 1218, 1225, 1229, 1237]]}}}, "childNodes": {"metrics": {"Runs": {"current": [[1673, 1687, 1692, 1710, 1721]]}}}, "previousSibling": {"metrics": {"Runs": {"current": [[1490, 1493, 1505, 1507, 1513]]}}}, "firstChild": {"metrics": {"Runs": {"current": [[1332, 1364, 1397, 1398, 1404]]}}}}}}}}}} \ No newline at end of file diff --git a/docs/sample-files/minibrowser-gtk/es6bench.result b/docs/sample-files/minibrowser-gtk/es6bench.result new file mode 100644 index 0000000..e07de68 --- /dev/null +++ b/docs/sample-files/minibrowser-gtk/es6bench.result @@ -0,0 +1 @@ +{"ES6SampleBench": {"metrics": {"Time": ["Geometric"]}, "tests": {"Air": {"metrics": {"Time": ["Geometric"]}, "tests": {"firstIteration": {"metrics": {"Time": {"current": [128.28500000000003, 100.73000000000002, 96.58500000000001, 83.56, 129.44, 72.875, 117.5, 77.685, 69.045, 49.80500000000001, 45.685, 48.080000000000005, 99.98500000000001, 43.975, 45.345000000000006, 49.35000000000001, 69.39500000000001, 61.3, 61.67, 46.004999999999995]}}}, "averageWorstCase": {"metrics": {"Time": {"current": [54.452499999999986, 54.92375000000003, 55.68000000000003, 56.7149999999999, 46.578750000000014, 55.12000000000004, 46.64499999999999, 55.83624999999992, 27.121249999999986, 35.092500000000044, 33.2575, 32.27250000000003, 30.322499999999984, 32.008749999999935, 35.15124999999995, 30.533750000000033, 34.29375, 34.222500000000004, 33.81499999999993, 32.12749999999995]}}}, "steadyState": {"metrics": {"Time": {"current": [3099.069999999999, 3596.390000000004, 3707.649999999997, 3801.2050000000036, 3278.6500000000037, 3457.5850000000005, 3039.310000000003, 3602.2549999999933, 2087.705, 2269.900000000001, 2322.755000000001, 2348.1349999999975, 2207.3999999999987, 2227.7649999999994, 2267.0999999999995, 2273.0549999999976, 2217.0600000000013, 2297.0000000000023, 2383.229999999999, 2266.8199999999974]}}}}}, "Basic": {"metrics": {"Time": ["Geometric"]}, "tests": {"firstIteration": {"metrics": {"Time": {"current": [52.18500000000002, 53.01000000000001, 46.480000000000004, 56.620000000000005, 54.34, 44.62500000000001, 44.75500000000001, 38.574999999999996, 34.265, 41.215, 33.425000000000004, 24.240000000000002, 30.745000000000008, 27.590000000000003, 27.25, 27.255000000000003, 31.19, 29.755000000000006, 29.365000000000006, 33.255]}}}, "averageWorstCase": {"metrics": {"Time": {"current": [31.986249999999995, 39.58125000000007, 36.75874999999991, 37.37249999999999, 28.405000000000012, 37.835000000000036, 31.72249999999999, 32.354999999999976, 18.075000000000063, 24.322500000000016, 22.404999999999994, 24.59000000000001, 19.168749999999907, 23.213749999999965, 21.468749999999986, 22.799999999999997, 18.80375000000002, 21.64374999999996, 21.858749999999993, 22.12625000000002]}}}, "steadyState": {"metrics": {"Time": {"current": [2781.219999999998, 2862.445000000001, 3063.06, 3059.1599999999994, 2742.045, 3024.279999999998, 2059.3300000000027, 2443.7749999999983, 1727.0300000000007, 1851.1249999999998, 1822.2249999999983, 1918.1799999999998, 1742.9650000000006, 1918.1500000000008, 1902.7, 1853.85, 1713.7949999999985, 1787.3049999999998, 1832.8049999999994, 1837.225]}}}}}}}} \ No newline at end of file diff --git a/docs/sample-files/minibrowser-gtk/jetstream.result b/docs/sample-files/minibrowser-gtk/jetstream.result new file mode 100644 index 0000000..037a944 --- /dev/null +++ b/docs/sample-files/minibrowser-gtk/jetstream.result @@ -0,0 +1 @@ +{"JetStream": {"metrics": {"Score": ["Geometric"]}, "tests": {"quicksort.c": {"metrics": {"Score": {"current": [[279.45823927765235, 287.90697674418607, 283.9449541284404], [285.9122401847575, 291.29411764705884, 299.7578692493947], [282.648401826484, 300.4854368932039, 291.9811320754717], [292.6713947990544, 296.8824940047962, 270.89715536105035], [295.4653937947494, 294.76190476190476, 296.17224880382776]]}}}, "date-format-xparb": {"metrics": {"Score": {"current": [[168.75, 160.3960396039604, 165.30612244897958], [143.36283185840708, 142.10526315789474, 140.8695652173913], [176.08695652173915, 140.8695652173913, 133.88429752066116], [163.63636363636363, 158.82352941176472, 143.36283185840708], [167.01030927835052, 172.3404255319149, 137.28813559322032]]}}}, "n-body.c": {"metrics": {"Score": {"current": [[357.3099415204678, 365.321375186846, 346.1756373937677], [305.88235294117646, 353.6903039073806, 351.14942528735634], [348.14814814814815, 339.44444444444446, 363.15007429420507], [365.8682634730539, 361.53846153846155, 359.4117647058824], [315.7622739018088, 362.0740740740741, 358.88399412628485]]}}}, "cdjs": {"metrics": {"Score": {"current": [[178.03097739006594, 126.35436080487735, 133.93156097234294], [174.68011703567797, 124.68827930174572, 151.06310661278758], [173.98869073510227, 126.37831348140686, 146.9183868361128], [184.17054192181942, 124.16190712689321, 162.8001628001628], [182.50672993566604, 137.51375137513762, 145.99072958867137]]}}}, "delta-blue": {"metrics": {"Score": {"current": [[293.8144329896907, 296.0637300843486, 308.62230552952195], [285.6472756052369, 303.09278350515484, 317.6194939081538], [268.55670103092774, 236.41049671977513, 313.35520149953146], [275.0234301780693, 313.5426429240862, 312.18499686044925], [262.74601686972824, 262.5117150890347, 323.19587628865975]]}}}, "gcc-loops.cpp": {"metrics": {"Score": {"current": [[503.4328774769746, 509.9802092168504, 507.68364762172814], [430.2958015267176, 498.28729281767954, 504.41834451901565], [501.8920422927101, 498.14968240817456, 506.97020798201237], [479.2242295430393, 504.13638904415876, 499.94456762749445], [506.11672278338943, 498.7005805916505, 496.91460055096417]]}}}, "code-multi-load": {"metrics": {"Score": {"current": [[116.76463900820968, 117.2621898038104, 142.9723353172635], [119.37380697057012, 125.65715907742374, 141.01781082758802], [117.89513227992379, 130.34296393847325, 143.31804033976724], [114.80581853900408, 121.33195455335107, 144.36183343493576], [119.93414786061544, 127.83320235027493, 143.65792549774596]]}}}, "regex-dna": {"metrics": {"Score": {"current": [[152.4271844660194, 152.4271844660194, 152.4271844660194], [155.44554455445544, 150.96153846153845, 155.44554455445544], [149.52380952380952, 150.96153846153845, 142.72727272727272], [153.921568627451, 134.1880341880342, 149.52380952380952], [153.921568627451, 155.44554455445544, 157]]}}}, "crypto-md5": {"metrics": {"Score": {"current": [[162.16216216216216, 113.20754716981132, 150], [176.47058823529412, 146.34146341463415, 150], [153.84615384615384, 136.36363636363635, 150], [146.34146341463415, 130.43478260869566, 150], [157.89473684210526, 122.44897959183673, 120]]}}}, "tagcloud": {"metrics": {"Score": {"current": [[176.36363636363637, 187.74193548387098, 187.74193548387098], [186.53846153846155, 181.875, 184.1772151898734], [192.71523178807948, 187.74193548387098, 183.0188679245283], [167.24137931034485, 191.44736842105263, 184.1772151898734], [155.6149732620321, 184.1772151898734, 181.875]]}}}, "hash-map": {"metrics": {"Score": {"current": [[348.7654320987654, 478.8135593220339, 487.0689655172414], [357.59493670886076, 437.984496124031, 455.64516129032256], [342.42424242424244, 448.41269841269843, 431.2977099236641], [344.5121951219512, 474.78991596638656, 474.78991596638656], [379.19463087248323, 444.88188976377955, 444.88188976377955]]}}}, "towers.c": {"metrics": {"Score": {"current": [[356.8807339449541, 361.86046511627904, 365.25821596244134], [361.86046511627904, 361.86046511627904, 287.0848708487085], [365.25821596244134, 358.5253456221198, 370.4761904761905], [363.5514018691589, 361.86046511627904, 370.4761904761905], [342.73127753303964, 344.24778761061947, 344.24778761061947]]}}}, "base64": {"metrics": {"Score": {"current": [[109.0909090909091, 63.1578947368421, 87.5], [109.0909090909091, 84, 88.42105263157895], [115.06849315068493, 88.42105263157895, 97.67441860465117], [125.3731343283582, 84, 80.76923076923076], [129.23076923076923, 89.36170212765957, 94.3820224719101]]}}}, "3d-raytrace": {"metrics": {"Score": {"current": [[129.83870967741936, 154.80769230769232, 140.00000000000003], [169.47368421052633, 187.20930232558143, 151.8867924528302], [142.4778761061947, 169.47368421052633, 146.36363636363637], [189.41176470588238, 157.843137254902, 157.843137254902], [175.00000000000003, 185.05747126436785, 161.00000000000003]]}}}, "code-first-load": {"metrics": {"Score": {"current": [[122.93248808359547, 126.52198475913937, 153.09591984549104], [125.53912046671262, 133.25830196856944, 158.75401289933316], [129.44588263475362, 136.8257513361202, 158.10852124745819], [124.39461613645759, 126.13173166049044, 159.88517187692037], [127.72212761400951, 130.3736543892555, 159.24693163060925]]}}}, "navier-stokes": {"metrics": {"Score": {"current": [[187.87425149700582, 187.09751786674866, 189.42307692307676], [178.23967449715946, 185.35384615384618, 191.53692767850282], [188.64943630646522, 186.3192307692308, 190.38461538461522], [188.46153846153823, 189.80116689697527, 186.72444205844], [190.18076923076907, 190.57443055449045, 187.87425149700582]]}}}, "box2d": {"metrics": {"Score": {"current": [[294.35590969455507, 302.24486414844245, 307.5885468387948], [306.59340659340666, 308.81522100365544, 309.7416666666666], [299.7180762852403, 305.98205383848443, 312.2710622710621], [305.3731343283578, 300.31571950814225, 311.33798140770233], [297.4825523429711, 301.2166666666663, 260.3917662682603]]}}}, "proto-raytracer": {"metrics": {"Score": {"current": [[211.47434940538412, 321.3166144200629, 319.12225705329183], [247.33542319749233, 310.971786833856, 321.3166144200629], [254.8589341692792, 308.77742946708474, 312.2257053291539], [214.73354231974932, 320.689655172414, 321.3166144200629], [249.5297805642634, 315.04077732955346, 319.12225705329183]]}}}, "typescript": {"metrics": {"Score": {"current": [[168.8693098384728, 196.24573378839605, 194.25675675675686], [205.35714285714297, 188.83415435139574, 198.61830742659774], [200.34843205574927, 190.39735099337736, 192.30769230769243], [188.21603927986905, 197.93459552495693, 203.1802120141343], [180.25078369905947, 186.9918699186993, 186.08414239482212]]}}}, "float-mm.c": {"metrics": {"Score": {"current": [[400.75075075075074, 428.4109149277689, 430.48387096774195], [416.38065522620906, 436.1111111111111, 427.04], [450.8445945945946, 435.3996737357259, 449.3265993265993], [435.3996737357259, 444.8333333333333, 448.57142857142856], [442.620232172471, 425, 450.0843170320405]]}}}, "regexp-2010": {"metrics": {"Score": {"current": [[284.38823529411775, 329.8883980469658, 327.3373685138388], [304.5494059692844, 323.45972940015093, 330.54164239953406], [299.0476743510829, 323.1407355841746, 327.0106845133263], [276.9116215132596, 328.91335844682715, 313.10824230387294], [289.12496341820304, 310.9467455621303, 326.0345332162715]]}}}, "bigfib.cpp": {"metrics": {"Score": {"current": [[350.40485829959516, 369.08315565031984, 365.96194503171245], [392.5170068027211, 368.29787234042556, 391.6289592760181], [362.1338912133891, 371.45922746781116, 386.38392857142856], [374.6753246753247, 369.08315565031984, 397.9310344827586], [358.3850931677019, 380.43956043956047, 359.87525987525987]]}}}, "splay": {"metrics": {"Score": {"current": [[230.1164040778499, 245.53178869323446, 241.8172381835032], [262.2465354952827, 244.3245597775717, 245.25319740500458], [257.3005718935781, 235.59536607970344, 219.7156626506023], [253.42520852641323, 233.17683852172402, 241.20457855397595], [260.01853568118634, 234.38813716404076, 240.88860055607032]]}}}, "container.cpp": {"metrics": {"Score": {"current": [[305.70712694877506, 343.4782608695652, 345.2059100911663], [329.1666666666667, 313.20593268682256, 348.16106531388715], [328.57570317175345, 343.0490471727585, 345.5317809943361], [343.90854995302226, 337.98091720529396, 332.3547215496368], [343.4782608695652, 335.0930729325603, 291.89261031366294]]}}}, "gbemu": {"metrics": {"Score": {"current": [[427.92527040314604, 446.12326043737556, 468.96551724137873], [407.7369439071564, 466.6666666666661, 460.55776892430225], [452.8893241919681, 440.864440078585, 462.3999999999995], [412.92850146914736, 427.50491159135555, 472.6911618669307], [421.17882117882056, 461.93806193806137, 447.4576271186434]]}}}, "richards": {"metrics": {"Score": {"current": [[311.4803625377644, 303.60213804322564, 304.04369044852433], [309.71415291656973, 282.6167789914014, 313.31629095979554], [290.86683709040216, 280.92028817104347, 306.8789216825471], [289.19358587032315, 284.7780618173368, 295.44503834534055], [300.1161980013944, 284.52242621426905, 331.257262375087]]}}}, "mandreel": {"metrics": {"Score": {"current": [[384.0245775729647, 391.6820965674407, 375.64029595902116], [370.47431939376935, 399.3855606758831, 376.7660910518054], [399.77634889572266, 382.52886354152184, 361.4285714285716], [398.21776663881934, 375.26652452025616, 390.51405850610604], [371.935756551141, 392.07299686341605, 399.3855606758831]]}}}, "crypto-aes": {"metrics": {"Score": {"current": [[148.31460674157302, 132, 150], [212.90322580645162, 159.03614457831324, 133.33333333333331], [212.90322580645162, 85.71428571428571, 155.2941176470588], [188.57142857142858, 167.0886075949367, 137.5], [124.52830188679246, 153.48837209302326, 155.2941176470588]]}}}, "crypto-sha1": {"metrics": {"Score": {"current": [[102.49999999999999, 102.49999999999999, 102.49999999999999], [113.88888888888887, 117.14285714285712, 102.49999999999999], [97.6190476190476, 91.1111111111111, 100], [89.13043478260869, 102.49999999999999, 85.41666666666666], [102.49999999999999, 100, 91.1111111111111]]}}}, "zlib": {"metrics": {"Score": {"current": [[264.186507936508, 266.83366733466937, 273.97119341563797], [266.83366733466937, 261.3346418056919, 261.07843137254895], [270.3553299492384, 266.03396603396595, 286.0365198711062], [266.03396603396595, 283.2978723404254, 269.2618806875632], [283.59957401490936, 267.1013039117351, 262.10629921259823]]}}}, "crypto": {"metrics": {"Score": {"current": [[223.71272767064792, 226.7428922912931, 214.60853574440387], [232.17065830443397, 210.1433854583105, 234.23437262990396], [231.4773600735999, 209.06258692338344, 219.2613000995077], [229.2156633379558, 215.83197745902174, 228.7338219391781], [236.7069032900343, 231.97785881956955, 212.94695951897597]]}}}, "n-body": {"metrics": {"Score": {"current": [[150, 117.64705882352942, 139.53488372093022], [150, 139.53488372093022, 142.85714285714286], [125, 150, 136.36363636363635], [136.36363636363635, 142.85714285714286, 146.34146341463415], [146.34146341463415, 150, 136.36363636363635]]}}}, "earley-boyer": {"metrics": {"Score": {"current": [[132.3352737611106, 166.00755688774106, 169.6973459604577], [170.38918088546947, 168.75231276707794, 166.30788119493388], [161.71741471849174, 166.54075104688135, 172.3298254149138], [150.5534795007261, 168.88205632561974, 174.53607275648596], [144.90880501053772, 174.34450749333595, 170.05088158266926]]}}}, "dry.c": {"metrics": {"Score": {"current": [[397.89227166276345, 389.6788990825688, 403.56294536817103], [397.89227166276345, 409.3975903614458, 430.126582278481], [415.4034229828851, 429.04040404040404, 399.7647058823529], [408.41346153846155, 400.70754716981133, 419.5061728395062], [411.38014527845036, 380.94170403587447, 423.6907730673317]]}}}, "mandreel-latency": {"metrics": {"Score": {"current": [[240.05776389943875, 240.28082821797994, 243.4848019953868], [226.98543048801898, 254.05193738479332, 232.1324098363748], [250.65963060685988, 252.69475263552766, 227.59052991947564], [240.43893664524427, 229.70474536388514, 241.190879969851], [229.2146138292813, 247.2355014727896, 252.49169435215973]]}}}, "date-format-tofte": {"metrics": {"Score": {"current": [[120.6060606060606, 124.37499999999999, 121.34146341463415], [133.55704697986576, 119.87951807228913, 122.08588957055213], [134.45945945945942, 125.1572327044025, 143.16546762589925], [138.19444444444443, 121.34146341463415, 112.42937853107344], [121.34146341463415, 113.71428571428571, 117.05882352941175]]}}}, "splay-latency": {"metrics": {"Score": {"current": [[148.78287343812434, 149.63259853039423, 144.75053150585808], [154.04364569961496, 143.03972663518925, 138.40231823883042], [147.1381005232284, 142.0553635412371, 137.4649178074347], [153.2850573497542, 140.91398375574911, 141.91316688101458], [151.6223592439101, 142.25594214925033, 141.3649571978324]]}}}, "pdfjs": {"metrics": {"Score": {"current": [[157.57425742574264, 223.83966244725724, 225.37581699346404], [198.2050032488629, 218.6366633696009, 222.10950080515295], [199.95902982628633, 222.10950080515295, 223.83966244725724], [176.6566766566766, 208.65290068829904, 229.102687140115], [204.2348411934554, 207.63209393346375, 221.0416666666668]]}}}, "3d-cube": {"metrics": {"Score": {"current": [[114.96062992125985, 175.9036144578313, 137.73584905660377], [148.97959183673467, 153.68421052631578, 146], [136.44859813084113, 169.7674418604651, 139.04761904761904], [130.35714285714286, 165.9090909090909, 143.1372549019608], [152.08333333333334, 178.0487804878049, 135.1851851851852]]}}}}}} \ No newline at end of file diff --git a/docs/sample-files/minibrowser-gtk/jsbench.result b/docs/sample-files/minibrowser-gtk/jsbench.result new file mode 100644 index 0000000..339598f --- /dev/null +++ b/docs/sample-files/minibrowser-gtk/jsbench.result @@ -0,0 +1 @@ +{"JSBench": {"metrics": {"Time": ["Geometric"]}, "tests": {"amazon/safari": {"metrics": {"Time": {"current": [6, 3, 3, 3, 2, 5, 3, 3, 5, 3, 6, 6, 4, 4, 4, 4, 5, 3, 4, 3]}}}, "google/chrome": {"metrics": {"Time": {"current": [33, 33, 32, 29, 32, 33, 32, 31, 31, 31, 34, 29, 31, 31, 33, 32, 33, 32, 33, 29]}}}, "twitter/firefox": {"metrics": {"Time": {"current": [1, 1, 1, 1, 1, 1, 1, 2, 1, 1, 2, 1, 1, 1, 1, 1, 1, 1, 2, 1]}}}, "amazon/chrome": {"metrics": {"Time": {"current": [4, 3, 3, 4, 4, 4, 3, 3, 3, 3, 4, 2, 3, 3, 3, 3, 3, 3, 3, 3]}}}, "facebook/firefox": {"metrics": {"Time": {"current": [22, 21, 21, 23, 19, 20, 22, 23, 21, 23, 21, 23, 21, 21, 22, 19, 21, 26, 20, 27]}}}, "amazon/firefox-win": {"metrics": {"Time": {"current": [3, 4, 3, 5, 3, 4, 3, 2, 2, 4, 2, 5, 2, 5, 2, 4, 3, 2, 5, 2]}}}, "facebook/chrome": {"metrics": {"Time": {"current": [36, 44, 55, 36, 35, 37, 35, 36, 36, 39, 38, 36, 35, 40, 37, 34, 36, 36, 34, 36]}}}, "yahoo/chrome-win": {"metrics": {"Time": {"current": [30, 33, 31, 29, 29, 27, 31, 28, 28, 29, 28, 29, 31, 29, 28, 35, 30, 29, 34, 28]}}}, "google/chrome-win": {"metrics": {"Time": {"current": [32, 31, 31, 30, 29, 67, 29, 30, 65, 32, 29, 30, 30, 30, 31, 33, 36, 33, 30, 29]}}}, "twitter/chrome-win": {"metrics": {"Time": {"current": [5, 5, 5, 5, 7, 5, 6, 6, 6, 5, 5, 6, 6, 5, 6, 6, 6, 6, 5, 6]}}}, "facebook/chrome-win": {"metrics": {"Time": {"current": [68, 74, 73, 70, 67, 66, 68, 67, 68, 73, 68, 67, 70, 68, 74, 78, 77, 68, 70, 73]}}}, "yahoo/firefox": {"metrics": {"Time": {"current": [30, 35, 29, 31, 32, 36, 37, 32, 30, 29, 31, 33, 30, 35, 31, 33, 31, 31, 39, 32]}}}, "facebook/safari": {"metrics": {"Time": {"current": [76, 79, 76, 74, 77, 72, 78, 78, 72, 73, 79, 72, 81, 76, 78, 92, 81, 76, 74, 71]}}}, "yahoo/firefox-win": {"metrics": {"Time": {"current": [24, 26, 21, 24, 23, 27, 25, 24, 23, 22, 22, 21, 22, 24, 23, 24, 24, 24, 24, 26]}}}, "google/firefox-win": {"metrics": {"Time": {"current": [20, 17, 19, 19, 18, 19, 21, 20, 18, 21, 18, 17, 19, 18, 18, 19, 20, 20, 19, 19]}}}, "google/safari": {"metrics": {"Time": {"current": [25, 25, 27, 27, 27, 25, 25, 27, 27, 25, 26, 25, 25, 27, 28, 25, 27, 31, 27, 24]}}}, "twitter/chrome": {"metrics": {"Time": {"current": [7, 8, 7, 6, 8, 7, 6, 6, 8, 6, 7, 5, 8, 5, 6, 6, 6, 5, 8, 6]}}}, "twitter/firefox-win": {"metrics": {"Time": {"current": [1, 1, 1, 1, 1, 1, 1, 1, 1, 2, 1, 1, 1, 1, 1, 1, 2, 1, 2, 2]}}}, "facebook/firefox-win": {"metrics": {"Time": {"current": [14, 19, 14, 15, 15, 13, 17, 14, 14, 16, 14, 15, 16, 16, 14, 16, 17, 14, 19, 17]}}}, "twitter/safari": {"metrics": {"Time": {"current": [6, 7, 9, 5, 5, 5, 5, 6, 5, 6, 6, 5, 5, 6, 8, 5, 4, 5, 6, 5]}}}, "yahoo/safari": {"metrics": {"Time": {"current": [35, 30, 29, 29, 31, 31, 31, 32, 33, 30, 33, 33, 30, 29, 30, 38, 34, 30, 34, 34]}}}, "google/firefox": {"metrics": {"Time": {"current": [16, 15, 18, 18, 19, 17, 18, 19, 17, 18, 16, 19, 20, 16, 17, 17, 20, 19, 50, 46]}}}, "amazon/chrome-win": {"metrics": {"Time": {"current": [3, 4, 3, 3, 3, 3, 3, 3, 3, 3, 4, 3, 3, 3, 2, 3, 4, 3, 2, 3]}}}, "amazon/firefox": {"metrics": {"Time": {"current": [2, 3, 3, 2, 4, 4, 2, 4, 3, 3, 4, 3, 2, 4, 5, 4, 4, 4, 4, 2]}}}, "yahoo/chrome": {"metrics": {"Time": {"current": [31, 36, 31, 32, 33, 30, 32, 32, 30, 30, 34, 32, 32, 35, 32, 36, 32, 32, 33, 30]}}}}}} \ No newline at end of file diff --git a/docs/sample-files/minibrowser-gtk/kraken.result b/docs/sample-files/minibrowser-gtk/kraken.result new file mode 100644 index 0000000..33cb614 --- /dev/null +++ b/docs/sample-files/minibrowser-gtk/kraken.result @@ -0,0 +1 @@ +{"Kraken": {"metrics": {"Time": ["Total"]}, "tests": {"ai-astar": {"metrics": {"Time": {"current": [[84, 109, 99, 97, 94, 91, 87, 91, 81, 84], [84, 73, 75, 87, 83, 76, 83, 82, 82, 84], [85, 82, 84, 79, 107, 80, 79, 82, 89, 86], [90, 76, 90, 78, 81, 75, 76, 80, 79, 75], [80, 83, 76, 82, 89, 88, 89, 109, 77, 94]]}}}, "imaging-gaussian-blur": {"metrics": {"Time": {"current": [[60, 61, 65, 59, 57, 61, 61, 60, 60, 62], [62, 60, 60, 57, 56, 62, 60, 56, 61, 60], [60, 61, 58, 61, 61, 64, 63, 71, 61, 64], [67, 65, 66, 64, 60, 59, 62, 63, 63, 59], [69, 60, 61, 56, 61, 63, 57, 78, 70, 56]]}}}, "audio-beat-detection": {"metrics": {"Time": {"current": [[57, 62, 110, 102, 58, 68, 104, 69, 60, 100], [50, 104, 84, 65, 101, 82, 111, 62, 61, 66], [85, 66, 106, 85, 94, 79, 84, 67, 95, 61], [47, 95, 56, 59, 63, 67, 89, 84, 64, 90], [50, 57, 57, 76, 107, 63, 90, 68, 95, 95]]}}}, "json-stringify-tinderbox": {"metrics": {"Time": {"current": [[23, 28, 31, 27, 26, 28, 28, 31, 28, 26], [32, 28, 29, 21, 23, 33, 36, 32, 27, 23], [23, 28, 24, 22, 23, 29, 33, 23, 30, 31], [27, 31, 31, 32, 33, 32, 22, 32, 23, 40], [32, 32, 31, 28, 29, 31, 24, 24, 23, 23]]}}}, "imaging-darkroom": {"metrics": {"Time": {"current": [[104, 106, 111, 104, 104, 108, 104, 108, 110, 104], [103, 110, 101, 103, 113, 108, 107, 106, 104, 112], [104, 126, 104, 101, 101, 106, 106, 109, 104, 104], [102, 103, 108, 113, 106, 103, 105, 103, 111, 109], [104, 111, 109, 105, 105, 102, 104, 114, 106, 104]]}}}, "stanford-crypto-pbkdf2": {"metrics": {"Time": {"current": [[132, 133, 148, 128, 128, 135, 125, 133, 138, 137], [127, 127, 129, 144, 132, 140, 138, 132, 134, 129], [132, 127, 137, 132, 126, 123, 132, 128, 128, 136], [133, 130, 137, 134, 130, 127, 133, 142, 127, 132], [127, 121, 131, 135, 132, 145, 137, 137, 137, 140]]}}}, "json-parse-financial": {"metrics": {"Time": {"current": [[44, 38, 37, 40, 41, 37, 40, 41, 42, 39], [34, 37, 42, 40, 43, 43, 38, 43, 36, 35], [41, 36, 41, 41, 37, 37, 35, 42, 41, 39], [41, 40, 42, 40, 42, 35, 42, 40, 41, 40], [39, 35, 37, 44, 39, 40, 41, 40, 43, 43]]}}}, "stanford-crypto-sha256-iterative": {"metrics": {"Time": {"current": [[39, 43, 42, 42, 45, 43, 38, 42, 46, 55], [54, 49, 55, 54, 52, 57, 59, 60, 44, 55], [44, 53, 46, 41, 45, 39, 46, 40, 47, 59], [51, 61, 52, 58, 56, 44, 43, 42, 55, 40], [56, 58, 51, 41, 40, 43, 43, 43, 43, 39]]}}}, "audio-fft": {"metrics": {"Time": {"current": [[46, 44, 41, 48, 47, 47, 43, 44, 43, 46], [40, 44, 48, 53, 47, 41, 42, 51, 55, 45], [43, 42, 50, 43, 55, 48, 42, 56, 43, 54], [44, 44, 52, 54, 60, 51, 40, 40, 46, 40], [47, 56, 61, 41, 42, 44, 43, 47, 48, 49]]}}}, "audio-dft": {"metrics": {"Time": {"current": [[86, 82, 95, 83, 90, 87, 89, 94, 87, 86], [96, 88, 89, 87, 85, 83, 89, 85, 89, 103], [90, 98, 81, 84, 87, 84, 85, 88, 84, 89], [105, 86, 94, 85, 84, 85, 84, 85, 100, 90], [92, 87, 85, 86, 85, 87, 84, 89, 91, 87]]}}}, "stanford-crypto-ccm": {"metrics": {"Time": {"current": [[58, 63, 59, 61, 55, 55, 50, 61, 70, 62], [53, 55, 62, 64, 48, 52, 58, 66, 52, 60], [62, 60, 68, 57, 59, 62, 56, 64, 68, 57], [56, 64, 57, 65, 63, 53, 61, 69, 61, 55], [53, 53, 54, 54, 61, 72, 64, 64, 50, 69]]}}}, "audio-oscillator": {"metrics": {"Time": {"current": [[72, 80, 70, 77, 81, 77, 72, 70, 77, 64], [67, 77, 83, 77, 73, 62, 71, 69, 74, 63], [83, 67, 74, 83, 81, 79, 65, 78, 72, 78], [63, 65, 71, 67, 74, 71, 67, 76, 73, 70], [72, 75, 75, 66, 76, 79, 71, 79, 82, 80]]}}}, "stanford-crypto-aes": {"metrics": {"Time": {"current": [[66, 58, 65, 57, 63, 64, 64, 58, 67, 73], [76, 59, 73, 62, 74, 67, 61, 57, 63, 67], [74, 61, 74, 57, 71, 59, 65, 76, 65, 55], [67, 66, 70, 78, 73, 58, 61, 65, 68, 67], [65, 70, 63, 62, 58, 65, 66, 72, 71, 71]]}}}, "imaging-desaturate": {"metrics": {"Time": {"current": [[53, 51, 64, 53, 49, 52, 52, 52, 47, 50], [52, 54, 46, 50, 51, 55, 55, 48, 51, 53], [48, 64, 51, 46, 54, 56, 51, 51, 50, 52], [49, 50, 50, 51, 53, 51, 70, 48, 55, 66], [53, 46, 48, 51, 54, 52, 56, 58, 54, 53]]}}}}}} \ No newline at end of file diff --git a/docs/sample-files/minibrowser-gtk/octane.result b/docs/sample-files/minibrowser-gtk/octane.result new file mode 100644 index 0000000..8387204 --- /dev/null +++ b/docs/sample-files/minibrowser-gtk/octane.result @@ -0,0 +1 @@ +{"Octane": {"metrics": {"Score": {"current": [33391.21798309278, 33641.41546849126, 33059.570161964504, 33555.19248107026, 33728.389071804966]}}, "tests": {"Mandreel": {"metrics": {"Score": {"current": [42737.17500000006, 41295.07360157017, 39643.270657507404, 41053.34634146341, 42488.220582524315]}}}, "MandreelLatency": {"metrics": {"Score": {"current": [30772.839506172862, 31551.898734177223, 31353.459119496863, 31551.898734177223, 32162.580645161295]}}}, "DeltaBlue": {"metrics": {"Score": {"current": [39888.98940000001, 41852.694000000025, 41839.47040000002, 41568.38660000001, 40662.57000000003]}}}, "NavierStokes": {"metrics": {"Score": {"current": [28231.474103585686, 29383.2, 29443.27018943171, 29176.447105788448, 28880.239520958083]}}}, "EarleyBoyer": {"metrics": {"Score": {"current": [30754.9459194313, 30072.459195482206, 30884.843308463656, 30541.171453873547, 31036.132826689383]}}}, "SplayLatency": {"metrics": {"Score": {"current": [15418.246285457017, 15824.364602587824, 15600.876993166301, 15798.811995386388, 15782.428851250139]}}}, "CodeLoad": {"metrics": {"Score": {"current": [24439.850396947004, 24407.496762339073, 24344.998216994056, 25217.270867403564, 25041.38490746532]}}}, "Crypto": {"metrics": {"Score": {"current": [39148.50214067835, 39135.52954412258, 37293.57328563325, 39420.6781844004, 38192.91495298175]}}}, "Splay": {"metrics": {"Score": {"current": [20556.8652259332, 21171.361800000002, 20853.54690000001, 20877.994200000012, 21106.169000000013]}}}, "Gameboy": {"metrics": {"Score": {"current": [95641.22359882017, 92964.91473477407, 96208.82729970335, 94167.4459701493, 93608.58872403565]}}}, "Typescript": {"metrics": {"Score": {"current": [68477.79860365199, 63215.498760535535, 73660.11611785105, 67894.38817891374, 66687.06119246871]}}}, "Box2D": {"metrics": {"Score": {"current": [59641.38522954099, 58674.11040000008, 58498.61455633104, 59641.38522954099, 61024.35825049702]}}}, "Richards": {"metrics": {"Score": {"current": [43329.67480000002, 48501.41779999999, 43986.29200000001, 42457.71540000001, 45994.9758]}}}, "RegExp": {"metrics": {"Score": {"current": [3964.7220573689415, 3909.4166666666715, 4030.907079646017, 3890.005461767626, 4038.8497536945843]}}}, "PdfJS": {"metrics": {"Score": {"current": [25508.521899224837, 25632.711392405065, 16957.995763546798, 25607.77684824905, 24864.73722986251]}}}, "zlib": {"metrics": {"Score": {"current": [65027.72255319154, 66848.27121609807, 66239.769397486, 65953.88347000432, 64506.183199662315]}}}, "RayTrace": {"metrics": {"Score": {"current": [51873.2289, 52412.80729270733, 58358.05573280163, 51799.23000000003, 52529.627916251266]}}}}}} \ No newline at end of file diff --git a/docs/sample-files/minibrowser-gtk/speedometer.result b/docs/sample-files/minibrowser-gtk/speedometer.result new file mode 100644 index 0000000..a694380 --- /dev/null +++ b/docs/sample-files/minibrowser-gtk/speedometer.result @@ -0,0 +1 @@ +{"Speedometer": {"metrics": {"Score": {"current": [[154.0719002201026, 151.4673398548437, 150.58702047445593, 148.6168021910364, 155.66192453732248], [151.4523195643943, 146.71105258193984, 150.03080989846163, 152.04473011155372, 155.35043544357222], [147.28650908179137, 153.19996425334162, 144.0395903102509, 150.9352595547406, 151.42228791866486], [151.34017126662704, 152.18880107836623, 150.21029441217715, 154.7135129360754, 149.87260828295982], [156.508810141771, 149.0138476439846, 153.3792740778072, 155.93355003146507, 146.55158877624217]]}, "Time": ["Total"]}, "tests": {"FlightJS-TodoMVC": {"metrics": {"Time": ["Total"]}, "tests": {"DeletingAllItems": {"metrics": {"Time": ["Total"]}, "tests": {"Async": {"metrics": {"Time": {"current": [[5.1250000000009095, 4.190000000000509, 16.035000000001673, 17.340000000000146, 4.044999999998254], [17.4950000000008, 5.235000000000582, 4.050000000001091, 4.780000000000655, 4.174999999999272], [4.169999999999163, 4.085000000000036, 4.420000000001892, 4.25, 4.304999999996653], [4.2849999999998545, 4.364999999999782, 4.145000000000437, 4.304999999998472, 4.345000000001164], [14.604999999999563, 4.170000000000073, 4.079999999999927, 4.2150000000001455, 4.18999999999869]]}}}, "Sync": {"metrics": {"Time": {"current": [[34.5, 33.23999999999978, 34.715000000000146, 34.125, 33.599999999998545], [33.344999999999345, 35.00999999999931, 32.8799999999992, 36.05000000000109, 33.6150000000016], [37.32499999999982, 33.17500000000018, 34.69000000000051, 32.44499999999971, 35.11999999999898], [35.26000000000022, 36.23000000000047, 33.74999999999818, 33.14500000000044, 34.42499999999927], [33.344999999999345, 33.52000000000044, 32.79999999999927, 33.719999999999345, 38.650000000001455]]}}}}}, "CompletingAllItems": {"metrics": {"Time": ["Total"]}, "tests": {"Async": {"metrics": {"Time": {"current": [[22.574999999999818, 9.595000000000255, 9.440000000002328, 9.220000000001164, 9.285000000003492], [10.454999999999927, 9.390000000000327, 9.31000000000131, 10.954999999999927, 9.864999999997963], [24.969999999999345, 10.68499999999949, 10.2400000000016, 9.355000000001382, 10.450000000000728], [24.01000000000022, 10.649999999999636, 9.319999999999709, 9.424999999999272, 9.924999999999272], [9.414999999999054, 9.3799999999992, 9.420000000000073, 9.284999999999854, 37.58999999999651]]}}}, "Sync": {"metrics": {"Time": {"current": [[44.51000000000022, 41.82500000000073, 41.654999999998836, 41.024999999999636, 41.904999999998836], [46.95499999999993, 46.63000000000011, 41.979999999997744, 43.36499999999978, 41.82499999999709], [40.95500000000084, 48.44999999999982, 43.419999999998254, 41.215000000000146, 60.3849999999984], [46.76000000000022, 45.539999999999964, 44.585000000000946, 41.70000000000073, 42.275000000001455], [41.42500000000109, 40.710000000000036, 40.8799999999992, 41.544999999998254, 49.37500000000364]]}}}}}, "Adding100Items": {"metrics": {"Time": ["Total"]}, "tests": {"Async": {"metrics": {"Time": {"current": [[14.445000000000618, 14.5600000000004, 13.229999999999563, 17.024999999999636, 13.069999999999709], [13.974999999999454, 24.81500000000051, 12.985000000000582, 18.404999999998836, 13.194999999999709], [13.445000000000618, 14.534999999999854, 13.549999999999272, 12.805000000000291, 13.305000000003929], [14.204999999999927, 16.699999999999818, 13.774999999999636, 13.385000000000218, 15.32499999999709], [15.389999999999873, 15.784999999999854, 13.225000000000364, 13.235000000000582, 16.17000000000189]]}}}, "Sync": {"metrics": {"Time": {"current": [[56.61499999999933, 56.88999999999942, 59.86499999999978, 57.51000000000022, 55.36999999999898], [60.80000000000018, 59.1299999999992, 56.344999999999345, 71.43500000000131, 61.539999999997235], [59.789999999999964, 67.8700000000008, 57.039999999999054, 63.530000000000655, 59.729999999995925], [58.835000000000036, 62.289999999999964, 57.155000000000655, 60.524999999999636, 58.845000000001164], [66.74499999999989, 61.835000000000946, 56.3899999999976, 56.82499999999891, 60.45999999999913]]}}}}}}}, "EmberJS-TodoMVC": {"metrics": {"Time": ["Total"]}, "tests": {"CompletingAllItems": {"metrics": {"Time": ["Total"]}, "tests": {"Async": {"metrics": {"Time": {"current": [[9.440000000000055, 11.800000000000182, 12.399999999999636, 11.1200000000008, 10.075000000000728], [9.559999999999945, 12.649999999999636, 9.80999999999949, 11.469999999999345, 11.040000000000873], [9.944999999999936, 9.819999999999709, 10.0550000000012, 11.969999999999345, 9.56500000000051], [9.945000000000164, 11.770000000000437, 9.8100000000004, 10.355000000001382, 9.845000000001164], [9.739999999999782, 10.385000000000218, 9.679999999999382, 9.555000000000291, 10.030000000000655]]}}}, "Sync": {"metrics": {"Time": {"current": [[83.53999999999996, 91.73999999999978, 88.15000000000055, 119.96999999999753, 98.85499999999956], [84.08000000000015, 108.07499999999982, 87.55500000000029, 98.42499999999927, 88.03499999999804], [89.79999999999995, 103.23000000000138, 90.74999999999909, 102.27000000000044, 83.55499999999847], [89.03499999999985, 113.68000000000029, 84.90500000000065, 97.59499999999935, 95.09000000000015], [82.46000000000026, 110.80499999999938, 83.94500000000062, 99.29500000000007, 86.63999999999942]]}}}}}, "Adding100Items": {"metrics": {"Time": ["Total"]}, "tests": {"Async": {"metrics": {"Time": {"current": [[17.38499999999999, 18.38500000000022, 12.5600000000004, 18.784999999999854, 18.029999999998836], [17.730000000000018, 18.085000000000036, 41.75500000000011, 12.705000000001746, 12.094999999999345], [17.575000000000273, 18.155000000000655, 14.520000000000437, 16.014999999999418, 13], [19.450000000000045, 18.05000000000109, 13.204999999999927, 15.910000000001673, 13.450000000000728], [18.449999999999818, 19.1200000000008, 13.180000000000291, 15.960000000000946, 12.834999999999127]]}}}, "Sync": {"metrics": {"Time": {"current": [[308.18000000000006, 300.8550000000005, 322.97499999999945, 369.3650000000016, 318.3550000000014], [333.80999999999995, 339.22999999999956, 326.84999999999945, 316.84499999999935, 319.14500000000226], [313.655, 320.6849999999995, 331.46000000000004, 341.7500000000018, 315.875], [316.48000000000025, 307.0050000000001, 322.27999999999975, 317.1749999999993, 343.3299999999999], [324.77, 333.0049999999992, 317.454999999999, 316.2049999999999, 328.25]]}}}}}, "DeletingItems": {"metrics": {"Time": ["Total"]}, "tests": {"Async": {"metrics": {"Time": {"current": [[4.3400000000001455, 4.170000000000073, 5.559999999999491, 4.4099999999998545, 4.545000000000073], [4.4900000000002365, 4.600000000000364, 4.369999999998981, 4.665000000000873, 4.200000000000728], [4.5750000000000455, 4.630000000000109, 11.114999999999782, 4.210000000000946, 35.76500000000124], [4.720000000000027, 4.2150000000001455, 11.139999999999418, 4.190000000000509, 36.30999999999949], [4.244999999999891, 5.170000000000073, 11.110000000000582, 4.654999999998836, 5.694999999999709]]}}}, "Sync": {"metrics": {"Time": {"current": [[159.0849999999998, 130.32999999999993, 160.1700000000019, 145.13999999999942, 149.23999999999796], [152.83500000000004, 137.5699999999988, 152.28499999999985, 143.80499999999847, 142.21500000000015], [152.79999999999995, 134.97499999999945, 177.54999999999927, 151.1900000000005, 153.0699999999997], [150.45000000000005, 134.14000000000033, 169.79500000000007, 134.73500000000058, 155.08500000000095], [151.2650000000001, 157.35000000000036, 172.77499999999964, 142.58000000000175, 168.9950000000008]]}}}}}}}, "BackboneJS-TodoMVC": {"metrics": {"Time": ["Total"]}, "tests": {"DeletingAllItems": {"metrics": {"Time": ["Total"]}, "tests": {"Async": {"metrics": {"Time": {"current": [[4.434999999999945, 4.350000000001273, 4.205000000001746, 16.99999999999818, 4.445000000001528], [4.554999999999836, 45.275000000000546, 4.43500000000131, 4.43999999999869, 4.350000000000364], [5.220000000000255, 4.510000000000218, 4.625, 4.635000000000218, 4.4950000000008], [4.499999999999545, 4.414999999999964, 4.150000000001455, 5.415000000000873, 4.440000000000509], [4.7199999999998, 4.390000000000327, 4.395000000000437, 4.385000000000218, 4.56499999999869]]}}}, "Sync": {"metrics": {"Time": {"current": [[45.13000000000011, 45.9399999999996, 51.650000000001455, 50.455000000001746, 44.64499999999862], [44.80000000000018, 46.60499999999956, 48.12499999999818, 45.56500000000051, 44.419999999998254], [46.83499999999958, 46.409999999999854, 47.600000000000364, 48.42000000000007, 46.414999999999054], [49.13500000000022, 48.81499999999869, 45.14999999999782, 44.919999999998254, 51.95000000000073], [45.284999999999854, 46.529999999999745, 45.68499999999949, 47.01000000000022, 48.335000000002765]]}}}}}, "CompletingAllItems": {"metrics": {"Time": ["Total"]}, "tests": {"Async": {"metrics": {"Time": {"current": [[11.735000000000127, 13.465000000000146, 48.68500000000131, 11.979999999999563, 12.179999999998472], [11.059999999999945, 12.920000000000073, 11.43500000000131, 13.875, 11.844999999999345], [11.41000000000031, 20.75000000000091, 11.965000000000146, 15.290000000000873, 11.270000000000437], [11.050000000000182, 43.4300000000012, 12.619999999998981, 12.784999999999854, 11.669999999998254], [11.235000000000127, 50.1299999999992, 11.909999999999854, 12.6349999999984, 45.544999999998254]]}}}, "Sync": {"metrics": {"Time": {"current": [[67.11000000000013, 74.58999999999924, 81.54999999999927, 74.08500000000095, 72.18500000000131], [66.1400000000001, 75.59500000000025, 83.93000000000029, 74.17499999999927, 72.08000000000175], [67.91999999999985, 73.60999999999967, 71.05999999999949, 77.7450000000008, 70.91999999999825], [76.04999999999995, 71.6899999999996, 70.21500000000015, 70.63500000000204, 69.29499999999825], [66.99500000000012, 92.34000000000015, 72.26000000000022, 72.90000000000146, 69.86999999999898]]}}}}}, "Adding100Items": {"metrics": {"Time": ["Total"]}, "tests": {"Async": {"metrics": {"Time": {"current": [[12.8900000000001, 12.824999999999818, 16.160000000001673, 13.225000000000364, 12.875], [13.160000000000082, 13.664999999999054, 15.110000000000582, 12.69499999999789, 14.045000000000073], [13.045000000000073, 12.929999999999382, 12.915000000000873, 13.595000000001164, 22.229999999999563], [12.989999999999782, 12.425000000000182, 12.674999999999272, 13.219999999999345, 20.05999999999767], [12.6400000000001, 13.645000000000437, 12.635000000000218, 13.590000000000146, 13.029999999998836]]}}}, "Sync": {"metrics": {"Time": {"current": [[77.45499999999993, 90.8100000000004, 81.34999999999854, 76.57000000000153, 78.41500000000087], [74.625, 97.59500000000025, 74.77999999999702, 88.19500000000153, 74.18000000000029], [75.39499999999998, 82.6200000000008, 94.57499999999891, 97.05500000000029, 77.22000000000116], [89.52500000000032, 78.78499999999985, 88.5099999999984, 95.125, 77.84000000000015], [74.60500000000002, 76.875, 92.35499999999956, 95.2549999999992, 75.32500000000073]]}}}}}}}, "AngularJS-TodoMVC": {"metrics": {"Time": ["Total"]}, "tests": {"DeletingAllItems": {"metrics": {"Time": ["Total"]}, "tests": {"Async": {"metrics": {"Time": {"current": [[40.289999999999964, 5.580000000000837, 7.704999999999927, 5.155000000000655, 5.315000000000509], [35.809999999999945, 10.989999999999782, 7.1299999999992, 15.43500000000131, 5.469999999999345], [33.27500000000009, 6.0349999999998545, 5.389999999999418, 5.100000000000364, 11.430000000000291], [39.84999999999991, 7.619999999999891, 5.6599999999998545, 5.0900000000001455, 10.950000000000728], [5.579999999999927, 7.694999999999709, 5.450000000000728, 5.024999999999636, 8.034999999999854]]}}}, "Sync": {"metrics": {"Time": {"current": [[79.79000000000042, 99.81499999999869, 77.83000000000175, 91.04000000000087, 100.96500000000196], [81.17500000000018, 74.93499999999949, 88.67000000000007, 89.8799999999992, 90.33000000000175], [79.41999999999962, 95.52500000000055, 96.2549999999992, 89.78499999999985, 82.06500000000051], [79.03999999999996, 77.52000000000044, 99.56500000000051, 84.56000000000131, 79.61499999999796], [94.90499999999975, 78.5600000000004, 94.90500000000065, 93.51000000000022, 79.26500000000124]]}}}}}, "CompletingAllItems": {"metrics": {"Time": ["Total"]}, "tests": {"Async": {"metrics": {"Time": {"current": [[9.4699999999998, 9.235000000000582, 9.494999999998981, 9.489999999999782, 9.299999999999272], [9.900000000000091, 9.980000000000473, 9.844999999999345, 39.155000000000655, 9.799999999999272], [9.289999999999964, 9.930000000000291, 9.665000000000873, 9.8700000000008, 9.824999999998909], [9.300000000000182, 9.9950000000008, 9.500000000001819, 19.575000000000728, 9.475000000000364], [9.245000000000346, 9.910000000000764, 9.735000000000582, 9.335000000000946, 9.599999999998545]]}}}, "Sync": {"metrics": {"Time": {"current": [[97.60500000000002, 90.82999999999993, 106.28500000000167, 106.39500000000044, 100.02999999999884], [106.51500000000033, 132.85500000000047, 115.80000000000109, 113.09999999999854, 102.15500000000065], [104.01999999999953, 98.71000000000004, 105.63000000000102, 101.29999999999927, 105.48999999999978], [97.01000000000022, 103.91499999999905, 103.61499999999796, 104.14999999999964, 107.53000000000065], [97.70999999999958, 105.24499999999989, 104.93999999999869, 103.82999999999993, 111.11499999999978]]}}}}}, "Adding100Items": {"metrics": {"Time": ["Total"]}, "tests": {"Async": {"metrics": {"Time": {"current": [[29.235000000000127, 24.734999999999673, 14.999999999998181, 24.75, 24.715000000000146], [26.375, 23.8799999999992, 17.770000000000437, 25.405000000002474, 24.839999999998327], [25.539999999999964, 24.88500000000022, 14.25, 25.214999999998327, 15.849999999998545], [25.96499999999969, 15.010000000000218, 15.5099999999984, 24.82499999999891, 14.920000000000073], [26.61999999999989, 14.535000000000764, 14.920000000000073, 24.980000000001382, 14.300000000001091]]}}}, "Sync": {"metrics": {"Time": {"current": [[160.85500000000002, 181.29500000000098, 177.81500000000233, 172.60999999999876, 156.46500000000015], [185.11500000000024, 180.88500000000022, 174.0049999999992, 175.96499999999833, 170.71000000000095], [176.7850000000003, 175.02500000000055, 183.71500000000015, 166.47999999999956, 184.94500000000153], [176.46500000000015, 168.3800000000001, 195.375, 152.90500000000065, 179.79500000000007], [150.03499999999985, 169.64999999999964, 172.45999999999913, 156.86000000000058, 170.46999999999935]]}}}}}}}, "VanillaJS-TodoMVC": {"metrics": {"Time": ["Total"]}, "tests": {"DeletingAllItems": {"metrics": {"Time": ["Total"]}, "tests": {"Async": {"metrics": {"Time": {"current": [[4.580000000000041, 4.349999999999454, 4.385000000000218, 4.079999999999927, 4.530000000000655], [4.57000000000005, 4.079999999999927, 18.224999999999454, 4.470000000002983, 4.585000000000946], [4.339999999999918, 4.459999999999127, 4.025000000000546, 4.230000000001382, 4.4950000000008], [4.094999999999914, 4.540000000000873, 4.579999999999927, 4.614999999999782, 4.584999999999127], [4.564999999999941, 4.490000000000691, 4.6850000000004, 4.429999999998472, 4.565000000000509]]}}}, "Sync": {"metrics": {"Time": {"current": [[19.43999999999994, 17.909999999999854, 21.600000000000364, 20.159999999999854, 18.61499999999978], [19.254999999999995, 20.300000000000182, 19.455000000000837, 19.1399999999976, 18.264999999999418], [19.690000000000055, 18.895000000000437, 19.8799999999992, 19.1299999999992, 18.93499999999767], [20.41999999999996, 18.30999999999949, 19.790000000000873, 18.61499999999978, 19.795000000000073], [19.040000000000077, 18.410000000000764, 20.159999999999854, 18.93500000000131, 18.88000000000102]]}}}}}, "CompletingAllItems": {"metrics": {"Time": ["Total"]}, "tests": {"Async": {"metrics": {"Time": {"current": [[8.504999999999995, 8.359999999999673, 8.769999999999527, 8.699999999998909, 8.075000000000728], [8.495000000000005, 9.24499999999989, 8.655000000000655, 8.1200000000008, 8.420000000000073], [9.139999999999986, 8.424999999999272, 8.710000000000036, 8.614999999999782, 8.345000000001164], [9.004999999999995, 8.354999999999563, 8.474999999999454, 10.875, 8.549999999999272], [8.555000000000064, 8.259999999999309, 9.014999999999418, 4.204999999999927, 8.390000000001237]]}}}, "Sync": {"metrics": {"Time": {"current": [[27.745000000000005, 25.5, 27.080000000000837, 27.409999999999854, 26.31500000000051], [29.81000000000006, 29.045000000000073, 31.05999999999949, 48.210000000000946, 26.139999999999418], [28.325000000000045, 27.475000000000364, 29.525000000000546, 30.340000000000146, 28.829999999999927], [30.385000000000105, 26.01000000000022, 31.890000000000327, 28.970000000001164, 28.579999999999927], [28.34999999999991, 26.324999999999818, 35.07000000000062, 29.50500000000102, 33.024999999999636]]}}}}}, "Adding100Items": {"metrics": {"Time": ["Total"]}, "tests": {"Async": {"metrics": {"Time": {"current": [[27.059999999999945, 11.219999999999345, 10.819999999999709, 11.319999999999709, 11.704999999999927], [24.45000000000016, 12.394999999999527, 11.239999999999782, 10.950000000000728, 10.735000000000582], [24.8900000000001, 11.635000000000218, 12.9350000000004, 11.450000000000728, 11.475000000000364], [26.480000000000018, 11.505000000001019, 30.854999999999563, 11.085000000000946, 12.299999999999272], [24.469999999999914, 11.329999999999018, 24.24999999999909, 10.719999999999345, 25.049999999999272]]}}}, "Sync": {"metrics": {"Time": {"current": [[84.12000000000012, 79.22500000000036, 76.6800000000012, 79.47500000000036, 75.82499999999891], [83.47000000000003, 85.64500000000044, 73.80500000000029, 74.96999999999753, 74.39999999999964], [82.34499999999991, 79.45999999999913, 91.75500000000011, 89.98499999999876, 94.76499999999942], [90.33000000000004, 75.62499999999909, 77.77000000000044, 95.29999999999927, 96.29999999999927], [83.77500000000009, 81.10499999999956, 76.78999999999996, 97.53000000000065, 75.22999999999956]]}}}}}}}, "jQuery-TodoMVC": {"metrics": {"Time": ["Total"]}, "tests": {"DeletingAllItems": {"metrics": {"Time": ["Total"]}, "tests": {"Async": {"metrics": {"Time": {"current": [[4.349999999999909, 4.180000000000291, 4.655000000000655, 4.265000000001237, 4.210000000000946], [4.220000000000255, 4.1800000000012005, 13.494999999998981, 4.364999999999782, 4.304999999998472], [4.9099999999998545, 4.25, 4.2849999999998545, 4.510000000000218, 4.219999999999345], [4.4900000000002365, 4.1899999999996, 4.195000000001528, 4.170000000000073, 4.239999999999782], [4.289999999999964, 4.164999999999054, 4.645000000000437, 4.315000000000509, 4.2549999999992]]}}}, "Sync": {"metrics": {"Time": {"current": [[2.2400000000002365, 2.100000000000364, 2.4349999999994907, 2.2049999999999272, 2.374999999998181], [2.324999999999818, 2.300000000000182, 2.404999999998836, 2.100000000000364, 2.6300000000010186], [2.3399999999996908, 2.3499999999994543, 2.2149999999983265, 2.485000000000582, 2.2600000000002183], [2.2899999999999636, 2.180000000000291, 2.155000000000655, 2.3800000000010186, 2.0050000000010186], [2.5299999999997453, 2.280000000000655, 2.2150000000019645, 2.3299999999981083, 2.1449999999986176]]}}}}}, "CompletingAllItems": {"metrics": {"Time": ["Total"]}, "tests": {"Async": {"metrics": {"Time": {"current": [[21, 25.354999999999563, 32.48999999999978, 65.73999999999978, 44.13500000000022], [21.84999999999991, 32.720000000000255, 21.334999999997308, 21.18499999999949, 58.06499999999869], [21.570000000000164, 21.48999999999978, 24.170000000000073, 22.94999999999891, 35.0049999999992], [21.34999999999991, 29.605000000000473, 23.789999999999054, 21.590000000000146, 24.924999999999272], [20.625, 29.919999999999163, 21.585000000000946, 21.100000000000364, 31.399999999999636]]}}}, "Sync": {"metrics": {"Time": {"current": [[232.80000000000018, 241.32999999999993, 258.78999999999905, 269.78499999999985, 236.84000000000196], [233.89999999999964, 284.40000000000055, 263.7300000000014, 248.57500000000073, 267.46000000000095], [242.36000000000013, 265.1199999999999, 270.90500000000065, 273.2000000000007, 265.5600000000013], [241.83500000000004, 260.1149999999998, 252.21500000000015, 263.3799999999992, 271.65500000000065], [230.11500000000024, 265.1750000000002, 261.71000000000095, 255.71499999999833, 275.2450000000008]]}}}}}, "Adding100Items": {"metrics": {"Time": ["Total"]}, "tests": {"Async": {"metrics": {"Time": {"current": [[24.829999999999927, 65.63500000000022, 24.700000000000728, 21.590000000000146, 22.420000000000073], [23.899999999999636, 27.105000000001382, 22.045000000000073, 22.63500000000022, 23.804999999998472], [24.554999999999836, 21.93000000000029, 22.30999999999949, 22.919999999998254, 22.80500000000029], [24.700000000000273, 26.24000000000069, 22.465000000000146, 22.465000000000146, 22.48999999999978], [23.090000000000146, 26.855000000000473, 23.13500000000022, 25.3799999999992, 27.714999999998327]]}}}, "Sync": {"metrics": {"Time": {"current": [[157.55000000000018, 147.4950000000008, 141.52500000000146, 139.07999999999993, 165.76500000000124], [162.17999999999984, 144.47999999999956, 167.26499999999942, 135.01000000000022, 147.2400000000016], [169.64499999999998, 133.1949999999997, 146.79999999999927, 160.47000000000116, 139.24499999999898], [158.69000000000005, 141.21500000000015, 142.4900000000016, 159.02999999999884, 143.78000000000065], [139.39999999999964, 140.78499999999985, 137.13500000000022, 157.33500000000095, 151.38500000000022]]}}}}}}}, "React-TodoMVC": {"metrics": {"Time": ["Total"]}, "tests": {"DeletingAllItems": {"metrics": {"Time": ["Total"]}, "tests": {"Async": {"metrics": {"Time": {"current": [[4.119999999999891, 5.949999999999818, 4.614999999999782, 4.179999999998472, 4.254999999997381], [4.150000000000091, 4.630000000000109, 5.080000000001746, 4.305000000000291, 4.18500000000131], [4.039999999999964, 4.769999999999527, 4.315000000000509, 4.250000000001819, 4.165000000000873], [4.474999999999454, 4.644999999999527, 4.170000000000073, 4.130000000001019, 4.2150000000001455], [4.414999999999964, 4.170000000000073, 4.074999999998909, 4.309999999999491, 4.599999999998545]]}}}, "Sync": {"metrics": {"Time": {"current": [[153.97500000000036, 149.5050000000001, 166.23500000000058, 155.16499999999724, 157.71500000000378], [165.01999999999998, 145.89999999999964, 149.02999999999884, 151.5550000000003, 155.45000000000073], [157.35500000000047, 152.39999999999964, 153.57500000000073, 161.07999999999993, 158.90000000000146], [168.1850000000004, 165.34500000000025, 160.84000000000015, 159.84499999999935, 169.0099999999984], [167.98000000000002, 156.3100000000004, 150.52000000000044, 148.1200000000008, 166.51000000000022]]}}}}}, "CompletingAllItems": {"metrics": {"Time": ["Total"]}, "tests": {"Async": {"metrics": {"Time": {"current": [[13.2199999999998, 10.944999999999709, 11.704999999999927, 10.125, 10.139999999999418], [9.940000000000055, 10.509999999999309, 10.069999999999709, 9.8849999999984, 10.264999999999418], [10.944999999999709, 9.840000000000146, 10.170000000001892, 10.18499999999949, 9.919999999998254], [10.200000000000273, 10.925000000000182, 10.164999999999054, 10.329999999999927, 9.140000000003056], [10.700000000000273, 13.05999999999949, 9.965000000000146, 10.420000000000073, 10.255000000001019]]}}}, "Sync": {"metrics": {"Time": {"current": [[272.21500000000015, 334.9449999999997, 287.6399999999994, 271.2950000000001, 281.97000000000116], [284.68499999999995, 281.2450000000008, 273.9250000000011, 283.2450000000008, 276.91499999999724], [304.4600000000005, 299.8000000000002, 291.9449999999997, 268.244999999999, 291.4300000000003], [267.7900000000004, 292.0549999999994, 266.9450000000015, 285.7049999999999, 281.5249999999978], [290.61500000000024, 304.77500000000055, 275.47999999999956, 265.8550000000014, 291.7599999999984]]}}}}}, "Adding100Items": {"metrics": {"Time": ["Total"]}, "tests": {"Async": {"metrics": {"Time": {"current": [[23.374999999999545, 15.319999999999709, 13.880000000001019, 14.93999999999869, 24.3650000000016], [14.199999999999818, 15.384999999999309, 14.104999999999563, 16.38000000000102, 14.800000000001091], [25.965000000000146, 18.73999999999978, 15.569999999999709, 15.405000000000655, 16.149999999999636], [14.414999999999964, 14.63000000000011, 14.264999999999418, 16.280000000000655, 16.144999999998618], [16.09999999999991, 14.6299999999992, 13.914999999999054, 15.514999999999418, 14.630000000001019]]}}}, "Sync": {"metrics": {"Time": {"current": [[249.13500000000022, 252.5, 236.59499999999935, 218.75500000000102, 220.98999999999978], [231.9699999999998, 223.60500000000047, 263.2900000000009, 226.45499999999993, 230.72999999999774], [297.5499999999997, 236.04500000000098, 346.3199999999997, 227.70499999999993, 220.9150000000027], [231.7550000000001, 257.60499999999956, 282.6149999999998, 220.28000000000065, 227.35000000000036], [233.51000000000022, 235.7450000000008, 257.3700000000008, 231.34500000000116, 252.5099999999984]]}}}}}}}}}} \ No newline at end of file diff --git a/docs/sample-files/minibrowser-gtk/sunspider.result b/docs/sample-files/minibrowser-gtk/sunspider.result new file mode 100644 index 0000000..771ef52 --- /dev/null +++ b/docs/sample-files/minibrowser-gtk/sunspider.result @@ -0,0 +1 @@ +{"SunSpider": {"metrics": {"Time": ["Total"]}, "tests": {"math-spectral-norm": {"metrics": {"Time": {"current": [[2, 2, 2, 1, 2, 3, 1, 3, 3, 2], [3, 2, 2, 2, 2, 3, 2, 2, 2, 2], [2, 2, 2, 3, 2, 2, 1, 2, 4, 2], [2, 1, 2, 2, 2, 2, 2, 3, 2, 2], [1, 1, 3, 2, 2, 2, 2, 3, 2, 1]]}}}, "bitops-3bit-bits-in-byte": {"metrics": {"Time": {"current": [[1, 1, 1, 1, 1, 1, 1, 1, 1, 1], [1, 1, 1, 2, 1, 1, 1, 2, 1, 1], [1, 1, 2, 0, 1, 1, 1, 1, 1, 2], [1, 1, 2, 1, 1, 1, 1, 2, 1, 0], [2, 1, 1, 1, 1, 2, 1, 1, 1, 1]]}}}, "date-format-xparb": {"metrics": {"Time": {"current": [[5, 5, 7, 7, 6, 6, 5, 4, 7, 6], [7, 5, 8, 5, 4, 5, 6, 5, 6, 9], [4, 8, 7, 6, 5, 6, 5, 10, 5, 9], [5, 5, 5, 8, 6, 7, 8, 7, 6, 7], [6, 5, 5, 7, 8, 8, 5, 7, 6, 6]]}}}, "3d-morph": {"metrics": {"Time": {"current": [[12, 13, 11, 14, 13, 10, 11, 11, 14, 12], [15, 14, 13, 14, 10, 10, 12, 15, 15, 11], [11, 11, 12, 12, 12, 15, 14, 11, 11, 11], [12, 14, 17, 10, 12, 11, 14, 12, 13, 12], [13, 11, 11, 12, 10, 14, 12, 14, 11, 10]]}}}, "controlflow-recursive": {"metrics": {"Time": {"current": [[3, 3, 3, 3, 2, 2, 2, 2, 2, 4], [4, 3, 2, 3, 4, 3, 2, 4, 3, 3], [3, 3, 3, 3, 2, 2, 2, 4, 2, 2], [2, 2, 3, 3, 2, 4, 3, 3, 2, 3], [4, 2, 4, 4, 2, 3, 2, 3, 2, 3]]}}}, "string-base64": {"metrics": {"Time": {"current": [[3, 6, 7, 5, 3, 4, 5, 8, 5, 3], [7, 5, 6, 7, 6, 6, 6, 3, 6, 4], [6, 4, 6, 6, 4, 4, 4, 4, 4, 4], [3, 6, 6, 4, 6, 6, 3, 6, 4, 5], [3, 4, 5, 5, 5, 4, 5, 5, 3, 4]]}}}, "access-fannkuch": {"metrics": {"Time": {"current": [[7, 9, 7, 7, 5, 5, 4, 7, 6, 7], [9, 6, 6, 6, 9, 5, 4, 9, 8, 6], [8, 10, 8, 4, 4, 9, 4, 7, 6, 5], [8, 6, 5, 5, 5, 7, 5, 6, 5, 6], [6, 6, 6, 7, 7, 6, 7, 9, 8, 7]]}}}, "access-nsieve": {"metrics": {"Time": {"current": [[2, 2, 5, 3, 3, 3, 3, 5, 2, 2], [1, 2, 3, 3, 3, 2, 3, 2, 3, 3], [2, 3, 3, 3, 3, 3, 2, 3, 3, 3], [3, 3, 3, 2, 3, 3, 2, 3, 4, 2], [4, 2, 2, 3, 4, 3, 3, 2, 4, 3]]}}}, "crypto-md5": {"metrics": {"Time": {"current": [[2, 2, 2, 4, 2, 2, 2, 3, 3, 3], [3, 4, 3, 3, 3, 3, 2, 2, 3, 2], [3, 4, 3, 3, 2, 2, 2, 2, 3, 2], [2, 2, 2, 2, 2, 3, 2, 2, 2, 3], [3, 2, 3, 3, 3, 3, 2, 2, 3, 3]]}}}, "bitops-nsieve-bits": {"metrics": {"Time": {"current": [[3, 4, 3, 3, 4, 3, 3, 3, 5, 5], [4, 4, 3, 4, 3, 4, 4, 3, 4, 4], [6, 5, 4, 4, 4, 3, 3, 5, 3, 4], [3, 4, 3, 3, 4, 4, 3, 4, 3, 5], [5, 3, 3, 4, 5, 5, 3, 3, 5, 3]]}}}, "access-binary-trees": {"metrics": {"Time": {"current": [[1, 2, 2, 1, 2, 2, 2, 2, 2, 2], [2, 2, 3, 3, 4, 2, 2, 3, 2, 3], [2, 1, 2, 2, 2, 2, 2, 2, 3, 1], [2, 3, 2, 2, 3, 2, 2, 2, 2, 3], [2, 2, 4, 3, 2, 3, 2, 2, 3, 2]]}}}, "bitops-bitwise-and": {"metrics": {"Time": {"current": [[1, 2, 3, 2, 2, 1, 2, 2, 1, 1], [2, 2, 3, 3, 3, 2, 1, 2, 3, 1], [2, 2, 2, 2, 2, 2, 1, 1, 1, 3], [1, 1, 1, 2, 2, 1, 2, 2, 3, 1], [3, 2, 1, 3, 1, 1, 1, 2, 3, 2]]}}}, "string-validate-input": {"metrics": {"Time": {"current": [[4, 4, 6, 4, 6, 5, 4, 6, 5, 6], [5, 7, 4, 7, 4, 5, 7, 4, 4, 4], [4, 4, 6, 6, 5, 4, 4, 4, 4, 5], [6, 4, 6, 4, 5, 6, 4, 7, 9, 4], [4, 5, 6, 6, 4, 6, 8, 7, 4, 4]]}}}, "3d-raytrace": {"metrics": {"Time": {"current": [[6, 4, 7, 4, 4, 6, 5, 5, 4, 5], [7, 6, 4, 8, 10, 8, 4, 5, 7, 7], [8, 6, 7, 4, 6, 6, 4, 5, 10, 5], [5, 7, 5, 6, 6, 6, 4, 6, 4, 8], [5, 5, 10, 5, 7, 6, 10, 8, 9, 4]]}}}, "string-fasta": {"metrics": {"Time": {"current": [[9, 9, 9, 6, 11, 9, 7, 6, 6, 7], [10, 6, 9, 9, 9, 8, 8, 9, 5, 5], [9, 6, 8, 9, 6, 6, 5, 6, 6, 6], [8, 9, 10, 6, 5, 9, 8, 9, 7, 5], [5, 6, 8, 12, 7, 6, 7, 8, 9, 7]]}}}, "regexp-dna": {"metrics": {"Time": {"current": [[6, 8, 6, 5, 6, 5, 7, 5, 6, 6], [7, 7, 8, 8, 6, 8, 8, 6, 6, 6], [6, 6, 6, 8, 6, 6, 6, 6, 5, 5], [9, 5, 5, 6, 8, 7, 6, 7, 6, 5], [7, 6, 5, 6, 7, 6, 6, 8, 6, 6]]}}}, "math-partial-sums": {"metrics": {"Time": {"current": [[10, 9, 10, 6, 7, 7, 6, 9, 10, 10], [9, 7, 5, 8, 7, 6, 9, 7, 9, 8], [10, 6, 9, 10, 6, 6, 6, 8, 7, 9], [6, 7, 6, 6, 8, 8, 10, 9, 10, 10], [6, 6, 8, 10, 7, 7, 6, 9, 10, 7]]}}}, "access-nbody": {"metrics": {"Time": {"current": [[2, 3, 3, 2, 2, 2, 2, 3, 2, 2], [2, 2, 2, 2, 2, 2, 2, 2, 2, 2], [2, 4, 2, 2, 2, 3, 2, 4, 2, 2], [2, 2, 2, 4, 2, 2, 2, 2, 3, 2], [3, 2, 2, 2, 2, 3, 2, 2, 2, 3]]}}}, "string-tagcloud": {"metrics": {"Time": {"current": [[10, 11, 10, 8, 11, 10, 9, 9, 8, 8], [12, 9, 7, 11, 11, 8, 11, 8, 8, 9], [10, 10, 9, 11, 9, 15, 8, 9, 13, 9], [16, 10, 10, 8, 7, 11, 9, 9, 10, 9], [8, 9, 11, 11, 7, 8, 10, 9, 11, 8]]}}}, "bitops-bits-in-byte": {"metrics": {"Time": {"current": [[2, 2, 3, 3, 3, 2, 2, 3, 3, 3], [4, 3, 3, 3, 4, 2, 3, 3, 3, 3], [3, 2, 3, 3, 4, 3, 2, 2, 3, 3], [2, 2, 3, 3, 2, 3, 3, 2, 3, 2], [4, 2, 2, 3, 4, 4, 3, 3, 3, 3]]}}}, "string-unpack-code": {"metrics": {"Time": {"current": [[18, 18, 19, 19, 22, 19, 19, 19, 21, 21], [21, 23, 18, 19, 20, 20, 20, 20, 19, 19], [18, 20, 20, 21, 20, 23, 20, 19, 23, 19], [31, 21, 23, 18, 22, 20, 19, 21, 19, 19], [20, 22, 18, 21, 18, 20, 21, 18, 20, 19]]}}}, "crypto-aes": {"metrics": {"Time": {"current": [[4, 6, 4, 5, 5, 3, 4, 5, 6, 3], [7, 8, 5, 8, 5, 5, 3, 6, 4, 5], [6, 3, 4, 5, 4, 5, 4, 3, 4, 6], [4, 3, 4, 3, 4, 4, 3, 4, 4, 3], [4, 4, 8, 5, 6, 5, 5, 4, 3, 3]]}}}, "crypto-sha1": {"metrics": {"Time": {"current": [[4, 2, 2, 2, 3, 3, 2, 3, 3, 3], [4, 3, 3, 3, 4, 3, 3, 2, 4, 3], [4, 3, 2, 2, 2, 2, 3, 3, 2, 2], [4, 2, 2, 2, 2, 2, 4, 3, 3, 3], [4, 2, 5, 2, 2, 2, 2, 3, 2, 3]]}}}, "date-format-tofte": {"metrics": {"Time": {"current": [[9, 7, 7, 10, 11, 6, 7, 6, 10, 8], [10, 9, 10, 10, 9, 7, 7, 8, 7, 10], [8, 10, 10, 10, 8, 7, 11, 9, 7, 8], [13, 7, 7, 11, 6, 10, 11, 9, 7, 10], [8, 6, 12, 10, 10, 10, 6, 10, 9, 7]]}}}, "math-cordic": {"metrics": {"Time": {"current": [[4, 3, 4, 2, 2, 3, 2, 2, 4, 5], [4, 4, 4, 3, 4, 2, 3, 3, 2, 4], [4, 4, 4, 4, 2, 2, 2, 4, 2, 3], [2, 2, 2, 4, 3, 3, 5, 4, 5, 4], [3, 2, 4, 4, 4, 5, 2, 4, 4, 2]]}}}, "3d-cube": {"metrics": {"Time": {"current": [[5, 5, 5, 7, 6, 5, 4, 5, 8, 7], [5, 6, 7, 4, 7, 5, 5, 6, 6, 5], [5, 6, 5, 5, 5, 5, 5, 5, 5, 4], [6, 4, 7, 4, 5, 5, 5, 5, 7, 5], [5, 5, 8, 4, 4, 5, 7, 9, 5, 5]]}}}}}} \ No newline at end of file diff --git a/docs/sample-files/speedometerexample.result b/docs/sample-files/speedometerexample.result new file mode 100644 index 0000000..02b47a3 --- /dev/null +++ b/docs/sample-files/speedometerexample.result @@ -0,0 +1,11 @@ + +{"SpeedometerExample": {"metrics": {"Score": {"current": [142, 141, 143, 141, 143] }, + "Time": ["Total"]}, + "tests": {"AngularJS-TodoMVC": {"metrics": {"Time": ["Total"]}, + "tests": {"Adding100Items": {"metrics": {"Time": ["Total"]}, + "tests": {"Async": {"metrics": {"Time": {"current": [9, 11, 10, 12.25, 14 ]}}}, + "Sync": {"metrics": {"Time": {"current": [207, 198, 214, 203.8, 210]}}}}}, + "Adding200Items": {"metrics": {"Time": ["Total"]}, + "tests": {"Async": {"metrics": {"Time": {"current": [19, 21, 20, 32.25, 44 ]}}}, + "Sync": {"metrics": {"Time": {"current": [407, 398, 414, 403.8, 523]}}}}}}}}}} +