- fork: python
- ref: f6cc7c8bd01d8468af70
- machine: linux-x86_64
- commit hash: f6cc7c8
- commit date: 2024-10-26
- overall geometric mean: 1.37x faster
- HPT reliability: 100.00%
- HPT 99th percentile: 1.25x faster
- Memory change: 1.33x
| Benchmark | bm-20220323-linux-x86_64-python-v3.10.4-3.10.4-9d38120 | bm-20241026-linux-x86_64-python-f6cc7c8bd01d8468af70-3.14.0a1+-f6cc7c8 |
|---|---|---|
| 2to3 | 348 ms | 279 ms: 1.25x faster |
| docutils | 3.30 sec | 2.93 sec: 1.12x faster |
| html5lib | 88.9 ms | 67.2 ms: 1.32x faster |
| tornado_http | 136 ms | 94.6 ms: 1.44x faster |
| Geometric mean | (ref) | 1.28x faster |
| Benchmark | bm-20220323-linux-x86_64-python-v3.10.4-3.10.4-9d38120 | bm-20241026-linux-x86_64-python-f6cc7c8bd01d8468af70-3.14.0a1+-f6cc7c8 |
|---|---|---|
| async_tree_none | 728 ms | 339 ms: 2.15x faster |
| async_tree_memoization | 870 ms | 416 ms: 2.09x faster |
| async_tree_io | 1.77 sec | 861 ms: 2.05x faster |
| async_tree_cpu_io_mixed | 1.02 sec | 579 ms: 1.75x faster |
| Geometric mean | (ref) | 2.01x faster |
| Benchmark | bm-20220323-linux-x86_64-python-v3.10.4-3.10.4-9d38120 | bm-20241026-linux-x86_64-python-f6cc7c8bd01d8468af70-3.14.0a1+-f6cc7c8 |
|---|---|---|
| nbody | 154 ms | 81.3 ms: 1.89x faster |
| float | 117 ms | 76.3 ms: 1.53x faster |
| pidigits | 191 ms | 187 ms: 1.02x faster |
| Geometric mean | (ref) | 1.44x faster |
| Benchmark | bm-20220323-linux-x86_64-python-v3.10.4-3.10.4-9d38120 | bm-20241026-linux-x86_64-python-f6cc7c8bd01d8468af70-3.14.0a1+-f6cc7c8 |
|---|---|---|
| regex_compile | 188 ms | 138 ms: 1.37x faster |
| regex_v8 | 27.8 ms | 25.3 ms: 1.10x faster |
| regex_dna | 227 ms | 219 ms: 1.04x faster |
| regex_effbot | 3.63 ms | 3.75 ms: 1.03x slower |
| Geometric mean | (ref) | 1.11x faster |
| Benchmark | bm-20220323-linux-x86_64-python-v3.10.4-3.10.4-9d38120 | bm-20241026-linux-x86_64-python-f6cc7c8bd01d8468af70-3.14.0a1+-f6cc7c8 |
|---|---|---|
| tomli_loads | 3.14 sec | 1.92 sec: 1.64x faster |
| pickle_pure_python | 484 us | 310 us: 1.56x faster |
| unpickle_pure_python | 331 us | 216 us: 1.53x faster |
| xml_etree_process | 79.1 ms | 55.4 ms: 1.43x faster |
| xml_etree_generate | 99.4 ms | 78.2 ms: 1.27x faster |
| json_dumps | 14.2 ms | 11.2 ms: 1.26x faster |
| json_loads | 31.2 us | 26.9 us: 1.16x faster |
| xml_etree_iterparse | 115 ms | 99.6 ms: 1.16x faster |
| xml_etree_parse | 168 ms | 147 ms: 1.14x faster |
| Geometric mean | (ref) | 1.34x faster |
| Benchmark | bm-20220323-linux-x86_64-python-v3.10.4-3.10.4-9d38120 | bm-20241026-linux-x86_64-python-f6cc7c8bd01d8468af70-3.14.0a1+-f6cc7c8 |
|---|---|---|
| python_startup | 14.6 ms | 12.7 ms: 1.15x faster |
| python_startup_no_site | 5.93 ms | 7.08 ms: 1.19x slower |
| Geometric mean | (ref) | 1.02x slower |
| Benchmark | bm-20220323-linux-x86_64-python-v3.10.4-3.10.4-9d38120 | bm-20241026-linux-x86_64-python-f6cc7c8bd01d8468af70-3.14.0a1+-f6cc7c8 |
|---|---|---|
| mako | 16.3 ms | 9.98 ms: 1.64x faster |
| django_template | 48.2 ms | 36.4 ms: 1.32x faster |
| genshi_text | 31.8 ms | 25.6 ms: 1.24x faster |
| genshi_xml | 66.0 ms | 60.0 ms: 1.10x faster |
| Geometric mean | (ref) | 1.31x faster |
| Benchmark | bm-20220323-linux-x86_64-python-v3.10.4-3.10.4-9d38120 | bm-20241026-linux-x86_64-python-f6cc7c8bd01d8468af70-3.14.0a1+-f6cc7c8 |
|---|---|---|
| typing_runtime_protocols | 544 us | 166 us: 3.28x faster |
| deltablue | 7.91 ms | 3.27 ms: 2.42x faster |
| generators | 80.1 ms | 35.3 ms: 2.27x faster |
| richards_super | 94.7 ms | 43.3 ms: 2.19x faster |
| async_tree_none | 728 ms | 339 ms: 2.15x faster |
| async_tree_memoization | 870 ms | 416 ms: 2.09x faster |
| async_tree_io | 1.77 sec | 861 ms: 2.05x faster |
| richards | 79.3 ms | 39.6 ms: 2.00x faster |
| deepcopy_memo | 58.5 us | 29.6 us: 1.97x faster |
| logging_silent | 190 ns | 97.3 ns: 1.95x faster |
| chaos | 115 ms | 59.4 ms: 1.94x faster |
| crypto_pyaes | 128 ms | 67.3 ms: 1.90x faster |
| nbody | 154 ms | 81.3 ms: 1.89x faster |
| scimark_sor | 220 ms | 118 ms: 1.85x faster |
| scimark_monte_carlo | 118 ms | 63.9 ms: 1.85x faster |
| raytrace | 507 ms | 278 ms: 1.83x faster |
| go | 240 ms | 132 ms: 1.81x faster |
| deepcopy | 479 us | 271 us: 1.77x faster |
| async_tree_cpu_io_mixed | 1.02 sec | 579 ms: 1.75x faster |
| comprehensions | 28.8 us | 17.0 us: 1.69x faster |
| tomli_loads | 3.14 sec | 1.92 sec: 1.64x faster |
| mako | 16.3 ms | 9.98 ms: 1.64x faster |
| sqlglot_parse | 2.17 ms | 1.33 ms: 1.64x faster |
| pyflate | 716 ms | 448 ms: 1.60x faster |
| pickle_pure_python | 484 us | 310 us: 1.56x faster |
| deepcopy_reduce | 4.17 us | 2.70 us: 1.55x faster |
| float | 117 ms | 76.3 ms: 1.53x faster |
| unpickle_pure_python | 331 us | 216 us: 1.53x faster |
| scimark_lu | 176 ms | 115 ms: 1.53x faster |
| sqlglot_transpile | 2.57 ms | 1.69 ms: 1.52x faster |
| pylint | 551 ms | 367 ms: 1.50x faster |
| coroutines | 35.1 ms | 23.5 ms: 1.49x faster |
| logging_simple | 8.30 us | 5.57 us: 1.49x faster |
| hexiom | 10.4 ms | 6.98 ms: 1.49x faster |
| logging_format | 9.09 us | 6.14 us: 1.48x faster |
| scimark_fft | 466 ms | 316 ms: 1.47x faster |
| spectral_norm | 170 ms | 116 ms: 1.47x faster |
| tornado_http | 136 ms | 94.6 ms: 1.44x faster |
| xml_etree_process | 79.1 ms | 55.4 ms: 1.43x faster |
| pprint_pformat | 2.10 sec | 1.49 sec: 1.42x faster |
| scimark_sparse_mat_mult | 6.47 ms | 4.59 ms: 1.41x faster |
| pprint_safe_repr | 1.02 sec | 727 ms: 1.40x faster |
| regex_compile | 188 ms | 138 ms: 1.37x faster |
| thrift | 1.07 ms | 797 us: 1.35x faster |
| fannkuch | 532 ms | 400 ms: 1.33x faster |
| django_template | 48.2 ms | 36.4 ms: 1.32x faster |
| html5lib | 88.9 ms | 67.2 ms: 1.32x faster |
| pycparser | 1.58 sec | 1.20 sec: 1.32x faster |
| sqlalchemy_imperative | 23.3 ms | 17.8 ms: 1.31x faster |
| xml_etree_generate | 99.4 ms | 78.2 ms: 1.27x faster |
| dulwich_log | 84.3 ms | 66.5 ms: 1.27x faster |
| pathlib | 20.5 ms | 16.2 ms: 1.26x faster |
| json_dumps | 14.2 ms | 11.2 ms: 1.26x faster |
| sqlglot_normalize | 143 ms | 114 ms: 1.25x faster |
| 2to3 | 348 ms | 279 ms: 1.25x faster |
| genshi_text | 31.8 ms | 25.6 ms: 1.24x faster |
| nqueens | 106 ms | 87.2 ms: 1.21x faster |
| sqlalchemy_declarative | 172 ms | 148 ms: 1.17x faster |
| json_loads | 31.2 us | 26.9 us: 1.16x faster |
| xml_etree_iterparse | 115 ms | 99.6 ms: 1.16x faster |
| sqlglot_optimize | 69.2 ms | 59.9 ms: 1.16x faster |
| python_startup | 14.6 ms | 12.7 ms: 1.15x faster |
| sympy_str | 346 ms | 303 ms: 1.14x faster |
| xml_etree_parse | 168 ms | 147 ms: 1.14x faster |
| json | 5.69 ms | 5.02 ms: 1.13x faster |
| sympy_expand | 566 ms | 501 ms: 1.13x faster |
| docutils | 3.30 sec | 2.93 sec: 1.12x faster |
| bench_thread_pool | 986 us | 882 us: 1.12x faster |
| sympy_sum | 196 ms | 176 ms: 1.11x faster |
| meteor_contest | 120 ms | 109 ms: 1.10x faster |
| genshi_xml | 66.0 ms | 60.0 ms: 1.10x faster |
| regex_v8 | 27.8 ms | 25.3 ms: 1.10x faster |
| sympy_integrate | 25.8 ms | 23.5 ms: 1.10x faster |
| regex_dna | 227 ms | 219 ms: 1.04x faster |
| mdp | 2.85 sec | 2.76 sec: 1.03x faster |
| pidigits | 191 ms | 187 ms: 1.02x faster |
| asyncio_websockets | 559 ms | 555 ms: 1.01x faster |
| async_generators | 444 ms | 453 ms: 1.02x slower |
| regex_effbot | 3.63 ms | 3.75 ms: 1.03x slower |
| telco | 7.27 ms | 7.62 ms: 1.05x slower |
| coverage | 79.4 ms | 84.9 ms: 1.07x slower |
| python_startup_no_site | 5.93 ms | 7.08 ms: 1.19x slower |
| gc_traversal | 3.62 ms | 4.74 ms: 1.31x slower |
| create_gc_cycles | 1.62 ms | 2.69 ms: 1.66x slower |
| bench_mp_pool | 24.0 ms | 84.4 ms: 3.51x slower |
| Geometric mean | (ref) | 1.37x faster |
| Ignored benchmarks (16) of results/bm-20220323-3.10.4-9d38120/bm-20220323-linux-x86_64-python-v3.10.4-3.10.4-9d38120.json: aiohttp, asyncio_tcp, asyncio_tcp_ssl, chameleon, dask, djangocms, flaskblogging, gunicorn, mypy2, pickle, pickle_dict, pickle_list, sqlite_synth, unpack_sequence, unpickle, unpickle_list | ||
| Ignored benchmarks (6) of results/bm-20241026-3.14.0a1+-f6cc7c8-JIT/bm-20241026-linux-x86_64-python-f6cc7c8bd01d8468af70-3.14.0a1+-f6cc7c8.json: async_tree_cpu_io_mixed_tg, async_tree_io_tg, async_tree_memoization_tg, async_tree_none_tg, bpe_tokeniser, sphinx |
- Reliability score: 100.00% likely to be faster
- 90% likely to have a speedup of 1.29x
- 95% likely to have a speedup of 1.27x
- 99% likely to have a speedup of 1.25x
- memory change: 1.33x