Skip to content

Instantly share code, notes, and snippets.

@yongkangc
Created January 15, 2026 16:50
Show Gist options
  • Select an option

  • Save yongkangc/fb9dea26961d727298e342b5e242d8dd to your computer and use it in GitHub Desktop.

Select an option

Save yongkangc/fb9dea26961d727298e342b5e242d8dd to your computer and use it in GitHub Desktop.
Merge strategies benchmark: extend_ref_old vs extend_ref_new vs kway_merge
Finished `bench` profile [optimized + debuginfo] target(s) in 0.25s
Running benches/merge_strategies.rs (target/release/deps/merge_strategies-5c4e859c5b1f0919)
Gnuplot not found, using plotters backend
Benchmarking HashedPostState_merge/extend_ref_old/n=50_k=3
Benchmarking HashedPostState_merge/extend_ref_old/n=50_k=3: Warming up for 3.0000 s
Benchmarking HashedPostState_merge/extend_ref_old/n=50_k=3: Collecting 100 samples in estimated 5.0073 s (1.3M iterations)
Benchmarking HashedPostState_merge/extend_ref_old/n=50_k=3: Analyzing
HashedPostState_merge/extend_ref_old/n=50_k=3
time: [3.6096 µs 3.6130 µs 3.6167 µs]
change: [-2.3141% -2.1418% -1.9619%] (p = 0.00 < 0.05)
Performance has improved.
Found 3 outliers among 100 measurements (3.00%)
1 (1.00%) high mild
2 (2.00%) high severe
Benchmarking HashedPostState_merge/extend_ref_new/n=50_k=3
Benchmarking HashedPostState_merge/extend_ref_new/n=50_k=3: Warming up for 3.0000 s
Benchmarking HashedPostState_merge/extend_ref_new/n=50_k=3: Collecting 100 samples in estimated 5.0144 s (889k iterations)
Benchmarking HashedPostState_merge/extend_ref_new/n=50_k=3: Analyzing
HashedPostState_merge/extend_ref_new/n=50_k=3
time: [5.5741 µs 5.5797 µs 5.5872 µs]
change: [-4.1718% -3.8446% -3.5308%] (p = 0.00 < 0.05)
Performance has improved.
Found 9 outliers among 100 measurements (9.00%)
5 (5.00%) high mild
4 (4.00%) high severe
Benchmarking HashedPostState_merge/kway_merge/n=50_k=3
Benchmarking HashedPostState_merge/kway_merge/n=50_k=3: Warming up for 3.0000 s
Benchmarking HashedPostState_merge/kway_merge/n=50_k=3: Collecting 100 samples in estimated 5.0242 s (379k iterations)
Benchmarking HashedPostState_merge/kway_merge/n=50_k=3: Analyzing
HashedPostState_merge/kway_merge/n=50_k=3
time: [13.250 µs 13.264 µs 13.279 µs]
change: [-1.6063% -1.3629% -1.0575%] (p = 0.00 < 0.05)
Performance has improved.
Found 8 outliers among 100 measurements (8.00%)
2 (2.00%) high mild
6 (6.00%) high severe
Benchmarking HashedPostState_merge/extend_ref_old/n=50_k=5
Benchmarking HashedPostState_merge/extend_ref_old/n=50_k=5: Warming up for 3.0000 s
Benchmarking HashedPostState_merge/extend_ref_old/n=50_k=5: Collecting 100 samples in estimated 5.0376 s (611k iterations)
Benchmarking HashedPostState_merge/extend_ref_old/n=50_k=5: Analyzing
HashedPostState_merge/extend_ref_old/n=50_k=5
time: [8.1779 µs 8.1858 µs 8.1944 µs]
change: [+0.4110% +0.6813% +0.9429%] (p = 0.00 < 0.05)
Change within noise threshold.
Found 7 outliers among 100 measurements (7.00%)
5 (5.00%) high mild
2 (2.00%) high severe
Benchmarking HashedPostState_merge/extend_ref_new/n=50_k=5
Benchmarking HashedPostState_merge/extend_ref_new/n=50_k=5: Warming up for 3.0000 s
Benchmarking HashedPostState_merge/extend_ref_new/n=50_k=5: Collecting 100 samples in estimated 5.0659 s (364k iterations)
Benchmarking HashedPostState_merge/extend_ref_new/n=50_k=5: Analyzing
HashedPostState_merge/extend_ref_new/n=50_k=5
time: [13.765 µs 13.777 µs 13.796 µs]
change: [-5.7691% -5.6121% -5.4389%] (p = 0.00 < 0.05)
Performance has improved.
Found 6 outliers among 100 measurements (6.00%)
2 (2.00%) high mild
4 (4.00%) high severe
Benchmarking HashedPostState_merge/kway_merge/n=50_k=5
Benchmarking HashedPostState_merge/kway_merge/n=50_k=5: Warming up for 3.0000 s
Benchmarking HashedPostState_merge/kway_merge/n=50_k=5: Collecting 100 samples in estimated 5.0946 s (227k iterations)
Benchmarking HashedPostState_merge/kway_merge/n=50_k=5: Analyzing
HashedPostState_merge/kway_merge/n=50_k=5
time: [22.194 µs 22.207 µs 22.224 µs]
change: [-1.7696% -1.4514% -1.2127%] (p = 0.00 < 0.05)
Performance has improved.
Found 4 outliers among 100 measurements (4.00%)
2 (2.00%) high mild
2 (2.00%) high severe
Benchmarking HashedPostState_merge/extend_ref_old/n=50_k=10
Benchmarking HashedPostState_merge/extend_ref_old/n=50_k=10: Warming up for 3.0000 s
Benchmarking HashedPostState_merge/extend_ref_old/n=50_k=10: Collecting 100 samples in estimated 5.0680 s (288k iterations)
Benchmarking HashedPostState_merge/extend_ref_old/n=50_k=10: Analyzing
HashedPostState_merge/extend_ref_old/n=50_k=10
time: [17.541 µs 17.560 µs 17.581 µs]
change: [+2.5463% +2.8062% +3.0727%] (p = 0.00 < 0.05)
Performance has regressed.
Found 9 outliers among 100 measurements (9.00%)
4 (4.00%) high mild
5 (5.00%) high severe
Benchmarking HashedPostState_merge/extend_ref_new/n=50_k=10
Benchmarking HashedPostState_merge/extend_ref_new/n=50_k=10: Warming up for 3.0000 s
Benchmarking HashedPostState_merge/extend_ref_new/n=50_k=10: Collecting 100 samples in estimated 5.1713 s (116k iterations)
Benchmarking HashedPostState_merge/extend_ref_new/n=50_k=10: Analyzing
HashedPostState_merge/extend_ref_new/n=50_k=10
time: [44.488 µs 44.516 µs 44.548 µs]
change: [+2.3876% +2.6106% +2.7956%] (p = 0.00 < 0.05)
Performance has regressed.
Found 8 outliers among 100 measurements (8.00%)
3 (3.00%) high mild
5 (5.00%) high severe
Benchmarking HashedPostState_merge/kway_merge/n=50_k=10
Benchmarking HashedPostState_merge/kway_merge/n=50_k=10: Warming up for 3.0000 s
Benchmarking HashedPostState_merge/kway_merge/n=50_k=10: Collecting 100 samples in estimated 5.1042 s (106k iterations)
Benchmarking HashedPostState_merge/kway_merge/n=50_k=10: Analyzing
HashedPostState_merge/kway_merge/n=50_k=10
time: [50.277 µs 50.319 µs 50.362 µs]
change: [+4.1922% +4.3477% +4.5220%] (p = 0.00 < 0.05)
Performance has regressed.
Found 8 outliers among 100 measurements (8.00%)
7 (7.00%) high mild
1 (1.00%) high severe
Benchmarking HashedPostState_merge/extend_ref_old/n=50_k=30
Benchmarking HashedPostState_merge/extend_ref_old/n=50_k=30: Warming up for 3.0000 s
Benchmarking HashedPostState_merge/extend_ref_old/n=50_k=30: Collecting 100 samples in estimated 5.1591 s (101k iterations)
Benchmarking HashedPostState_merge/extend_ref_old/n=50_k=30: Analyzing
HashedPostState_merge/extend_ref_old/n=50_k=30
time: [50.960 µs 51.065 µs 51.170 µs]
change: [-2.0512% -1.7069% -1.3290%] (p = 0.00 < 0.05)
Performance has improved.
Found 8 outliers among 100 measurements (8.00%)
6 (6.00%) high mild
2 (2.00%) high severe
Benchmarking HashedPostState_merge/extend_ref_new/n=50_k=30
Benchmarking HashedPostState_merge/extend_ref_new/n=50_k=30: Warming up for 3.0000 s
Benchmarking HashedPostState_merge/extend_ref_new/n=50_k=30: Collecting 100 samples in estimated 5.8505 s (20k iterations)
Benchmarking HashedPostState_merge/extend_ref_new/n=50_k=30: Analyzing
HashedPostState_merge/extend_ref_new/n=50_k=30
time: [288.05 µs 288.42 µs 288.80 µs]
change: [-0.2865% -0.0482% +0.1907%] (p = 0.69 > 0.05)
No change in performance detected.
Found 4 outliers among 100 measurements (4.00%)
3 (3.00%) high mild
1 (1.00%) high severe
Benchmarking HashedPostState_merge/kway_merge/n=50_k=30
Benchmarking HashedPostState_merge/kway_merge/n=50_k=30: Warming up for 3.0000 s
Benchmarking HashedPostState_merge/kway_merge/n=50_k=30: Collecting 100 samples in estimated 5.7320 s (35k iterations)
Benchmarking HashedPostState_merge/kway_merge/n=50_k=30: Analyzing
HashedPostState_merge/kway_merge/n=50_k=30
time: [162.53 µs 162.83 µs 163.15 µs]
change: [-11.854% -11.639% -11.422%] (p = 0.00 < 0.05)
Performance has improved.
Found 6 outliers among 100 measurements (6.00%)
6 (6.00%) high mild
Benchmarking HashedPostState_merge/extend_ref_old/n=100_k=3
Benchmarking HashedPostState_merge/extend_ref_old/n=100_k=3: Warming up for 3.0000 s
Benchmarking HashedPostState_merge/extend_ref_old/n=100_k=3: Collecting 100 samples in estimated 5.0133 s (636k iterations)
Benchmarking HashedPostState_merge/extend_ref_old/n=100_k=3: Analyzing
HashedPostState_merge/extend_ref_old/n=100_k=3
time: [8.2236 µs 8.2304 µs 8.2378 µs]
change: [+5.8218% +6.1810% +6.5973%] (p = 0.00 < 0.05)
Performance has regressed.
Found 10 outliers among 100 measurements (10.00%)
4 (4.00%) high mild
6 (6.00%) high severe
Benchmarking HashedPostState_merge/extend_ref_new/n=100_k=3
Benchmarking HashedPostState_merge/extend_ref_new/n=100_k=3: Warming up for 3.0000 s
Benchmarking HashedPostState_merge/extend_ref_new/n=100_k=3: Collecting 100 samples in estimated 5.0272 s (470k iterations)
Benchmarking HashedPostState_merge/extend_ref_new/n=100_k=3: Analyzing
HashedPostState_merge/extend_ref_new/n=100_k=3
time: [10.603 µs 10.607 µs 10.612 µs]
change: [-4.2655% -3.6618% -3.2081%] (p = 0.00 < 0.05)
Performance has improved.
Found 8 outliers among 100 measurements (8.00%)
5 (5.00%) high mild
3 (3.00%) high severe
Benchmarking HashedPostState_merge/kway_merge/n=100_k=3
Benchmarking HashedPostState_merge/kway_merge/n=100_k=3: Warming up for 3.0000 s
Benchmarking HashedPostState_merge/kway_merge/n=100_k=3: Collecting 100 samples in estimated 5.1180 s (192k iterations)
Benchmarking HashedPostState_merge/kway_merge/n=100_k=3: Analyzing
HashedPostState_merge/kway_merge/n=100_k=3
time: [26.379 µs 26.391 µs 26.404 µs]
Found 10 outliers among 100 measurements (10.00%)
6 (6.00%) high mild
4 (4.00%) high severe
Benchmarking HashedPostState_merge/extend_ref_old/n=100_k=5
Benchmarking HashedPostState_merge/extend_ref_old/n=100_k=5: Warming up for 3.0000 s
Benchmarking HashedPostState_merge/extend_ref_old/n=100_k=5: Collecting 100 samples in estimated 5.0524 s (333k iterations)
Benchmarking HashedPostState_merge/extend_ref_old/n=100_k=5: Analyzing
HashedPostState_merge/extend_ref_old/n=100_k=5
time: [16.513 µs 16.534 µs 16.557 µs]
Found 10 outliers among 100 measurements (10.00%)
1 (1.00%) low mild
6 (6.00%) high mild
3 (3.00%) high severe
Benchmarking HashedPostState_merge/extend_ref_new/n=100_k=5
Benchmarking HashedPostState_merge/extend_ref_new/n=100_k=5: Warming up for 3.0000 s
Benchmarking HashedPostState_merge/extend_ref_new/n=100_k=5: Collecting 100 samples in estimated 5.0337 s (207k iterations)
Benchmarking HashedPostState_merge/extend_ref_new/n=100_k=5: Analyzing
HashedPostState_merge/extend_ref_new/n=100_k=5
time: [24.061 µs 24.075 µs 24.090 µs]
Found 9 outliers among 100 measurements (9.00%)
3 (3.00%) high mild
6 (6.00%) high severe
Benchmarking HashedPostState_merge/kway_merge/n=100_k=5
Benchmarking HashedPostState_merge/kway_merge/n=100_k=5: Warming up for 3.0000 s
Benchmarking HashedPostState_merge/kway_merge/n=100_k=5: Collecting 100 samples in estimated 5.1965 s (116k iterations)
Benchmarking HashedPostState_merge/kway_merge/n=100_k=5: Analyzing
HashedPostState_merge/kway_merge/n=100_k=5
time: [44.790 µs 44.877 µs 45.002 µs]
Found 10 outliers among 100 measurements (10.00%)
2 (2.00%) high mild
8 (8.00%) high severe
Benchmarking HashedPostState_merge/extend_ref_old/n=100_k=10
Benchmarking HashedPostState_merge/extend_ref_old/n=100_k=10: Warming up for 3.0000 s
Benchmarking HashedPostState_merge/extend_ref_old/n=100_k=10: Collecting 100 samples in estimated 5.1273 s (146k iterations)
Benchmarking HashedPostState_merge/extend_ref_old/n=100_k=10: Analyzing
HashedPostState_merge/extend_ref_old/n=100_k=10
time: [35.509 µs 35.580 µs 35.664 µs]
Found 8 outliers among 100 measurements (8.00%)
6 (6.00%) high mild
2 (2.00%) high severe
Benchmarking HashedPostState_merge/extend_ref_new/n=100_k=10
Benchmarking HashedPostState_merge/extend_ref_new/n=100_k=10: Warming up for 3.0000 s
Benchmarking HashedPostState_merge/extend_ref_new/n=100_k=10: Collecting 100 samples in estimated 5.3613 s (71k iterations)
Benchmarking HashedPostState_merge/extend_ref_new/n=100_k=10: Analyzing
HashedPostState_merge/extend_ref_new/n=100_k=10
time: [76.237 µs 76.305 µs 76.374 µs]
Found 15 outliers among 100 measurements (15.00%)
3 (3.00%) low severe
4 (4.00%) low mild
6 (6.00%) high mild
2 (2.00%) high severe
Benchmarking HashedPostState_merge/kway_merge/n=100_k=10
Benchmarking HashedPostState_merge/kway_merge/n=100_k=10: Warming up for 3.0000 s
Benchmarking HashedPostState_merge/kway_merge/n=100_k=10: Collecting 100 samples in estimated 5.3613 s (56k iterations)
Benchmarking HashedPostState_merge/kway_merge/n=100_k=10: Analyzing
HashedPostState_merge/kway_merge/n=100_k=10
time: [96.813 µs 96.951 µs 97.113 µs]
Found 5 outliers among 100 measurements (5.00%)
4 (4.00%) high mild
1 (1.00%) high severe
Benchmarking HashedPostState_merge/extend_ref_old/n=100_k=30
Benchmarking HashedPostState_merge/extend_ref_old/n=100_k=30: Warming up for 3.0000 s
Benchmarking HashedPostState_merge/extend_ref_old/n=100_k=30: Collecting 100 samples in estimated 5.3905 s (50k iterations)
Benchmarking HashedPostState_merge/extend_ref_old/n=100_k=30: Analyzing
HashedPostState_merge/extend_ref_old/n=100_k=30
time: [106.62 µs 106.89 µs 107.18 µs]
Found 12 outliers among 100 measurements (12.00%)
6 (6.00%) high mild
6 (6.00%) high severe
Benchmarking HashedPostState_merge/extend_ref_new/n=100_k=30
Benchmarking HashedPostState_merge/extend_ref_new/n=100_k=30: Warming up for 3.0000 s
Benchmarking HashedPostState_merge/extend_ref_new/n=100_k=30: Collecting 100 samples in estimated 5.6744 s (10k iterations)
Benchmarking HashedPostState_merge/extend_ref_new/n=100_k=30: Analyzing
HashedPostState_merge/extend_ref_new/n=100_k=30
time: [559.08 µs 561.24 µs 563.43 µs]
Found 2 outliers among 100 measurements (2.00%)
2 (2.00%) high mild
Benchmarking HashedPostState_merge/kway_merge/n=100_k=30
Benchmarking HashedPostState_merge/kway_merge/n=100_k=30: Warming up for 3.0000 s
Benchmarking HashedPostState_merge/kway_merge/n=100_k=30: Collecting 100 samples in estimated 5.1609 s (15k iterations)
Benchmarking HashedPostState_merge/kway_merge/n=100_k=30: Analyzing
HashedPostState_merge/kway_merge/n=100_k=30
time: [338.44 µs 339.33 µs 340.32 µs]
Found 10 outliers among 100 measurements (10.00%)
1 (1.00%) high mild
9 (9.00%) high severe
Benchmarking HashedPostState_merge/extend_ref_old/n=200_k=3
Benchmarking HashedPostState_merge/extend_ref_old/n=200_k=3: Warming up for 3.0000 s
Benchmarking HashedPostState_merge/extend_ref_old/n=200_k=3: Collecting 100 samples in estimated 5.0061 s (323k iterations)
Benchmarking HashedPostState_merge/extend_ref_old/n=200_k=3: Analyzing
HashedPostState_merge/extend_ref_old/n=200_k=3
time: [15.487 µs 15.521 µs 15.559 µs]
Found 14 outliers among 100 measurements (14.00%)
6 (6.00%) high mild
8 (8.00%) high severe
Benchmarking HashedPostState_merge/extend_ref_new/n=200_k=3
Benchmarking HashedPostState_merge/extend_ref_new/n=200_k=3: Warming up for 3.0000 s
Benchmarking HashedPostState_merge/extend_ref_new/n=200_k=3: Collecting 100 samples in estimated 5.0314 s (232k iterations)
Benchmarking HashedPostState_merge/extend_ref_new/n=200_k=3: Analyzing
HashedPostState_merge/extend_ref_new/n=200_k=3
time: [21.027 µs 21.068 µs 21.128 µs]
Found 7 outliers among 100 measurements (7.00%)
3 (3.00%) high mild
4 (4.00%) high severe
Benchmarking HashedPostState_merge/kway_merge/n=200_k=3
Benchmarking HashedPostState_merge/kway_merge/n=200_k=3: Warming up for 3.0000 s
Benchmarking HashedPostState_merge/kway_merge/n=200_k=3: Collecting 100 samples in estimated 5.0748 s (96k iterations)
Benchmarking HashedPostState_merge/kway_merge/n=200_k=3: Analyzing
HashedPostState_merge/kway_merge/n=200_k=3
time: [52.864 µs 53.111 µs 53.394 µs]
Found 11 outliers among 100 measurements (11.00%)
3 (3.00%) high mild
8 (8.00%) high severe
Benchmarking HashedPostState_merge/extend_ref_old/n=200_k=5
Benchmarking HashedPostState_merge/extend_ref_old/n=200_k=5: Warming up for 3.0000 s
Benchmarking HashedPostState_merge/extend_ref_old/n=200_k=5: Collecting 100 samples in estimated 5.0661 s (157k iterations)
Benchmarking HashedPostState_merge/extend_ref_old/n=200_k=5: Analyzing
HashedPostState_merge/extend_ref_old/n=200_k=5
time: [32.387 µs 32.440 µs 32.490 µs]
Found 8 outliers among 100 measurements (8.00%)
1 (1.00%) low mild
3 (3.00%) high mild
4 (4.00%) high severe
Benchmarking HashedPostState_merge/extend_ref_new/n=200_k=5
Benchmarking HashedPostState_merge/extend_ref_new/n=200_k=5: Warming up for 3.0000 s
Benchmarking HashedPostState_merge/extend_ref_new/n=200_k=5: Collecting 100 samples in estimated 5.0794 s (101k iterations)
Benchmarking HashedPostState_merge/extend_ref_new/n=200_k=5: Analyzing
HashedPostState_merge/extend_ref_new/n=200_k=5
time: [50.411 µs 50.609 µs 50.826 µs]
Found 8 outliers among 100 measurements (8.00%)
5 (5.00%) high mild
3 (3.00%) high severe
Benchmarking HashedPostState_merge/kway_merge/n=200_k=5
Benchmarking HashedPostState_merge/kway_merge/n=200_k=5: Warming up for 3.0000 s
Benchmarking HashedPostState_merge/kway_merge/n=200_k=5: Collecting 100 samples in estimated 5.3685 s (61k iterations)
Benchmarking HashedPostState_merge/kway_merge/n=200_k=5: Analyzing
HashedPostState_merge/kway_merge/n=200_k=5
time: [88.605 µs 88.800 µs 89.023 µs]
Found 3 outliers among 100 measurements (3.00%)
3 (3.00%) high mild
Benchmarking HashedPostState_merge/extend_ref_old/n=200_k=10
Benchmarking HashedPostState_merge/extend_ref_old/n=200_k=10: Warming up for 3.0000 s
Benchmarking HashedPostState_merge/extend_ref_old/n=200_k=10: Collecting 100 samples in estimated 5.1799 s (71k iterations)
Benchmarking HashedPostState_merge/extend_ref_old/n=200_k=10: Analyzing
HashedPostState_merge/extend_ref_old/n=200_k=10
time: [72.462 µs 72.589 µs 72.738 µs]
Found 6 outliers among 100 measurements (6.00%)
2 (2.00%) high mild
4 (4.00%) high severe
Benchmarking HashedPostState_merge/extend_ref_new/n=200_k=10
Benchmarking HashedPostState_merge/extend_ref_new/n=200_k=10: Warming up for 3.0000 s
Benchmarking HashedPostState_merge/extend_ref_new/n=200_k=10: Collecting 100 samples in estimated 5.4025 s (35k iterations)
Benchmarking HashedPostState_merge/extend_ref_new/n=200_k=10: Analyzing
HashedPostState_merge/extend_ref_new/n=200_k=10
time: [150.22 µs 150.42 µs 150.64 µs]
Found 11 outliers among 100 measurements (11.00%)
4 (4.00%) high mild
7 (7.00%) high severe
Benchmarking HashedPostState_merge/kway_merge/n=200_k=10
Benchmarking HashedPostState_merge/kway_merge/n=200_k=10: Warming up for 3.0000 s
Benchmarking HashedPostState_merge/kway_merge/n=200_k=10: Collecting 100 samples in estimated 5.8486 s (30k iterations)
Benchmarking HashedPostState_merge/kway_merge/n=200_k=10: Analyzing
HashedPostState_merge/kway_merge/n=200_k=10
time: [194.02 µs 194.57 µs 195.14 µs]
Found 5 outliers among 100 measurements (5.00%)
3 (3.00%) high mild
2 (2.00%) high severe
Benchmarking HashedPostState_merge/extend_ref_old/n=200_k=30
Benchmarking HashedPostState_merge/extend_ref_old/n=200_k=30: Warming up for 3.0000 s
Benchmarking HashedPostState_merge/extend_ref_old/n=200_k=30: Collecting 100 samples in estimated 5.6256 s (25k iterations)
Benchmarking HashedPostState_merge/extend_ref_old/n=200_k=30: Analyzing
HashedPostState_merge/extend_ref_old/n=200_k=30
time: [219.57 µs 220.81 µs 222.25 µs]
Found 12 outliers among 100 measurements (12.00%)
7 (7.00%) high mild
5 (5.00%) high severe
Benchmarking HashedPostState_merge/extend_ref_new/n=200_k=30
Benchmarking HashedPostState_merge/extend_ref_new/n=200_k=30: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 5.7s, enable flat sampling, or reduce sample count to 60.
Benchmarking HashedPostState_merge/extend_ref_new/n=200_k=30: Collecting 100 samples in estimated 5.6757 s (5050 iterations)
Benchmarking HashedPostState_merge/extend_ref_new/n=200_k=30: Analyzing
HashedPostState_merge/extend_ref_new/n=200_k=30
time: [1.1265 ms 1.1299 ms 1.1336 ms]
Found 2 outliers among 100 measurements (2.00%)
1 (1.00%) high mild
1 (1.00%) high severe
Benchmarking HashedPostState_merge/kway_merge/n=200_k=30
Benchmarking HashedPostState_merge/kway_merge/n=200_k=30: Warming up for 3.0000 s
Benchmarking HashedPostState_merge/kway_merge/n=200_k=30: Collecting 100 samples in estimated 7.2540 s (10k iterations)
Benchmarking HashedPostState_merge/kway_merge/n=200_k=30: Analyzing
HashedPostState_merge/kway_merge/n=200_k=30
time: [703.78 µs 706.00 µs 708.48 µs]
Found 8 outliers among 100 measurements (8.00%)
2 (2.00%) high mild
6 (6.00%) high severe
Benchmarking HashedPostState_merge/extend_ref_old/n=500_k=3
Benchmarking HashedPostState_merge/extend_ref_old/n=500_k=3: Warming up for 3.0000 s
Benchmarking HashedPostState_merge/extend_ref_old/n=500_k=3: Collecting 100 samples in estimated 5.0832 s (121k iterations)
Benchmarking HashedPostState_merge/extend_ref_old/n=500_k=3: Analyzing
HashedPostState_merge/extend_ref_old/n=500_k=3
time: [41.019 µs 41.168 µs 41.349 µs]
Found 5 outliers among 100 measurements (5.00%)
5 (5.00%) high mild
Benchmarking HashedPostState_merge/extend_ref_new/n=500_k=3
Benchmarking HashedPostState_merge/extend_ref_new/n=500_k=3: Warming up for 3.0000 s
Benchmarking HashedPostState_merge/extend_ref_new/n=500_k=3: Collecting 100 samples in estimated 5.0911 s (91k iterations)
Benchmarking HashedPostState_merge/extend_ref_new/n=500_k=3: Analyzing
HashedPostState_merge/extend_ref_new/n=500_k=3
time: [55.441 µs 55.656 µs 55.982 µs]
Found 6 outliers among 100 measurements (6.00%)
4 (4.00%) high mild
2 (2.00%) high severe
Benchmarking HashedPostState_merge/kway_merge/n=500_k=3
Benchmarking HashedPostState_merge/kway_merge/n=500_k=3: Warming up for 3.0000 s
Benchmarking HashedPostState_merge/kway_merge/n=500_k=3: Collecting 100 samples in estimated 5.3645 s (40k iterations)
Benchmarking HashedPostState_merge/kway_merge/n=500_k=3: Analyzing
HashedPostState_merge/kway_merge/n=500_k=3
time: [133.29 µs 133.73 µs 134.25 µs]
Found 6 outliers among 100 measurements (6.00%)
3 (3.00%) high mild
3 (3.00%) high severe
Benchmarking HashedPostState_merge/extend_ref_old/n=500_k=5
Benchmarking HashedPostState_merge/extend_ref_old/n=500_k=5: Warming up for 3.0000 s
Benchmarking HashedPostState_merge/extend_ref_old/n=500_k=5: Collecting 100 samples in estimated 5.0760 s (66k iterations)
Benchmarking HashedPostState_merge/extend_ref_old/n=500_k=5: Analyzing
HashedPostState_merge/extend_ref_old/n=500_k=5
time: [76.945 µs 77.334 µs 77.751 µs]
Found 8 outliers among 100 measurements (8.00%)
8 (8.00%) high mild
Benchmarking HashedPostState_merge/extend_ref_new/n=500_k=5
Benchmarking HashedPostState_merge/extend_ref_new/n=500_k=5: Warming up for 3.0000 s
Benchmarking HashedPostState_merge/extend_ref_new/n=500_k=5: Collecting 100 samples in estimated 5.0398 s (40k iterations)
Benchmarking HashedPostState_merge/extend_ref_new/n=500_k=5: Analyzing
HashedPostState_merge/extend_ref_new/n=500_k=5
time: [124.27 µs 124.61 µs 124.96 µs]
Found 3 outliers among 100 measurements (3.00%)
2 (2.00%) high mild
1 (1.00%) high severe
Benchmarking HashedPostState_merge/kway_merge/n=500_k=5
Benchmarking HashedPostState_merge/kway_merge/n=500_k=5: Warming up for 3.0000 s
Benchmarking HashedPostState_merge/kway_merge/n=500_k=5: Collecting 100 samples in estimated 5.6596 s (25k iterations)
Benchmarking HashedPostState_merge/kway_merge/n=500_k=5: Analyzing
HashedPostState_merge/kway_merge/n=500_k=5
time: [223.83 µs 224.26 µs 224.68 µs]
Found 4 outliers among 100 measurements (4.00%)
3 (3.00%) high mild
1 (1.00%) high severe
Benchmarking HashedPostState_merge/extend_ref_old/n=500_k=10
Benchmarking HashedPostState_merge/extend_ref_old/n=500_k=10: Warming up for 3.0000 s
Benchmarking HashedPostState_merge/extend_ref_old/n=500_k=10: Collecting 100 samples in estimated 5.2555 s (30k iterations)
Benchmarking HashedPostState_merge/extend_ref_old/n=500_k=10: Analyzing
HashedPostState_merge/extend_ref_old/n=500_k=10
time: [173.61 µs 174.20 µs 174.86 µs]
Found 10 outliers among 100 measurements (10.00%)
2 (2.00%) high mild
8 (8.00%) high severe
Benchmarking HashedPostState_merge/extend_ref_new/n=500_k=10
Benchmarking HashedPostState_merge/extend_ref_new/n=500_k=10: Warming up for 3.0000 s
Benchmarking HashedPostState_merge/extend_ref_new/n=500_k=10: Collecting 100 samples in estimated 6.0406 s (15k iterations)
Benchmarking HashedPostState_merge/extend_ref_new/n=500_k=10: Analyzing
HashedPostState_merge/extend_ref_new/n=500_k=10
time: [397.61 µs 399.29 µs 401.11 µs]
Found 2 outliers among 100 measurements (2.00%)
2 (2.00%) high mild
Benchmarking HashedPostState_merge/kway_merge/n=500_k=10
Benchmarking HashedPostState_merge/kway_merge/n=500_k=10: Warming up for 3.0000 s
Benchmarking HashedPostState_merge/kway_merge/n=500_k=10: Collecting 100 samples in estimated 5.0859 s (10k iterations)
Benchmarking HashedPostState_merge/kway_merge/n=500_k=10: Analyzing
HashedPostState_merge/kway_merge/n=500_k=10
time: [501.94 µs 504.29 µs 507.17 µs]
Found 11 outliers among 100 measurements (11.00%)
9 (9.00%) high mild
2 (2.00%) high severe
Benchmarking HashedPostState_merge/extend_ref_old/n=500_k=30
Benchmarking HashedPostState_merge/extend_ref_old/n=500_k=30: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 5.4s, enable flat sampling, or reduce sample count to 60.
Benchmarking HashedPostState_merge/extend_ref_old/n=500_k=30: Collecting 100 samples in estimated 5.4473 s (5050 iterations)
Benchmarking HashedPostState_merge/extend_ref_old/n=500_k=30: Analyzing
HashedPostState_merge/extend_ref_old/n=500_k=30
time: [1.0943 ms 1.1154 ms 1.1392 ms]
Found 4 outliers among 100 measurements (4.00%)
4 (4.00%) high mild
Benchmarking HashedPostState_merge/extend_ref_new/n=500_k=30
Benchmarking HashedPostState_merge/extend_ref_new/n=500_k=30: Warming up for 3.0000 s
Benchmarking HashedPostState_merge/extend_ref_new/n=500_k=30: Collecting 100 samples in estimated 5.0041 s (1700 iterations)
Benchmarking HashedPostState_merge/extend_ref_new/n=500_k=30: Analyzing
HashedPostState_merge/extend_ref_new/n=500_k=30
time: [2.9631 ms 2.9829 ms 3.0033 ms]
Benchmarking HashedPostState_merge/kway_merge/n=500_k=30
Benchmarking HashedPostState_merge/kway_merge/n=500_k=30: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 9.7s, enable flat sampling, or reduce sample count to 50.
Benchmarking HashedPostState_merge/kway_merge/n=500_k=30: Collecting 100 samples in estimated 9.6659 s (5050 iterations)
Benchmarking HashedPostState_merge/kway_merge/n=500_k=30: Analyzing
HashedPostState_merge/kway_merge/n=500_k=30
time: [1.9415 ms 1.9515 ms 1.9625 ms]
Found 4 outliers among 100 measurements (4.00%)
1 (1.00%) high mild
3 (3.00%) high severe
Benchmarking HashedPostState_merge/extend_ref_old/n=1000_k=3
Benchmarking HashedPostState_merge/extend_ref_old/n=1000_k=3: Warming up for 3.0000 s
Benchmarking HashedPostState_merge/extend_ref_old/n=1000_k=3: Collecting 100 samples in estimated 5.1631 s (61k iterations)
Benchmarking HashedPostState_merge/extend_ref_old/n=1000_k=3: Analyzing
HashedPostState_merge/extend_ref_old/n=1000_k=3
time: [84.770 µs 85.092 µs 85.475 µs]
Found 8 outliers among 100 measurements (8.00%)
5 (5.00%) high mild
3 (3.00%) high severe
Benchmarking HashedPostState_merge/extend_ref_new/n=1000_k=3
Benchmarking HashedPostState_merge/extend_ref_new/n=1000_k=3: Warming up for 3.0000 s
Benchmarking HashedPostState_merge/extend_ref_new/n=1000_k=3: Collecting 100 samples in estimated 5.2701 s (45k iterations)
Benchmarking HashedPostState_merge/extend_ref_new/n=1000_k=3: Analyzing
HashedPostState_merge/extend_ref_new/n=1000_k=3
time: [113.48 µs 113.81 µs 114.20 µs]
Found 14 outliers among 100 measurements (14.00%)
10 (10.00%) high mild
4 (4.00%) high severe
Benchmarking HashedPostState_merge/kway_merge/n=1000_k=3
Benchmarking HashedPostState_merge/kway_merge/n=1000_k=3: Warming up for 3.0000 s
Benchmarking HashedPostState_merge/kway_merge/n=1000_k=3: Collecting 100 samples in estimated 5.5419 s (20k iterations)
Benchmarking HashedPostState_merge/kway_merge/n=1000_k=3: Analyzing
HashedPostState_merge/kway_merge/n=1000_k=3
time: [272.41 µs 272.97 µs 273.60 µs]
Found 10 outliers among 100 measurements (10.00%)
6 (6.00%) high mild
4 (4.00%) high severe
Benchmarking HashedPostState_merge/extend_ref_old/n=1000_k=5
Benchmarking HashedPostState_merge/extend_ref_old/n=1000_k=5: Warming up for 3.0000 s
Benchmarking HashedPostState_merge/extend_ref_old/n=1000_k=5: Collecting 100 samples in estimated 5.7377 s (35k iterations)
Benchmarking HashedPostState_merge/extend_ref_old/n=1000_k=5: Analyzing
HashedPostState_merge/extend_ref_old/n=1000_k=5
time: [162.89 µs 163.71 µs 164.55 µs]
Found 5 outliers among 100 measurements (5.00%)
3 (3.00%) high mild
2 (2.00%) high severe
Benchmarking HashedPostState_merge/extend_ref_new/n=1000_k=5
Benchmarking HashedPostState_merge/extend_ref_new/n=1000_k=5: Warming up for 3.0000 s
Benchmarking HashedPostState_merge/extend_ref_new/n=1000_k=5: Collecting 100 samples in estimated 5.0262 s (20k iterations)
Benchmarking HashedPostState_merge/extend_ref_new/n=1000_k=5: Analyzing
HashedPostState_merge/extend_ref_new/n=1000_k=5
time: [248.86 µs 249.66 µs 250.48 µs]
Found 6 outliers among 100 measurements (6.00%)
4 (4.00%) high mild
2 (2.00%) high severe
Benchmarking HashedPostState_merge/kway_merge/n=1000_k=5
Benchmarking HashedPostState_merge/kway_merge/n=1000_k=5: Warming up for 3.0000 s
Benchmarking HashedPostState_merge/kway_merge/n=1000_k=5: Collecting 100 samples in estimated 7.0401 s (15k iterations)
Benchmarking HashedPostState_merge/kway_merge/n=1000_k=5: Analyzing
HashedPostState_merge/kway_merge/n=1000_k=5
time: [473.26 µs 474.89 µs 476.61 µs]
Found 5 outliers among 100 measurements (5.00%)
4 (4.00%) high mild
1 (1.00%) high severe
Benchmarking HashedPostState_merge/extend_ref_old/n=1000_k=10
Benchmarking HashedPostState_merge/extend_ref_old/n=1000_k=10: Warming up for 3.0000 s
Benchmarking HashedPostState_merge/extend_ref_old/n=1000_k=10: Collecting 100 samples in estimated 5.9106 s (15k iterations)
Benchmarking HashedPostState_merge/extend_ref_old/n=1000_k=10: Analyzing
HashedPostState_merge/extend_ref_old/n=1000_k=10
time: [386.31 µs 389.89 µs 393.60 µs]
Found 7 outliers among 100 measurements (7.00%)
3 (3.00%) high mild
4 (4.00%) high severe
Benchmarking HashedPostState_merge/extend_ref_new/n=1000_k=10
Benchmarking HashedPostState_merge/extend_ref_new/n=1000_k=10: Warming up for 3.0000 s
Benchmarking HashedPostState_merge/extend_ref_new/n=1000_k=10: Collecting 100 samples in estimated 8.2850 s (10k iterations)
Benchmarking HashedPostState_merge/extend_ref_new/n=1000_k=10: Analyzing
HashedPostState_merge/extend_ref_new/n=1000_k=10
time: [820.75 µs 828.40 µs 836.94 µs]
Found 11 outliers among 100 measurements (11.00%)
5 (5.00%) high mild
6 (6.00%) high severe
Benchmarking HashedPostState_merge/kway_merge/n=1000_k=10
Benchmarking HashedPostState_merge/kway_merge/n=1000_k=10: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 5.6s, enable flat sampling, or reduce sample count to 60.
Benchmarking HashedPostState_merge/kway_merge/n=1000_k=10: Collecting 100 samples in estimated 5.5569 s (5050 iterations)
Benchmarking HashedPostState_merge/kway_merge/n=1000_k=10: Analyzing
HashedPostState_merge/kway_merge/n=1000_k=10
time: [1.1028 ms 1.1079 ms 1.1139 ms]
Found 5 outliers among 100 measurements (5.00%)
4 (4.00%) high mild
1 (1.00%) high severe
Benchmarking HashedPostState_merge/extend_ref_old/n=1000_k=30
Benchmarking HashedPostState_merge/extend_ref_old/n=1000_k=30: Warming up for 3.0000 s
Benchmarking HashedPostState_merge/extend_ref_old/n=1000_k=30: Collecting 100 samples in estimated 5.0108 s (1300 iterations)
Benchmarking HashedPostState_merge/extend_ref_old/n=1000_k=30: Analyzing
HashedPostState_merge/extend_ref_old/n=1000_k=30
time: [3.9952 ms 4.0656 ms 4.1376 ms]
Benchmarking HashedPostState_merge/extend_ref_new/n=1000_k=30
Benchmarking HashedPostState_merge/extend_ref_new/n=1000_k=30: Warming up for 3.0000 s
Benchmarking HashedPostState_merge/extend_ref_new/n=1000_k=30: Collecting 100 samples in estimated 5.2079 s (800 iterations)
Benchmarking HashedPostState_merge/extend_ref_new/n=1000_k=30: Analyzing
HashedPostState_merge/extend_ref_new/n=1000_k=30
time: [6.5326 ms 6.5700 ms 6.6077 ms]
Benchmarking HashedPostState_merge/kway_merge/n=1000_k=30
Benchmarking HashedPostState_merge/kway_merge/n=1000_k=30: Warming up for 3.0000 s
Benchmarking HashedPostState_merge/kway_merge/n=1000_k=30: Collecting 100 samples in estimated 5.4061 s (1200 iterations)
Benchmarking HashedPostState_merge/kway_merge/n=1000_k=30: Analyzing
HashedPostState_merge/kway_merge/n=1000_k=30
time: [4.5603 ms 4.6029 ms 4.6469 ms]
Benchmarking HashedPostState_merge/extend_ref_old/n=2000_k=3
Benchmarking HashedPostState_merge/extend_ref_old/n=2000_k=3: Warming up for 3.0000 s
Benchmarking HashedPostState_merge/extend_ref_old/n=2000_k=3: Collecting 100 samples in estimated 5.5492 s (30k iterations)
Benchmarking HashedPostState_merge/extend_ref_old/n=2000_k=3: Analyzing
HashedPostState_merge/extend_ref_old/n=2000_k=3
time: [186.39 µs 187.35 µs 188.39 µs]
Found 9 outliers among 100 measurements (9.00%)
7 (7.00%) high mild
2 (2.00%) high severe
Benchmarking HashedPostState_merge/extend_ref_new/n=2000_k=3
Benchmarking HashedPostState_merge/extend_ref_new/n=2000_k=3: Warming up for 3.0000 s
Benchmarking HashedPostState_merge/extend_ref_new/n=2000_k=3: Collecting 100 samples in estimated 5.6863 s (25k iterations)
Benchmarking HashedPostState_merge/extend_ref_new/n=2000_k=3: Analyzing
HashedPostState_merge/extend_ref_new/n=2000_k=3
time: [222.39 µs 223.04 µs 223.71 µs]
Found 6 outliers among 100 measurements (6.00%)
1 (1.00%) high mild
5 (5.00%) high severe
Benchmarking HashedPostState_merge/kway_merge/n=2000_k=3
Benchmarking HashedPostState_merge/kway_merge/n=2000_k=3: Warming up for 3.0000 s
Benchmarking HashedPostState_merge/kway_merge/n=2000_k=3: Collecting 100 samples in estimated 5.6418 s (10k iterations)
Benchmarking HashedPostState_merge/kway_merge/n=2000_k=3: Analyzing
HashedPostState_merge/kway_merge/n=2000_k=3
time: [555.46 µs 557.70 µs 559.96 µs]
Found 5 outliers among 100 measurements (5.00%)
5 (5.00%) high mild
Benchmarking HashedPostState_merge/extend_ref_old/n=2000_k=5
Benchmarking HashedPostState_merge/extend_ref_old/n=2000_k=5: Warming up for 3.0000 s
Benchmarking HashedPostState_merge/extend_ref_old/n=2000_k=5: Collecting 100 samples in estimated 5.6101 s (15k iterations)
Benchmarking HashedPostState_merge/extend_ref_old/n=2000_k=5: Analyzing
HashedPostState_merge/extend_ref_old/n=2000_k=5
time: [361.83 µs 364.26 µs 367.70 µs]
Found 12 outliers among 100 measurements (12.00%)
6 (6.00%) high mild
6 (6.00%) high severe
Benchmarking HashedPostState_merge/extend_ref_new/n=2000_k=5
Benchmarking HashedPostState_merge/extend_ref_new/n=2000_k=5: Warming up for 3.0000 s
Benchmarking HashedPostState_merge/extend_ref_new/n=2000_k=5: Collecting 100 samples in estimated 5.5015 s (10k iterations)
Benchmarking HashedPostState_merge/extend_ref_new/n=2000_k=5: Analyzing
HashedPostState_merge/extend_ref_new/n=2000_k=5
time: [525.82 µs 528.20 µs 531.03 µs]
Found 5 outliers among 100 measurements (5.00%)
3 (3.00%) high mild
2 (2.00%) high severe
Benchmarking HashedPostState_merge/kway_merge/n=2000_k=5
Benchmarking HashedPostState_merge/kway_merge/n=2000_k=5: Warming up for 3.0000 s
Benchmarking HashedPostState_merge/kway_merge/n=2000_k=5: Collecting 100 samples in estimated 9.8425 s (10k iterations)
Benchmarking HashedPostState_merge/kway_merge/n=2000_k=5: Analyzing
HashedPostState_merge/kway_merge/n=2000_k=5
time: [969.24 µs 970.93 µs 972.86 µs]
Found 7 outliers among 100 measurements (7.00%)
3 (3.00%) high mild
4 (4.00%) high severe
Benchmarking HashedPostState_merge/extend_ref_old/n=2000_k=10
Benchmarking HashedPostState_merge/extend_ref_old/n=2000_k=10: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 9.6s, enable flat sampling, or reduce sample count to 50.
Benchmarking HashedPostState_merge/extend_ref_old/n=2000_k=10: Collecting 100 samples in estimated 9.5667 s (5050 iterations)
Benchmarking HashedPostState_merge/extend_ref_old/n=2000_k=10: Analyzing
HashedPostState_merge/extend_ref_old/n=2000_k=10
time: [1.8435 ms 1.8839 ms 1.9239 ms]
Found 6 outliers among 100 measurements (6.00%)
6 (6.00%) high mild
Benchmarking HashedPostState_merge/extend_ref_new/n=2000_k=10
Benchmarking HashedPostState_merge/extend_ref_new/n=2000_k=10: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 9.5s, enable flat sampling, or reduce sample count to 50.
Benchmarking HashedPostState_merge/extend_ref_new/n=2000_k=10: Collecting 100 samples in estimated 9.5311 s (5050 iterations)
Benchmarking HashedPostState_merge/extend_ref_new/n=2000_k=10: Analyzing
HashedPostState_merge/extend_ref_new/n=2000_k=10
time: [1.8691 ms 1.8888 ms 1.9136 ms]
Found 10 outliers among 100 measurements (10.00%)
7 (7.00%) high mild
3 (3.00%) high severe
Benchmarking HashedPostState_merge/kway_merge/n=2000_k=10
Benchmarking HashedPostState_merge/kway_merge/n=2000_k=10: Warming up for 3.0000 s
Benchmarking HashedPostState_merge/kway_merge/n=2000_k=10: Collecting 100 samples in estimated 5.2020 s (2200 iterations)
Benchmarking HashedPostState_merge/kway_merge/n=2000_k=10: Analyzing
HashedPostState_merge/kway_merge/n=2000_k=10
time: [2.4313 ms 2.4616 ms 2.4927 ms]
Benchmarking HashedPostState_merge/extend_ref_old/n=2000_k=30
Benchmarking HashedPostState_merge/extend_ref_old/n=2000_k=30: Warming up for 3.0000 s
Benchmarking HashedPostState_merge/extend_ref_old/n=2000_k=30: Collecting 100 samples in estimated 5.9539 s (600 iterations)
Benchmarking HashedPostState_merge/extend_ref_old/n=2000_k=30: Analyzing
HashedPostState_merge/extend_ref_old/n=2000_k=30
time: [10.005 ms 10.148 ms 10.299 ms]
Found 3 outliers among 100 measurements (3.00%)
3 (3.00%) high mild
Benchmarking HashedPostState_merge/extend_ref_new/n=2000_k=30
Benchmarking HashedPostState_merge/extend_ref_new/n=2000_k=30: Warming up for 3.0000 s
Benchmarking HashedPostState_merge/extend_ref_new/n=2000_k=30: Collecting 100 samples in estimated 5.5952 s (400 iterations)
Benchmarking HashedPostState_merge/extend_ref_new/n=2000_k=30: Analyzing
HashedPostState_merge/extend_ref_new/n=2000_k=30
time: [13.917 ms 13.962 ms 14.007 ms]
Benchmarking HashedPostState_merge/kway_merge/n=2000_k=30
Benchmarking HashedPostState_merge/kway_merge/n=2000_k=30: Warming up for 3.0000 s
Benchmarking HashedPostState_merge/kway_merge/n=2000_k=30: Collecting 100 samples in estimated 5.9891 s (500 iterations)
Benchmarking HashedPostState_merge/kway_merge/n=2000_k=30: Analyzing
HashedPostState_merge/kway_merge/n=2000_k=30
time: [10.747 ms 10.859 ms 10.977 ms]
Found 2 outliers among 100 measurements (2.00%)
2 (2.00%) high mild
Benchmarking HashedPostState_merge/extend_ref_old/n=5000_k=3
Benchmarking HashedPostState_merge/extend_ref_old/n=5000_k=3: Warming up for 3.0000 s
Benchmarking HashedPostState_merge/extend_ref_old/n=5000_k=3: Collecting 100 samples in estimated 8.2944 s (10k iterations)
Benchmarking HashedPostState_merge/extend_ref_old/n=5000_k=3: Analyzing
HashedPostState_merge/extend_ref_old/n=5000_k=3
time: [873.76 µs 890.20 µs 907.89 µs]
Found 5 outliers among 100 measurements (5.00%)
3 (3.00%) high mild
2 (2.00%) high severe
Benchmarking HashedPostState_merge/extend_ref_new/n=5000_k=3
Benchmarking HashedPostState_merge/extend_ref_new/n=5000_k=3: Warming up for 3.0000 s
Benchmarking HashedPostState_merge/extend_ref_new/n=5000_k=3: Collecting 100 samples in estimated 6.2169 s (10k iterations)
Benchmarking HashedPostState_merge/extend_ref_new/n=5000_k=3: Analyzing
HashedPostState_merge/extend_ref_new/n=5000_k=3
time: [611.80 µs 616.65 µs 621.93 µs]
Found 5 outliers among 100 measurements (5.00%)
4 (4.00%) high mild
1 (1.00%) high severe
Benchmarking HashedPostState_merge/kway_merge/n=5000_k=3
Benchmarking HashedPostState_merge/kway_merge/n=5000_k=3: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 7.2s, enable flat sampling, or reduce sample count to 50.
Benchmarking HashedPostState_merge/kway_merge/n=5000_k=3: Collecting 100 samples in estimated 7.1697 s (5050 iterations)
Benchmarking HashedPostState_merge/kway_merge/n=5000_k=3: Analyzing
HashedPostState_merge/kway_merge/n=5000_k=3
time: [1.4209 ms 1.4255 ms 1.4305 ms]
Found 5 outliers among 100 measurements (5.00%)
4 (4.00%) high mild
1 (1.00%) high severe
Benchmarking HashedPostState_merge/extend_ref_old/n=5000_k=5
Benchmarking HashedPostState_merge/extend_ref_old/n=5000_k=5: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 9.6s, enable flat sampling, or reduce sample count to 50.
Benchmarking HashedPostState_merge/extend_ref_old/n=5000_k=5: Collecting 100 samples in estimated 9.5637 s (5050 iterations)
Benchmarking HashedPostState_merge/extend_ref_old/n=5000_k=5: Analyzing
HashedPostState_merge/extend_ref_old/n=5000_k=5
time: [1.9244 ms 1.9544 ms 1.9894 ms]
Found 1 outliers among 100 measurements (1.00%)
1 (1.00%) high mild
Benchmarking HashedPostState_merge/extend_ref_new/n=5000_k=5
Benchmarking HashedPostState_merge/extend_ref_new/n=5000_k=5: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 8.5s, enable flat sampling, or reduce sample count to 50.
Benchmarking HashedPostState_merge/extend_ref_new/n=5000_k=5: Collecting 100 samples in estimated 8.5344 s (5050 iterations)
Benchmarking HashedPostState_merge/extend_ref_new/n=5000_k=5: Analyzing
HashedPostState_merge/extend_ref_new/n=5000_k=5
time: [1.5973 ms 1.6067 ms 1.6170 ms]
Found 8 outliers among 100 measurements (8.00%)
6 (6.00%) high mild
2 (2.00%) high severe
Benchmarking HashedPostState_merge/kway_merge/n=5000_k=5
Benchmarking HashedPostState_merge/kway_merge/n=5000_k=5: Warming up for 3.0000 s
Benchmarking HashedPostState_merge/kway_merge/n=5000_k=5: Collecting 100 samples in estimated 5.2489 s (1900 iterations)
Benchmarking HashedPostState_merge/kway_merge/n=5000_k=5: Analyzing
HashedPostState_merge/kway_merge/n=5000_k=5
time: [2.6954 ms 2.7185 ms 2.7432 ms]
Found 3 outliers among 100 measurements (3.00%)
3 (3.00%) high mild
Benchmarking HashedPostState_merge/extend_ref_old/n=5000_k=10
Benchmarking HashedPostState_merge/extend_ref_old/n=5000_k=10: Warming up for 3.0000 s
Benchmarking HashedPostState_merge/extend_ref_old/n=5000_k=10: Collecting 100 samples in estimated 5.0452 s (800 iterations)
Benchmarking HashedPostState_merge/extend_ref_old/n=5000_k=10: Analyzing
HashedPostState_merge/extend_ref_old/n=5000_k=10
time: [6.1396 ms 6.1744 ms 6.2108 ms]
Found 3 outliers among 100 measurements (3.00%)
3 (3.00%) high mild
Benchmarking HashedPostState_merge/extend_ref_new/n=5000_k=10
Benchmarking HashedPostState_merge/extend_ref_new/n=5000_k=10: Warming up for 3.0000 s
Benchmarking HashedPostState_merge/extend_ref_new/n=5000_k=10: Collecting 100 samples in estimated 5.4974 s (900 iterations)
Benchmarking HashedPostState_merge/extend_ref_new/n=5000_k=10: Analyzing
HashedPostState_merge/extend_ref_new/n=5000_k=10
time: [6.1588 ms 6.1811 ms 6.2039 ms]
Found 3 outliers among 100 measurements (3.00%)
3 (3.00%) high mild
Benchmarking HashedPostState_merge/kway_merge/n=5000_k=10
Benchmarking HashedPostState_merge/kway_merge/n=5000_k=10: Warming up for 3.0000 s
Benchmarking HashedPostState_merge/kway_merge/n=5000_k=10: Collecting 100 samples in estimated 5.0304 s (700 iterations)
Benchmarking HashedPostState_merge/kway_merge/n=5000_k=10: Analyzing
HashedPostState_merge/kway_merge/n=5000_k=10
time: [7.5267 ms 7.6166 ms 7.7104 ms]
Found 2 outliers among 100 measurements (2.00%)
2 (2.00%) high mild
Benchmarking HashedPostState_merge/extend_ref_old/n=5000_k=30
Benchmarking HashedPostState_merge/extend_ref_old/n=5000_k=30: Warming up for 3.0000 s
Benchmarking HashedPostState_merge/extend_ref_old/n=5000_k=30: Collecting 100 samples in estimated 5.2686 s (200 iterations)
Benchmarking HashedPostState_merge/extend_ref_old/n=5000_k=30: Analyzing
HashedPostState_merge/extend_ref_old/n=5000_k=30
time: [25.339 ms 25.882 ms 26.468 ms]
Found 14 outliers among 100 measurements (14.00%)
13 (13.00%) high mild
1 (1.00%) high severe
Benchmarking HashedPostState_merge/extend_ref_new/n=5000_k=30
Benchmarking HashedPostState_merge/extend_ref_new/n=5000_k=30: Warming up for 3.0000 s
Benchmarking HashedPostState_merge/extend_ref_new/n=5000_k=30: Collecting 100 samples in estimated 7.5370 s (200 iterations)
Benchmarking HashedPostState_merge/extend_ref_new/n=5000_k=30: Analyzing
HashedPostState_merge/extend_ref_new/n=5000_k=30
time: [37.942 ms 38.128 ms 38.317 ms]
Benchmarking HashedPostState_merge/kway_merge/n=5000_k=30
Benchmarking HashedPostState_merge/kway_merge/n=5000_k=30: Warming up for 3.0000 s
Benchmarking HashedPostState_merge/kway_merge/n=5000_k=30: Collecting 100 samples in estimated 6.8713 s (200 iterations)
Benchmarking HashedPostState_merge/kway_merge/n=5000_k=30: Analyzing
HashedPostState_merge/kway_merge/n=5000_k=30
time: [34.767 ms 34.906 ms 35.049 ms]
Found 2 outliers among 100 measurements (2.00%)
2 (2.00%) high mild
Benchmarking HashedPostState_merge/extend_ref_old/n=10000_k=3
Benchmarking HashedPostState_merge/extend_ref_old/n=10000_k=3: Warming up for 3.0000 s
Benchmarking HashedPostState_merge/extend_ref_old/n=10000_k=3: Collecting 100 samples in estimated 5.0950 s (1500 iterations)
Benchmarking HashedPostState_merge/extend_ref_old/n=10000_k=3: Analyzing
HashedPostState_merge/extend_ref_old/n=10000_k=3
time: [3.2031 ms 3.2335 ms 3.2657 ms]
Found 7 outliers among 100 measurements (7.00%)
6 (6.00%) high mild
1 (1.00%) high severe
Benchmarking HashedPostState_merge/extend_ref_new/n=10000_k=3
Benchmarking HashedPostState_merge/extend_ref_new/n=10000_k=3: Warming up for 3.0000 s
Benchmarking HashedPostState_merge/extend_ref_new/n=10000_k=3: Collecting 100 samples in estimated 5.0998 s (2400 iterations)
Benchmarking HashedPostState_merge/extend_ref_new/n=10000_k=3: Analyzing
HashedPostState_merge/extend_ref_new/n=10000_k=3
time: [2.0248 ms 2.0448 ms 2.0653 ms]
Found 2 outliers among 100 measurements (2.00%)
2 (2.00%) high mild
Benchmarking HashedPostState_merge/kway_merge/n=10000_k=3
Benchmarking HashedPostState_merge/kway_merge/n=10000_k=3: Warming up for 3.0000 s
Benchmarking HashedPostState_merge/kway_merge/n=10000_k=3: Collecting 100 samples in estimated 5.2529 s (1600 iterations)
Benchmarking HashedPostState_merge/kway_merge/n=10000_k=3: Analyzing
HashedPostState_merge/kway_merge/n=10000_k=3
time: [3.2985 ms 3.3227 ms 3.3478 ms]
Found 3 outliers among 100 measurements (3.00%)
3 (3.00%) high mild
Benchmarking HashedPostState_merge/extend_ref_old/n=10000_k=10
Benchmarking HashedPostState_merge/extend_ref_old/n=10000_k=10: Warming up for 3.0000 s
Benchmarking HashedPostState_merge/extend_ref_old/n=10000_k=10: Collecting 100 samples in estimated 5.7113 s (400 iterations)
Benchmarking HashedPostState_merge/extend_ref_old/n=10000_k=10: Analyzing
HashedPostState_merge/extend_ref_old/n=10000_k=10
time: [14.162 ms 14.199 ms 14.242 ms]
Found 2 outliers among 100 measurements (2.00%)
1 (1.00%) high mild
1 (1.00%) high severe
Benchmarking HashedPostState_merge/extend_ref_new/n=10000_k=10
Benchmarking HashedPostState_merge/extend_ref_new/n=10000_k=10: Warming up for 3.0000 s
Benchmarking HashedPostState_merge/extend_ref_new/n=10000_k=10: Collecting 100 samples in estimated 5.4692 s (400 iterations)
Benchmarking HashedPostState_merge/extend_ref_new/n=10000_k=10: Analyzing
HashedPostState_merge/extend_ref_new/n=10000_k=10
time: [13.541 ms 13.580 ms 13.621 ms]
Found 3 outliers among 100 measurements (3.00%)
2 (2.00%) high mild
1 (1.00%) high severe
Benchmarking HashedPostState_merge/kway_merge/n=10000_k=10
Benchmarking HashedPostState_merge/kway_merge/n=10000_k=10: Warming up for 3.0000 s
Benchmarking HashedPostState_merge/kway_merge/n=10000_k=10: Collecting 100 samples in estimated 5.9961 s (300 iterations)
Benchmarking HashedPostState_merge/kway_merge/n=10000_k=10: Analyzing
HashedPostState_merge/kway_merge/n=10000_k=10
time: [20.105 ms 20.198 ms 20.294 ms]
Found 2 outliers among 100 measurements (2.00%)
1 (1.00%) low mild
1 (1.00%) high severe
Benchmarking HashedPostState_merge/extend_ref_old/n=10000_k=30
Benchmarking HashedPostState_merge/extend_ref_old/n=10000_k=30: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 7.1s, or reduce sample count to 70.
Benchmarking HashedPostState_merge/extend_ref_old/n=10000_k=30: Collecting 100 samples in estimated 7.1309 s (100 iterations)
Benchmarking HashedPostState_merge/extend_ref_old/n=10000_k=30: Analyzing
HashedPostState_merge/extend_ref_old/n=10000_k=30
time: [71.468 ms 72.243 ms 73.070 ms]
Found 5 outliers among 100 measurements (5.00%)
5 (5.00%) high mild
Benchmarking HashedPostState_merge/extend_ref_new/n=10000_k=30
Benchmarking HashedPostState_merge/extend_ref_new/n=10000_k=30: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 10.0s, or reduce sample count to 40.
Benchmarking HashedPostState_merge/extend_ref_new/n=10000_k=30: Collecting 100 samples in estimated 10.034 s (100 iterations)
Benchmarking HashedPostState_merge/extend_ref_new/n=10000_k=30: Analyzing
HashedPostState_merge/extend_ref_new/n=10000_k=30
time: [101.02 ms 101.34 ms 101.68 ms]
Found 2 outliers among 100 measurements (2.00%)
2 (2.00%) high mild
Benchmarking HashedPostState_merge/kway_merge/n=10000_k=30
Benchmarking HashedPostState_merge/kway_merge/n=10000_k=30: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 9.3s, or reduce sample count to 50.
Benchmarking HashedPostState_merge/kway_merge/n=10000_k=30: Collecting 100 samples in estimated 9.2704 s (100 iterations)
Benchmarking HashedPostState_merge/kway_merge/n=10000_k=30: Analyzing
HashedPostState_merge/kway_merge/n=10000_k=30
time: [91.669 ms 91.897 ms 92.127 ms]
Benchmarking HashedPostState_merge/extend_ref_old/n=15000_k=3
Benchmarking HashedPostState_merge/extend_ref_old/n=15000_k=3: Warming up for 3.0000 s
Benchmarking HashedPostState_merge/extend_ref_old/n=15000_k=3: Collecting 100 samples in estimated 5.2290 s (1000 iterations)
Benchmarking HashedPostState_merge/extend_ref_old/n=15000_k=3: Analyzing
HashedPostState_merge/extend_ref_old/n=15000_k=3
time: [5.4111 ms 5.4661 ms 5.5218 ms]
Benchmarking HashedPostState_merge/extend_ref_new/n=15000_k=3
Benchmarking HashedPostState_merge/extend_ref_new/n=15000_k=3: Warming up for 3.0000 s
Benchmarking HashedPostState_merge/extend_ref_new/n=15000_k=3: Collecting 100 samples in estimated 5.1383 s (1300 iterations)
Benchmarking HashedPostState_merge/extend_ref_new/n=15000_k=3: Analyzing
HashedPostState_merge/extend_ref_new/n=15000_k=3
time: [4.0118 ms 4.0281 ms 4.0449 ms]
Found 4 outliers among 100 measurements (4.00%)
4 (4.00%) high mild
Benchmarking HashedPostState_merge/kway_merge/n=15000_k=3
Benchmarking HashedPostState_merge/kway_merge/n=15000_k=3: Warming up for 3.0000 s
Benchmarking HashedPostState_merge/kway_merge/n=15000_k=3: Collecting 100 samples in estimated 5.5192 s (900 iterations)
Benchmarking HashedPostState_merge/kway_merge/n=15000_k=3: Analyzing
HashedPostState_merge/kway_merge/n=15000_k=3
time: [6.5558 ms 6.6646 ms 6.7772 ms]
Found 1 outliers among 100 measurements (1.00%)
1 (1.00%) high mild
Benchmarking HashedPostState_merge/extend_ref_old/n=15000_k=10
Benchmarking HashedPostState_merge/extend_ref_old/n=15000_k=10: Warming up for 3.0000 s
Benchmarking HashedPostState_merge/extend_ref_old/n=15000_k=10: Collecting 100 samples in estimated 7.3221 s (300 iterations)
Benchmarking HashedPostState_merge/extend_ref_old/n=15000_k=10: Analyzing
HashedPostState_merge/extend_ref_old/n=15000_k=10
time: [23.937 ms 23.996 ms 24.059 ms]
Found 3 outliers among 100 measurements (3.00%)
2 (2.00%) high mild
1 (1.00%) high severe
Benchmarking HashedPostState_merge/extend_ref_new/n=15000_k=10
Benchmarking HashedPostState_merge/extend_ref_new/n=15000_k=10: Warming up for 3.0000 s
Benchmarking HashedPostState_merge/extend_ref_new/n=15000_k=10: Collecting 100 samples in estimated 6.7487 s (300 iterations)
Benchmarking HashedPostState_merge/extend_ref_new/n=15000_k=10: Analyzing
HashedPostState_merge/extend_ref_new/n=15000_k=10
time: [22.361 ms 22.428 ms 22.506 ms]
Found 4 outliers among 100 measurements (4.00%)
2 (2.00%) high mild
2 (2.00%) high severe
Benchmarking HashedPostState_merge/kway_merge/n=15000_k=10
Benchmarking HashedPostState_merge/kway_merge/n=15000_k=10: Warming up for 3.0000 s
Benchmarking HashedPostState_merge/kway_merge/n=15000_k=10: Collecting 100 samples in estimated 6.2657 s (200 iterations)
Benchmarking HashedPostState_merge/kway_merge/n=15000_k=10: Analyzing
HashedPostState_merge/kway_merge/n=15000_k=10
time: [31.708 ms 31.882 ms 32.066 ms]
Found 3 outliers among 100 measurements (3.00%)
3 (3.00%) high mild
Benchmarking HashedPostState_merge/extend_ref_old/n=15000_k=30
Benchmarking HashedPostState_merge/extend_ref_old/n=15000_k=30: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 9.8s, or reduce sample count to 50.
Benchmarking HashedPostState_merge/extend_ref_old/n=15000_k=30: Collecting 100 samples in estimated 9.8417 s (100 iterations)
Benchmarking HashedPostState_merge/extend_ref_old/n=15000_k=30: Analyzing
HashedPostState_merge/extend_ref_old/n=15000_k=30
time: [99.627 ms 100.20 ms 100.88 ms]
Found 3 outliers among 100 measurements (3.00%)
3 (3.00%) high severe
Benchmarking HashedPostState_merge/extend_ref_new/n=15000_k=30
Benchmarking HashedPostState_merge/extend_ref_new/n=15000_k=30: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 15.8s, or reduce sample count to 30.
Benchmarking HashedPostState_merge/extend_ref_new/n=15000_k=30: Collecting 100 samples in estimated 15.821 s (100 iterations)
Benchmarking HashedPostState_merge/extend_ref_new/n=15000_k=30: Analyzing
HashedPostState_merge/extend_ref_new/n=15000_k=30
time: [158.90 ms 159.39 ms 159.89 ms]
Benchmarking HashedPostState_merge/kway_merge/n=15000_k=30
Benchmarking HashedPostState_merge/kway_merge/n=15000_k=30: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 15.5s, or reduce sample count to 30.
Benchmarking HashedPostState_merge/kway_merge/n=15000_k=30: Collecting 100 samples in estimated 15.453 s (100 iterations)
Benchmarking HashedPostState_merge/kway_merge/n=15000_k=30: Analyzing
HashedPostState_merge/kway_merge/n=15000_k=30
time: [151.97 ms 153.42 ms 155.00 ms]
Found 13 outliers among 100 measurements (13.00%)
13 (13.00%) high severe
Benchmarking TrieUpdates_merge/extend_ref_old/n=50_k=3
Benchmarking TrieUpdates_merge/extend_ref_old/n=50_k=3: Warming up for 3.0000 s
Benchmarking TrieUpdates_merge/extend_ref_old/n=50_k=3: Collecting 100 samples in estimated 5.0159 s (904k iterations)
Benchmarking TrieUpdates_merge/extend_ref_old/n=50_k=3: Analyzing
TrieUpdates_merge/extend_ref_old/n=50_k=3
time: [5.5316 µs 5.5394 µs 5.5497 µs]
Found 10 outliers among 100 measurements (10.00%)
2 (2.00%) low severe
4 (4.00%) low mild
1 (1.00%) high mild
3 (3.00%) high severe
Benchmarking TrieUpdates_merge/extend_ref_new/n=50_k=3
Benchmarking TrieUpdates_merge/extend_ref_new/n=50_k=3: Warming up for 3.0000 s
Benchmarking TrieUpdates_merge/extend_ref_new/n=50_k=3: Collecting 100 samples in estimated 5.0259 s (894k iterations)
Benchmarking TrieUpdates_merge/extend_ref_new/n=50_k=3: Analyzing
TrieUpdates_merge/extend_ref_new/n=50_k=3
time: [5.5925 µs 5.6003 µs 5.6097 µs]
Found 27 outliers among 100 measurements (27.00%)
6 (6.00%) low severe
8 (8.00%) low mild
5 (5.00%) high mild
8 (8.00%) high severe
Benchmarking TrieUpdates_merge/kway_merge/n=50_k=3
Benchmarking TrieUpdates_merge/kway_merge/n=50_k=3: Warming up for 3.0000 s
Benchmarking TrieUpdates_merge/kway_merge/n=50_k=3: Collecting 100 samples in estimated 5.0310 s (545k iterations)
Benchmarking TrieUpdates_merge/kway_merge/n=50_k=3: Analyzing
TrieUpdates_merge/kway_merge/n=50_k=3
time: [9.0846 µs 9.0962 µs 9.1139 µs]
Found 3 outliers among 100 measurements (3.00%)
2 (2.00%) high mild
1 (1.00%) high severe
Benchmarking TrieUpdates_merge/extend_ref_old/n=50_k=5
Benchmarking TrieUpdates_merge/extend_ref_old/n=50_k=5: Warming up for 3.0000 s
Benchmarking TrieUpdates_merge/extend_ref_old/n=50_k=5: Collecting 100 samples in estimated 5.0181 s (485k iterations)
Benchmarking TrieUpdates_merge/extend_ref_old/n=50_k=5: Analyzing
TrieUpdates_merge/extend_ref_old/n=50_k=5
time: [10.354 µs 10.381 µs 10.415 µs]
Found 6 outliers among 100 measurements (6.00%)
2 (2.00%) high mild
4 (4.00%) high severe
Benchmarking TrieUpdates_merge/extend_ref_new/n=50_k=5
Benchmarking TrieUpdates_merge/extend_ref_new/n=50_k=5: Warming up for 3.0000 s
Benchmarking TrieUpdates_merge/extend_ref_new/n=50_k=5: Collecting 100 samples in estimated 5.0017 s (424k iterations)
Benchmarking TrieUpdates_merge/extend_ref_new/n=50_k=5: Analyzing
TrieUpdates_merge/extend_ref_new/n=50_k=5
time: [11.702 µs 11.717 µs 11.737 µs]
Found 4 outliers among 100 measurements (4.00%)
2 (2.00%) high mild
2 (2.00%) high severe
Benchmarking TrieUpdates_merge/kway_merge/n=50_k=5
Benchmarking TrieUpdates_merge/kway_merge/n=50_k=5: Warming up for 3.0000 s
Benchmarking TrieUpdates_merge/kway_merge/n=50_k=5: Collecting 100 samples in estimated 5.0595 s (313k iterations)
Benchmarking TrieUpdates_merge/kway_merge/n=50_k=5: Analyzing
TrieUpdates_merge/kway_merge/n=50_k=5
time: [16.050 µs 16.070 µs 16.097 µs]
Found 6 outliers among 100 measurements (6.00%)
2 (2.00%) high mild
4 (4.00%) high severe
Benchmarking TrieUpdates_merge/extend_ref_old/n=50_k=10
Benchmarking TrieUpdates_merge/extend_ref_old/n=50_k=10: Warming up for 3.0000 s
Benchmarking TrieUpdates_merge/extend_ref_old/n=50_k=10: Collecting 100 samples in estimated 5.0020 s (237k iterations)
Benchmarking TrieUpdates_merge/extend_ref_old/n=50_k=10: Analyzing
TrieUpdates_merge/extend_ref_old/n=50_k=10
time: [21.203 µs 21.248 µs 21.300 µs]
Found 5 outliers among 100 measurements (5.00%)
3 (3.00%) high mild
2 (2.00%) high severe
Benchmarking TrieUpdates_merge/extend_ref_new/n=50_k=10
Benchmarking TrieUpdates_merge/extend_ref_new/n=50_k=10: Warming up for 3.0000 s
Benchmarking TrieUpdates_merge/extend_ref_new/n=50_k=10: Collecting 100 samples in estimated 5.1632 s (152k iterations)
Benchmarking TrieUpdates_merge/extend_ref_new/n=50_k=10: Analyzing
TrieUpdates_merge/extend_ref_new/n=50_k=10
time: [34.113 µs 34.157 µs 34.205 µs]
Found 10 outliers among 100 measurements (10.00%)
6 (6.00%) high mild
4 (4.00%) high severe
Benchmarking TrieUpdates_merge/kway_merge/n=50_k=10
Benchmarking TrieUpdates_merge/kway_merge/n=50_k=10: Warming up for 3.0000 s
Benchmarking TrieUpdates_merge/kway_merge/n=50_k=10: Collecting 100 samples in estimated 5.0663 s (146k iterations)
Benchmarking TrieUpdates_merge/kway_merge/n=50_k=10: Analyzing
TrieUpdates_merge/kway_merge/n=50_k=10
time: [34.353 µs 34.434 µs 34.523 µs]
Found 15 outliers among 100 measurements (15.00%)
12 (12.00%) high mild
3 (3.00%) high severe
Benchmarking TrieUpdates_merge/extend_ref_old/n=50_k=30
Benchmarking TrieUpdates_merge/extend_ref_old/n=50_k=30: Warming up for 3.0000 s
Benchmarking TrieUpdates_merge/extend_ref_old/n=50_k=30: Collecting 100 samples in estimated 5.1230 s (81k iterations)
Benchmarking TrieUpdates_merge/extend_ref_old/n=50_k=30: Analyzing
TrieUpdates_merge/extend_ref_old/n=50_k=30
time: [62.908 µs 63.085 µs 63.303 µs]
Found 8 outliers among 100 measurements (8.00%)
2 (2.00%) high mild
6 (6.00%) high severe
Benchmarking TrieUpdates_merge/extend_ref_new/n=50_k=30
Benchmarking TrieUpdates_merge/extend_ref_new/n=50_k=30: Warming up for 3.0000 s
Benchmarking TrieUpdates_merge/extend_ref_new/n=50_k=30: Collecting 100 samples in estimated 5.3602 s (25k iterations)
Benchmarking TrieUpdates_merge/extend_ref_new/n=50_k=30: Analyzing
TrieUpdates_merge/extend_ref_new/n=50_k=30
time: [211.61 µs 212.21 µs 212.99 µs]
Found 6 outliers among 100 measurements (6.00%)
4 (4.00%) high mild
2 (2.00%) high severe
Benchmarking TrieUpdates_merge/kway_merge/n=50_k=30
Benchmarking TrieUpdates_merge/kway_merge/n=50_k=30: Warming up for 3.0000 s
Benchmarking TrieUpdates_merge/kway_merge/n=50_k=30: Collecting 100 samples in estimated 5.4824 s (45k iterations)
Benchmarking TrieUpdates_merge/kway_merge/n=50_k=30: Analyzing
TrieUpdates_merge/kway_merge/n=50_k=30
time: [117.81 µs 118.06 µs 118.33 µs]
Found 5 outliers among 100 measurements (5.00%)
5 (5.00%) high mild
Benchmarking TrieUpdates_merge/extend_ref_old/n=100_k=3
Benchmarking TrieUpdates_merge/extend_ref_old/n=100_k=3: Warming up for 3.0000 s
Benchmarking TrieUpdates_merge/extend_ref_old/n=100_k=3: Collecting 100 samples in estimated 5.0505 s (470k iterations)
Benchmarking TrieUpdates_merge/extend_ref_old/n=100_k=3: Analyzing
TrieUpdates_merge/extend_ref_old/n=100_k=3
time: [10.751 µs 10.756 µs 10.761 µs]
Found 15 outliers among 100 measurements (15.00%)
4 (4.00%) high mild
11 (11.00%) high severe
Benchmarking TrieUpdates_merge/extend_ref_new/n=100_k=3
Benchmarking TrieUpdates_merge/extend_ref_new/n=100_k=3: Warming up for 3.0000 s
Benchmarking TrieUpdates_merge/extend_ref_new/n=100_k=3: Collecting 100 samples in estimated 5.0196 s (495k iterations)
Benchmarking TrieUpdates_merge/extend_ref_new/n=100_k=3: Analyzing
TrieUpdates_merge/extend_ref_new/n=100_k=3
time: [10.067 µs 10.077 µs 10.087 µs]
Found 4 outliers among 100 measurements (4.00%)
2 (2.00%) high mild
2 (2.00%) high severe
Benchmarking TrieUpdates_merge/kway_merge/n=100_k=3
Benchmarking TrieUpdates_merge/kway_merge/n=100_k=3: Warming up for 3.0000 s
Benchmarking TrieUpdates_merge/kway_merge/n=100_k=3: Collecting 100 samples in estimated 5.0273 s (273k iterations)
Benchmarking TrieUpdates_merge/kway_merge/n=100_k=3: Analyzing
TrieUpdates_merge/kway_merge/n=100_k=3
time: [17.760 µs 17.812 µs 17.876 µs]
Found 11 outliers among 100 measurements (11.00%)
3 (3.00%) high mild
8 (8.00%) high severe
Benchmarking TrieUpdates_merge/extend_ref_old/n=100_k=5
Benchmarking TrieUpdates_merge/extend_ref_old/n=100_k=5: Warming up for 3.0000 s
Benchmarking TrieUpdates_merge/extend_ref_old/n=100_k=5: Collecting 100 samples in estimated 5.0838 s (258k iterations)
Benchmarking TrieUpdates_merge/extend_ref_old/n=100_k=5: Analyzing
TrieUpdates_merge/extend_ref_old/n=100_k=5
time: [19.995 µs 20.039 µs 20.097 µs]
Found 9 outliers among 100 measurements (9.00%)
4 (4.00%) high mild
5 (5.00%) high severe
Benchmarking TrieUpdates_merge/extend_ref_new/n=100_k=5
Benchmarking TrieUpdates_merge/extend_ref_new/n=100_k=5: Warming up for 3.0000 s
Benchmarking TrieUpdates_merge/extend_ref_new/n=100_k=5: Collecting 100 samples in estimated 5.0367 s (237k iterations)
Benchmarking TrieUpdates_merge/extend_ref_new/n=100_k=5: Analyzing
TrieUpdates_merge/extend_ref_new/n=100_k=5
time: [21.121 µs 21.155 µs 21.193 µs]
Found 4 outliers among 100 measurements (4.00%)
3 (3.00%) high mild
1 (1.00%) high severe
Benchmarking TrieUpdates_merge/kway_merge/n=100_k=5
Benchmarking TrieUpdates_merge/kway_merge/n=100_k=5: Warming up for 3.0000 s
Benchmarking TrieUpdates_merge/kway_merge/n=100_k=5: Collecting 100 samples in estimated 5.1247 s (162k iterations)
Benchmarking TrieUpdates_merge/kway_merge/n=100_k=5: Analyzing
TrieUpdates_merge/kway_merge/n=100_k=5
time: [31.069 µs 31.199 µs 31.343 µs]
Found 11 outliers among 100 measurements (11.00%)
2 (2.00%) high mild
9 (9.00%) high severe
Benchmarking TrieUpdates_merge/extend_ref_old/n=100_k=10
Benchmarking TrieUpdates_merge/extend_ref_old/n=100_k=10: Warming up for 3.0000 s
Benchmarking TrieUpdates_merge/extend_ref_old/n=100_k=10: Collecting 100 samples in estimated 5.0358 s (116k iterations)
Benchmarking TrieUpdates_merge/extend_ref_old/n=100_k=10: Analyzing
TrieUpdates_merge/extend_ref_old/n=100_k=10
time: [43.279 µs 43.371 µs 43.481 µs]
Found 9 outliers among 100 measurements (9.00%)
3 (3.00%) high mild
6 (6.00%) high severe
Benchmarking TrieUpdates_merge/extend_ref_new/n=100_k=10
Benchmarking TrieUpdates_merge/extend_ref_new/n=100_k=10: Warming up for 3.0000 s
Benchmarking TrieUpdates_merge/extend_ref_new/n=100_k=10: Collecting 100 samples in estimated 5.3087 s (86k iterations)
Benchmarking TrieUpdates_merge/extend_ref_new/n=100_k=10: Analyzing
TrieUpdates_merge/extend_ref_new/n=100_k=10
time: [61.429 µs 61.579 µs 61.740 µs]
Found 7 outliers among 100 measurements (7.00%)
2 (2.00%) high mild
5 (5.00%) high severe
Benchmarking TrieUpdates_merge/kway_merge/n=100_k=10
Benchmarking TrieUpdates_merge/kway_merge/n=100_k=10: Warming up for 3.0000 s
Benchmarking TrieUpdates_merge/kway_merge/n=100_k=10: Collecting 100 samples in estimated 5.2045 s (76k iterations)
Benchmarking TrieUpdates_merge/kway_merge/n=100_k=10: Analyzing
TrieUpdates_merge/kway_merge/n=100_k=10
time: [68.250 µs 68.404 µs 68.589 µs]
Found 4 outliers among 100 measurements (4.00%)
2 (2.00%) high mild
2 (2.00%) high severe
Benchmarking TrieUpdates_merge/extend_ref_old/n=100_k=30
Benchmarking TrieUpdates_merge/extend_ref_old/n=100_k=30: Warming up for 3.0000 s
Benchmarking TrieUpdates_merge/extend_ref_old/n=100_k=30: Collecting 100 samples in estimated 5.1869 s (40k iterations)
Benchmarking TrieUpdates_merge/extend_ref_old/n=100_k=30: Analyzing
TrieUpdates_merge/extend_ref_old/n=100_k=30
time: [127.72 µs 128.00 µs 128.28 µs]
Found 5 outliers among 100 measurements (5.00%)
4 (4.00%) high mild
1 (1.00%) high severe
Benchmarking TrieUpdates_merge/extend_ref_new/n=100_k=30
Benchmarking TrieUpdates_merge/extend_ref_new/n=100_k=30: Warming up for 3.0000 s
Benchmarking TrieUpdates_merge/extend_ref_new/n=100_k=30: Collecting 100 samples in estimated 6.5108 s (15k iterations)
Benchmarking TrieUpdates_merge/extend_ref_new/n=100_k=30: Analyzing
TrieUpdates_merge/extend_ref_new/n=100_k=30
time: [424.27 µs 425.03 µs 425.85 µs]
Found 8 outliers among 100 measurements (8.00%)
5 (5.00%) high mild
3 (3.00%) high severe
Benchmarking TrieUpdates_merge/kway_merge/n=100_k=30
Benchmarking TrieUpdates_merge/kway_merge/n=100_k=30: Warming up for 3.0000 s
Benchmarking TrieUpdates_merge/kway_merge/n=100_k=30: Collecting 100 samples in estimated 6.1791 s (25k iterations)
Benchmarking TrieUpdates_merge/kway_merge/n=100_k=30: Analyzing
TrieUpdates_merge/kway_merge/n=100_k=30
time: [239.10 µs 239.63 µs 240.16 µs]
Found 8 outliers among 100 measurements (8.00%)
5 (5.00%) high mild
3 (3.00%) high severe
Benchmarking TrieUpdates_merge/extend_ref_old/n=200_k=3
Benchmarking TrieUpdates_merge/extend_ref_old/n=200_k=3: Warming up for 3.0000 s
Benchmarking TrieUpdates_merge/extend_ref_old/n=200_k=3: Collecting 100 samples in estimated 5.0972 s (237k iterations)
Benchmarking TrieUpdates_merge/extend_ref_old/n=200_k=3: Analyzing
TrieUpdates_merge/extend_ref_old/n=200_k=3
time: [21.502 µs 21.530 µs 21.558 µs]
Found 3 outliers among 100 measurements (3.00%)
3 (3.00%) high mild
Benchmarking TrieUpdates_merge/extend_ref_new/n=200_k=3
Benchmarking TrieUpdates_merge/extend_ref_new/n=200_k=3: Warming up for 3.0000 s
Benchmarking TrieUpdates_merge/extend_ref_new/n=200_k=3: Collecting 100 samples in estimated 5.0300 s (247k iterations)
Benchmarking TrieUpdates_merge/extend_ref_new/n=200_k=3: Analyzing
TrieUpdates_merge/extend_ref_new/n=200_k=3
time: [20.308 µs 20.345 µs 20.390 µs]
Found 3 outliers among 100 measurements (3.00%)
1 (1.00%) high mild
2 (2.00%) high severe
Benchmarking TrieUpdates_merge/kway_merge/n=200_k=3
Benchmarking TrieUpdates_merge/kway_merge/n=200_k=3: Warming up for 3.0000 s
Benchmarking TrieUpdates_merge/kway_merge/n=200_k=3: Collecting 100 samples in estimated 5.0165 s (141k iterations)
Benchmarking TrieUpdates_merge/kway_merge/n=200_k=3: Analyzing
TrieUpdates_merge/kway_merge/n=200_k=3
time: [35.216 µs 35.294 µs 35.382 µs]
Found 7 outliers among 100 measurements (7.00%)
4 (4.00%) high mild
3 (3.00%) high severe
Benchmarking TrieUpdates_merge/extend_ref_old/n=200_k=5
Benchmarking TrieUpdates_merge/extend_ref_old/n=200_k=5: Warming up for 3.0000 s
Benchmarking TrieUpdates_merge/extend_ref_old/n=200_k=5: Collecting 100 samples in estimated 5.1374 s (126k iterations)
Benchmarking TrieUpdates_merge/extend_ref_old/n=200_k=5: Analyzing
TrieUpdates_merge/extend_ref_old/n=200_k=5
time: [40.662 µs 40.741 µs 40.833 µs]
Found 7 outliers among 100 measurements (7.00%)
5 (5.00%) high mild
2 (2.00%) high severe
Benchmarking TrieUpdates_merge/extend_ref_new/n=200_k=5
Benchmarking TrieUpdates_merge/extend_ref_new/n=200_k=5: Warming up for 3.0000 s
Benchmarking TrieUpdates_merge/extend_ref_new/n=200_k=5: Collecting 100 samples in estimated 5.2060 s (121k iterations)
Benchmarking TrieUpdates_merge/extend_ref_new/n=200_k=5: Analyzing
TrieUpdates_merge/extend_ref_new/n=200_k=5
time: [42.432 µs 42.537 µs 42.650 µs]
Found 4 outliers among 100 measurements (4.00%)
2 (2.00%) high mild
2 (2.00%) high severe
Benchmarking TrieUpdates_merge/kway_merge/n=200_k=5
Benchmarking TrieUpdates_merge/kway_merge/n=200_k=5: Warming up for 3.0000 s
Benchmarking TrieUpdates_merge/kway_merge/n=200_k=5: Collecting 100 samples in estimated 5.0902 s (81k iterations)
Benchmarking TrieUpdates_merge/kway_merge/n=200_k=5: Analyzing
TrieUpdates_merge/kway_merge/n=200_k=5
time: [62.480 µs 62.617 µs 62.771 µs]
Found 7 outliers among 100 measurements (7.00%)
1 (1.00%) high mild
6 (6.00%) high severe
Benchmarking TrieUpdates_merge/extend_ref_old/n=200_k=10
Benchmarking TrieUpdates_merge/extend_ref_old/n=200_k=10: Warming up for 3.0000 s
Benchmarking TrieUpdates_merge/extend_ref_old/n=200_k=10: Collecting 100 samples in estimated 5.0490 s (56k iterations)
Benchmarking TrieUpdates_merge/extend_ref_old/n=200_k=10: Analyzing
TrieUpdates_merge/extend_ref_old/n=200_k=10
time: [90.504 µs 90.688 µs 90.882 µs]
Found 9 outliers among 100 measurements (9.00%)
8 (8.00%) high mild
1 (1.00%) high severe
Benchmarking TrieUpdates_merge/extend_ref_new/n=200_k=10
Benchmarking TrieUpdates_merge/extend_ref_new/n=200_k=10: Warming up for 3.0000 s
Benchmarking TrieUpdates_merge/extend_ref_new/n=200_k=10: Collecting 100 samples in estimated 5.1938 s (40k iterations)
Benchmarking TrieUpdates_merge/extend_ref_new/n=200_k=10: Analyzing
TrieUpdates_merge/extend_ref_new/n=200_k=10
time: [129.07 µs 129.24 µs 129.41 µs]
Found 7 outliers among 100 measurements (7.00%)
1 (1.00%) low mild
6 (6.00%) high mild
Benchmarking TrieUpdates_merge/kway_merge/n=200_k=10
Benchmarking TrieUpdates_merge/kway_merge/n=200_k=10: Warming up for 3.0000 s
Benchmarking TrieUpdates_merge/kway_merge/n=200_k=10: Collecting 100 samples in estimated 5.6594 s (40k iterations)
Benchmarking TrieUpdates_merge/kway_merge/n=200_k=10: Analyzing
TrieUpdates_merge/kway_merge/n=200_k=10
time: [140.24 µs 140.66 µs 141.11 µs]
Found 5 outliers among 100 measurements (5.00%)
4 (4.00%) high mild
1 (1.00%) high severe
Benchmarking TrieUpdates_merge/extend_ref_old/n=200_k=30
Benchmarking TrieUpdates_merge/extend_ref_old/n=200_k=30: Warming up for 3.0000 s
Benchmarking TrieUpdates_merge/extend_ref_old/n=200_k=30: Collecting 100 samples in estimated 5.4633 s (20k iterations)
Benchmarking TrieUpdates_merge/extend_ref_old/n=200_k=30: Analyzing
TrieUpdates_merge/extend_ref_old/n=200_k=30
time: [270.88 µs 272.03 µs 273.33 µs]
Found 7 outliers among 100 measurements (7.00%)
2 (2.00%) high mild
5 (5.00%) high severe
Benchmarking TrieUpdates_merge/extend_ref_new/n=200_k=30
Benchmarking TrieUpdates_merge/extend_ref_new/n=200_k=30: Warming up for 3.0000 s
Benchmarking TrieUpdates_merge/extend_ref_new/n=200_k=30: Collecting 100 samples in estimated 8.9099 s (10k iterations)
Benchmarking TrieUpdates_merge/extend_ref_new/n=200_k=30: Analyzing
TrieUpdates_merge/extend_ref_new/n=200_k=30
time: [885.04 µs 887.09 µs 889.12 µs]
Found 8 outliers among 100 measurements (8.00%)
3 (3.00%) high mild
5 (5.00%) high severe
Benchmarking TrieUpdates_merge/kway_merge/n=200_k=30
Benchmarking TrieUpdates_merge/kway_merge/n=200_k=30: Warming up for 3.0000 s
Benchmarking TrieUpdates_merge/kway_merge/n=200_k=30: Collecting 100 samples in estimated 5.3598 s (10k iterations)
Benchmarking TrieUpdates_merge/kway_merge/n=200_k=30: Analyzing
TrieUpdates_merge/kway_merge/n=200_k=30
time: [518.43 µs 520.97 µs 523.55 µs]
Found 15 outliers among 100 measurements (15.00%)
3 (3.00%) low mild
4 (4.00%) high mild
8 (8.00%) high severe
Benchmarking TrieUpdates_merge/extend_ref_old/n=500_k=3
Benchmarking TrieUpdates_merge/extend_ref_old/n=500_k=3: Warming up for 3.0000 s
Benchmarking TrieUpdates_merge/extend_ref_old/n=500_k=3: Collecting 100 samples in estimated 5.2188 s (101k iterations)
Benchmarking TrieUpdates_merge/extend_ref_old/n=500_k=3: Analyzing
TrieUpdates_merge/extend_ref_old/n=500_k=3
time: [51.857 µs 52.013 µs 52.170 µs]
Found 4 outliers among 100 measurements (4.00%)
3 (3.00%) high mild
1 (1.00%) high severe
Benchmarking TrieUpdates_merge/extend_ref_new/n=500_k=3
Benchmarking TrieUpdates_merge/extend_ref_new/n=500_k=3: Warming up for 3.0000 s
Benchmarking TrieUpdates_merge/extend_ref_new/n=500_k=3: Collecting 100 samples in estimated 5.0903 s (96k iterations)
Benchmarking TrieUpdates_merge/extend_ref_new/n=500_k=3: Analyzing
TrieUpdates_merge/extend_ref_new/n=500_k=3
time: [52.652 µs 52.718 µs 52.791 µs]
Found 5 outliers among 100 measurements (5.00%)
2 (2.00%) high mild
3 (3.00%) high severe
Benchmarking TrieUpdates_merge/kway_merge/n=500_k=3
Benchmarking TrieUpdates_merge/kway_merge/n=500_k=3: Warming up for 3.0000 s
Benchmarking TrieUpdates_merge/kway_merge/n=500_k=3: Collecting 100 samples in estimated 5.2121 s (61k iterations)
Benchmarking TrieUpdates_merge/kway_merge/n=500_k=3: Analyzing
TrieUpdates_merge/kway_merge/n=500_k=3
time: [85.717 µs 85.843 µs 85.991 µs]
Found 3 outliers among 100 measurements (3.00%)
2 (2.00%) high mild
1 (1.00%) high severe
Benchmarking TrieUpdates_merge/extend_ref_old/n=500_k=5
Benchmarking TrieUpdates_merge/extend_ref_old/n=500_k=5: Warming up for 3.0000 s
Benchmarking TrieUpdates_merge/extend_ref_old/n=500_k=5: Collecting 100 samples in estimated 5.2187 s (50k iterations)
Benchmarking TrieUpdates_merge/extend_ref_old/n=500_k=5: Analyzing
TrieUpdates_merge/extend_ref_old/n=500_k=5
time: [103.80 µs 104.25 µs 104.73 µs]
Found 9 outliers among 100 measurements (9.00%)
7 (7.00%) high mild
2 (2.00%) high severe
Benchmarking TrieUpdates_merge/extend_ref_new/n=500_k=5
Benchmarking TrieUpdates_merge/extend_ref_new/n=500_k=5: Warming up for 3.0000 s
Benchmarking TrieUpdates_merge/extend_ref_new/n=500_k=5: Collecting 100 samples in estimated 5.2357 s (45k iterations)
Benchmarking TrieUpdates_merge/extend_ref_new/n=500_k=5: Analyzing
TrieUpdates_merge/extend_ref_new/n=500_k=5
time: [114.29 µs 114.56 µs 114.86 µs]
Found 7 outliers among 100 measurements (7.00%)
6 (6.00%) high mild
1 (1.00%) high severe
Benchmarking TrieUpdates_merge/kway_merge/n=500_k=5
Benchmarking TrieUpdates_merge/kway_merge/n=500_k=5: Warming up for 3.0000 s
Benchmarking TrieUpdates_merge/kway_merge/n=500_k=5: Collecting 100 samples in estimated 5.6272 s (35k iterations)
Benchmarking TrieUpdates_merge/kway_merge/n=500_k=5: Analyzing
TrieUpdates_merge/kway_merge/n=500_k=5
time: [156.71 µs 157.43 µs 158.22 µs]
Found 9 outliers among 100 measurements (9.00%)
6 (6.00%) high mild
3 (3.00%) high severe
Benchmarking TrieUpdates_merge/extend_ref_old/n=500_k=10
Benchmarking TrieUpdates_merge/extend_ref_old/n=500_k=10: Warming up for 3.0000 s
Benchmarking TrieUpdates_merge/extend_ref_old/n=500_k=10: Collecting 100 samples in estimated 5.7714 s (25k iterations)
Benchmarking TrieUpdates_merge/extend_ref_old/n=500_k=10: Analyzing
TrieUpdates_merge/extend_ref_old/n=500_k=10
time: [230.39 µs 231.36 µs 232.39 µs]
Found 7 outliers among 100 measurements (7.00%)
5 (5.00%) high mild
2 (2.00%) high severe
Benchmarking TrieUpdates_merge/extend_ref_new/n=500_k=10
Benchmarking TrieUpdates_merge/extend_ref_new/n=500_k=10: Warming up for 3.0000 s
Benchmarking TrieUpdates_merge/extend_ref_new/n=500_k=10: Collecting 100 samples in estimated 5.0401 s (15k iterations)
Benchmarking TrieUpdates_merge/extend_ref_new/n=500_k=10: Analyzing
TrieUpdates_merge/extend_ref_new/n=500_k=10
time: [329.09 µs 329.81 µs 330.57 µs]
Found 7 outliers among 100 measurements (7.00%)
7 (7.00%) high mild
Benchmarking TrieUpdates_merge/kway_merge/n=500_k=10
Benchmarking TrieUpdates_merge/kway_merge/n=500_k=10: Warming up for 3.0000 s
Benchmarking TrieUpdates_merge/kway_merge/n=500_k=10: Collecting 100 samples in estimated 5.3329 s (15k iterations)
Benchmarking TrieUpdates_merge/kway_merge/n=500_k=10: Analyzing
TrieUpdates_merge/kway_merge/n=500_k=10
time: [344.70 µs 345.93 µs 347.40 µs]
Found 4 outliers among 100 measurements (4.00%)
3 (3.00%) high mild
1 (1.00%) high severe
Benchmarking TrieUpdates_merge/extend_ref_old/n=500_k=30
Benchmarking TrieUpdates_merge/extend_ref_old/n=500_k=30: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 5.1s, enable flat sampling, or reduce sample count to 60.
Benchmarking TrieUpdates_merge/extend_ref_old/n=500_k=30: Collecting 100 samples in estimated 5.1148 s (5050 iterations)
Benchmarking TrieUpdates_merge/extend_ref_old/n=500_k=30: Analyzing
TrieUpdates_merge/extend_ref_old/n=500_k=30
time: [1.0203 ms 1.0402 ms 1.0607 ms]
Found 9 outliers among 100 measurements (9.00%)
5 (5.00%) high mild
4 (4.00%) high severe
Benchmarking TrieUpdates_merge/extend_ref_new/n=500_k=30
Benchmarking TrieUpdates_merge/extend_ref_new/n=500_k=30: Warming up for 3.0000 s
Benchmarking TrieUpdates_merge/extend_ref_new/n=500_k=30: Collecting 100 samples in estimated 5.1694 s (2300 iterations)
Benchmarking TrieUpdates_merge/extend_ref_new/n=500_k=30: Analyzing
TrieUpdates_merge/extend_ref_new/n=500_k=30
time: [2.2640 ms 2.2728 ms 2.2820 ms]
Found 3 outliers among 100 measurements (3.00%)
3 (3.00%) high mild
Benchmarking TrieUpdates_merge/kway_merge/n=500_k=30
Benchmarking TrieUpdates_merge/kway_merge/n=500_k=30: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 7.2s, enable flat sampling, or reduce sample count to 50.
Benchmarking TrieUpdates_merge/kway_merge/n=500_k=30: Collecting 100 samples in estimated 7.1699 s (5050 iterations)
Benchmarking TrieUpdates_merge/kway_merge/n=500_k=30: Analyzing
TrieUpdates_merge/kway_merge/n=500_k=30
time: [1.3835 ms 1.3898 ms 1.3968 ms]
Found 12 outliers among 100 measurements (12.00%)
6 (6.00%) high mild
6 (6.00%) high severe
Benchmarking TrieUpdates_merge/extend_ref_old/n=1000_k=3
Benchmarking TrieUpdates_merge/extend_ref_old/n=1000_k=3: Warming up for 3.0000 s
Benchmarking TrieUpdates_merge/extend_ref_old/n=1000_k=3: Collecting 100 samples in estimated 5.4862 s (50k iterations)
Benchmarking TrieUpdates_merge/extend_ref_old/n=1000_k=3: Analyzing
TrieUpdates_merge/extend_ref_old/n=1000_k=3
time: [107.35 µs 107.54 µs 107.74 µs]
Found 9 outliers among 100 measurements (9.00%)
5 (5.00%) high mild
4 (4.00%) high severe
Benchmarking TrieUpdates_merge/extend_ref_new/n=1000_k=3
Benchmarking TrieUpdates_merge/extend_ref_new/n=1000_k=3: Warming up for 3.0000 s
Benchmarking TrieUpdates_merge/extend_ref_new/n=1000_k=3: Collecting 100 samples in estimated 5.0406 s (45k iterations)
Benchmarking TrieUpdates_merge/extend_ref_new/n=1000_k=3: Analyzing
TrieUpdates_merge/extend_ref_new/n=1000_k=3
time: [109.85 µs 110.12 µs 110.42 µs]
Found 6 outliers among 100 measurements (6.00%)
6 (6.00%) high mild
Benchmarking TrieUpdates_merge/kway_merge/n=1000_k=3
Benchmarking TrieUpdates_merge/kway_merge/n=1000_k=3: Warming up for 3.0000 s
Benchmarking TrieUpdates_merge/kway_merge/n=1000_k=3: Collecting 100 samples in estimated 5.5026 s (30k iterations)
Benchmarking TrieUpdates_merge/kway_merge/n=1000_k=3: Analyzing
TrieUpdates_merge/kway_merge/n=1000_k=3
time: [178.36 µs 178.60 µs 178.84 µs]
Found 8 outliers among 100 measurements (8.00%)
3 (3.00%) high mild
5 (5.00%) high severe
Benchmarking TrieUpdates_merge/extend_ref_old/n=1000_k=5
Benchmarking TrieUpdates_merge/extend_ref_old/n=1000_k=5: Warming up for 3.0000 s
Benchmarking TrieUpdates_merge/extend_ref_old/n=1000_k=5: Collecting 100 samples in estimated 5.4727 s (25k iterations)
Benchmarking TrieUpdates_merge/extend_ref_old/n=1000_k=5: Analyzing
TrieUpdates_merge/extend_ref_old/n=1000_k=5
time: [216.63 µs 218.19 µs 219.89 µs]
Found 9 outliers among 100 measurements (9.00%)
3 (3.00%) high mild
6 (6.00%) high severe
Benchmarking TrieUpdates_merge/extend_ref_new/n=1000_k=5
Benchmarking TrieUpdates_merge/extend_ref_new/n=1000_k=5: Warming up for 3.0000 s
Benchmarking TrieUpdates_merge/extend_ref_new/n=1000_k=5: Collecting 100 samples in estimated 5.8725 s (25k iterations)
Benchmarking TrieUpdates_merge/extend_ref_new/n=1000_k=5: Analyzing
TrieUpdates_merge/extend_ref_new/n=1000_k=5
time: [298.60 µs 307.34 µs 315.16 µs]
Benchmarking TrieUpdates_merge/kway_merge/n=1000_k=5
Benchmarking TrieUpdates_merge/kway_merge/n=1000_k=5: Warming up for 3.0000 s
Benchmarking TrieUpdates_merge/kway_merge/n=1000_k=5: Collecting 100 samples in estimated 7.0104 s (15k iterations)
Benchmarking TrieUpdates_merge/kway_merge/n=1000_k=5: Analyzing
TrieUpdates_merge/kway_merge/n=1000_k=5
time: [358.96 µs 368.57 µs 380.63 µs]
Benchmarking TrieUpdates_merge/extend_ref_old/n=1000_k=10
Benchmarking TrieUpdates_merge/extend_ref_old/n=1000_k=10: Warming up for 3.0000 s
Benchmarking TrieUpdates_merge/extend_ref_old/n=1000_k=10: Collecting 100 samples in estimated 5.6735 s (10k iterations)
Benchmarking TrieUpdates_merge/extend_ref_old/n=1000_k=10: Analyzing
TrieUpdates_merge/extend_ref_old/n=1000_k=10
time: [494.29 µs 503.50 µs 515.29 µs]
Found 9 outliers among 100 measurements (9.00%)
8 (8.00%) high mild
1 (1.00%) high severe
Benchmarking TrieUpdates_merge/extend_ref_new/n=1000_k=10
Benchmarking TrieUpdates_merge/extend_ref_new/n=1000_k=10: Warming up for 3.0000 s
Benchmarking TrieUpdates_merge/extend_ref_new/n=1000_k=10: Collecting 100 samples in estimated 7.0481 s (10k iterations)
Benchmarking TrieUpdates_merge/extend_ref_new/n=1000_k=10: Analyzing
TrieUpdates_merge/extend_ref_new/n=1000_k=10
time: [691.16 µs 692.83 µs 694.91 µs]
Found 6 outliers among 100 measurements (6.00%)
3 (3.00%) high mild
3 (3.00%) high severe
Benchmarking TrieUpdates_merge/kway_merge/n=1000_k=10
Benchmarking TrieUpdates_merge/kway_merge/n=1000_k=10: Warming up for 3.0000 s
Benchmarking TrieUpdates_merge/kway_merge/n=1000_k=10: Collecting 100 samples in estimated 9.4194 s (10k iterations)
Benchmarking TrieUpdates_merge/kway_merge/n=1000_k=10: Analyzing
TrieUpdates_merge/kway_merge/n=1000_k=10
time: [775.99 µs 779.87 µs 784.21 µs]
Found 9 outliers among 100 measurements (9.00%)
6 (6.00%) high mild
3 (3.00%) high severe
Benchmarking TrieUpdates_merge/extend_ref_old/n=1000_k=30
Benchmarking TrieUpdates_merge/extend_ref_old/n=1000_k=30: Warming up for 3.0000 s
Benchmarking TrieUpdates_merge/extend_ref_old/n=1000_k=30: Collecting 100 samples in estimated 5.1606 s (800 iterations)
Benchmarking TrieUpdates_merge/extend_ref_old/n=1000_k=30: Analyzing
TrieUpdates_merge/extend_ref_old/n=1000_k=30
time: [6.5609 ms 6.6362 ms 6.7193 ms]
Found 6 outliers among 100 measurements (6.00%)
3 (3.00%) high mild
3 (3.00%) high severe
Benchmarking TrieUpdates_merge/extend_ref_new/n=1000_k=30
Benchmarking TrieUpdates_merge/extend_ref_new/n=1000_k=30: Warming up for 3.0000 s
Benchmarking TrieUpdates_merge/extend_ref_new/n=1000_k=30: Collecting 100 samples in estimated 5.0919 s (800 iterations)
Benchmarking TrieUpdates_merge/extend_ref_new/n=1000_k=30: Analyzing
TrieUpdates_merge/extend_ref_new/n=1000_k=30
time: [6.3409 ms 6.4030 ms 6.4724 ms]
Found 4 outliers among 100 measurements (4.00%)
3 (3.00%) high mild
1 (1.00%) high severe
Benchmarking TrieUpdates_merge/kway_merge/n=1000_k=30
Benchmarking TrieUpdates_merge/kway_merge/n=1000_k=30: Warming up for 3.0000 s
Benchmarking TrieUpdates_merge/kway_merge/n=1000_k=30: Collecting 100 samples in estimated 5.2520 s (800 iterations)
Benchmarking TrieUpdates_merge/kway_merge/n=1000_k=30: Analyzing
TrieUpdates_merge/kway_merge/n=1000_k=30
time: [5.2946 ms 5.4819 ms 5.6764 ms]
Found 5 outliers among 100 measurements (5.00%)
5 (5.00%) high mild
Benchmarking TrieUpdates_merge/extend_ref_old/n=2000_k=3
Benchmarking TrieUpdates_merge/extend_ref_old/n=2000_k=3: Warming up for 3.0000 s
Benchmarking TrieUpdates_merge/extend_ref_old/n=2000_k=3: Collecting 100 samples in estimated 5.8309 s (15k iterations)
Benchmarking TrieUpdates_merge/extend_ref_old/n=2000_k=3: Analyzing
TrieUpdates_merge/extend_ref_old/n=2000_k=3
time: [270.87 µs 280.93 µs 293.28 µs]
Found 1 outliers among 100 measurements (1.00%)
1 (1.00%) high mild
Benchmarking TrieUpdates_merge/extend_ref_new/n=2000_k=3
Benchmarking TrieUpdates_merge/extend_ref_new/n=2000_k=3: Warming up for 3.0000 s
Benchmarking TrieUpdates_merge/extend_ref_new/n=2000_k=3: Collecting 100 samples in estimated 5.3971 s (20k iterations)
Benchmarking TrieUpdates_merge/extend_ref_new/n=2000_k=3: Analyzing
TrieUpdates_merge/extend_ref_new/n=2000_k=3
time: [290.01 µs 297.15 µs 306.97 µs]
Found 10 outliers among 100 measurements (10.00%)
3 (3.00%) high mild
7 (7.00%) high severe
Benchmarking TrieUpdates_merge/kway_merge/n=2000_k=3
Benchmarking TrieUpdates_merge/kway_merge/n=2000_k=3: Warming up for 3.0000 s
Benchmarking TrieUpdates_merge/kway_merge/n=2000_k=3: Collecting 100 samples in estimated 5.2599 s (10k iterations)
Benchmarking TrieUpdates_merge/kway_merge/n=2000_k=3: Analyzing
TrieUpdates_merge/kway_merge/n=2000_k=3
time: [482.50 µs 495.41 µs 512.43 µs]
Found 14 outliers among 100 measurements (14.00%)
6 (6.00%) high mild
8 (8.00%) high severe
Benchmarking TrieUpdates_merge/extend_ref_old/n=2000_k=5
Benchmarking TrieUpdates_merge/extend_ref_old/n=2000_k=5: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 5.7s, enable flat sampling, or reduce sample count to 60.
Benchmarking TrieUpdates_merge/extend_ref_old/n=2000_k=5: Collecting 100 samples in estimated 5.6519 s (5050 iterations)
Benchmarking TrieUpdates_merge/extend_ref_old/n=2000_k=5: Analyzing
TrieUpdates_merge/extend_ref_old/n=2000_k=5
time: [1.1586 ms 1.2185 ms 1.2921 ms]
Found 17 outliers among 100 measurements (17.00%)
1 (1.00%) low mild
5 (5.00%) high mild
11 (11.00%) high severe
Benchmarking TrieUpdates_merge/extend_ref_new/n=2000_k=5
Benchmarking TrieUpdates_merge/extend_ref_new/n=2000_k=5: Warming up for 3.0000 s
Benchmarking TrieUpdates_merge/extend_ref_new/n=2000_k=5: Collecting 100 samples in estimated 7.7358 s (10k iterations)
Benchmarking TrieUpdates_merge/extend_ref_new/n=2000_k=5: Analyzing
TrieUpdates_merge/extend_ref_new/n=2000_k=5
time: [736.70 µs 774.74 µs 821.85 µs]
Found 14 outliers among 100 measurements (14.00%)
2 (2.00%) low mild
4 (4.00%) high mild
8 (8.00%) high severe
Benchmarking TrieUpdates_merge/kway_merge/n=2000_k=5
Benchmarking TrieUpdates_merge/kway_merge/n=2000_k=5: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 5.5s, enable flat sampling, or reduce sample count to 60.
Benchmarking TrieUpdates_merge/kway_merge/n=2000_k=5: Collecting 100 samples in estimated 5.4830 s (5050 iterations)
Benchmarking TrieUpdates_merge/kway_merge/n=2000_k=5: Analyzing
TrieUpdates_merge/kway_merge/n=2000_k=5
time: [1.0500 ms 1.0673 ms 1.0861 ms]
Found 3 outliers among 100 measurements (3.00%)
2 (2.00%) high mild
1 (1.00%) high severe
Benchmarking TrieUpdates_merge/extend_ref_old/n=2000_k=10
Benchmarking TrieUpdates_merge/extend_ref_old/n=2000_k=10: Warming up for 3.0000 s
Benchmarking TrieUpdates_merge/extend_ref_old/n=2000_k=10: Collecting 100 samples in estimated 5.2413 s (1400 iterations)
Benchmarking TrieUpdates_merge/extend_ref_old/n=2000_k=10: Analyzing
TrieUpdates_merge/extend_ref_old/n=2000_k=10
time: [3.6542 ms 3.7151 ms 3.7828 ms]
Found 6 outliers among 100 measurements (6.00%)
1 (1.00%) low mild
1 (1.00%) high mild
4 (4.00%) high severe
Benchmarking TrieUpdates_merge/extend_ref_new/n=2000_k=10
Benchmarking TrieUpdates_merge/extend_ref_new/n=2000_k=10: Warming up for 3.0000 s
Benchmarking TrieUpdates_merge/extend_ref_new/n=2000_k=10: Collecting 100 samples in estimated 5.1361 s (1900 iterations)
Benchmarking TrieUpdates_merge/extend_ref_new/n=2000_k=10: Analyzing
TrieUpdates_merge/extend_ref_new/n=2000_k=10
time: [2.6506 ms 2.7167 ms 2.7881 ms]
Found 15 outliers among 100 measurements (15.00%)
1 (1.00%) low mild
5 (5.00%) high mild
9 (9.00%) high severe
Benchmarking TrieUpdates_merge/kway_merge/n=2000_k=10
Benchmarking TrieUpdates_merge/kway_merge/n=2000_k=10: Warming up for 3.0000 s
Benchmarking TrieUpdates_merge/kway_merge/n=2000_k=10: Collecting 100 samples in estimated 5.1874 s (1300 iterations)
Benchmarking TrieUpdates_merge/kway_merge/n=2000_k=10: Analyzing
TrieUpdates_merge/kway_merge/n=2000_k=10
time: [2.9686 ms 3.1143 ms 3.2595 ms]
Benchmarking TrieUpdates_merge/extend_ref_old/n=2000_k=30
Benchmarking TrieUpdates_merge/extend_ref_old/n=2000_k=30: Warming up for 3.0000 s
Benchmarking TrieUpdates_merge/extend_ref_old/n=2000_k=30: Collecting 100 samples in estimated 5.6571 s (500 iterations)
Benchmarking TrieUpdates_merge/extend_ref_old/n=2000_k=30: Analyzing
TrieUpdates_merge/extend_ref_old/n=2000_k=30
time: [10.812 ms 10.848 ms 10.887 ms]
Found 4 outliers among 100 measurements (4.00%)
4 (4.00%) high mild
Benchmarking TrieUpdates_merge/extend_ref_new/n=2000_k=30
Benchmarking TrieUpdates_merge/extend_ref_new/n=2000_k=30: Warming up for 3.0000 s
Benchmarking TrieUpdates_merge/extend_ref_new/n=2000_k=30: Collecting 100 samples in estimated 5.5939 s (500 iterations)
Benchmarking TrieUpdates_merge/extend_ref_new/n=2000_k=30: Analyzing
TrieUpdates_merge/extend_ref_new/n=2000_k=30
time: [11.165 ms 11.204 ms 11.247 ms]
Found 4 outliers among 100 measurements (4.00%)
1 (1.00%) high mild
3 (3.00%) high severe
Benchmarking TrieUpdates_merge/kway_merge/n=2000_k=30
Benchmarking TrieUpdates_merge/kway_merge/n=2000_k=30: Warming up for 3.0000 s
Benchmarking TrieUpdates_merge/kway_merge/n=2000_k=30: Collecting 100 samples in estimated 6.0422 s (500 iterations)
Benchmarking TrieUpdates_merge/kway_merge/n=2000_k=30: Analyzing
TrieUpdates_merge/kway_merge/n=2000_k=30
time: [11.352 ms 11.458 ms 11.566 ms]
Found 1 outliers among 100 measurements (1.00%)
1 (1.00%) high mild
Benchmarking TrieUpdates_merge/extend_ref_old/n=5000_k=3
Benchmarking TrieUpdates_merge/extend_ref_old/n=5000_k=3: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 5.0s, enable flat sampling, or reduce sample count to 70.
Benchmarking TrieUpdates_merge/extend_ref_old/n=5000_k=3: Collecting 100 samples in estimated 5.0335 s (5050 iterations)
Benchmarking TrieUpdates_merge/extend_ref_old/n=5000_k=3: Analyzing
TrieUpdates_merge/extend_ref_old/n=5000_k=3
time: [941.35 µs 963.25 µs 988.40 µs]
Found 9 outliers among 100 measurements (9.00%)
9 (9.00%) high severe
Benchmarking TrieUpdates_merge/extend_ref_new/n=5000_k=3
Benchmarking TrieUpdates_merge/extend_ref_new/n=5000_k=3: Warming up for 3.0000 s
Benchmarking TrieUpdates_merge/extend_ref_new/n=5000_k=3: Collecting 100 samples in estimated 5.9457 s (10k iterations)
Benchmarking TrieUpdates_merge/extend_ref_new/n=5000_k=3: Analyzing
TrieUpdates_merge/extend_ref_new/n=5000_k=3
time: [576.24 µs 581.36 µs 586.40 µs]
Found 2 outliers among 100 measurements (2.00%)
2 (2.00%) high mild
Benchmarking TrieUpdates_merge/kway_merge/n=5000_k=3
Benchmarking TrieUpdates_merge/kway_merge/n=5000_k=3: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 5.0s, enable flat sampling, or reduce sample count to 70.
Benchmarking TrieUpdates_merge/kway_merge/n=5000_k=3: Collecting 100 samples in estimated 5.0025 s (5050 iterations)
Benchmarking TrieUpdates_merge/kway_merge/n=5000_k=3: Analyzing
TrieUpdates_merge/kway_merge/n=5000_k=3
time: [1.0062 ms 1.0160 ms 1.0271 ms]
Found 6 outliers among 100 measurements (6.00%)
5 (5.00%) high mild
1 (1.00%) high severe
Benchmarking TrieUpdates_merge/extend_ref_old/n=5000_k=5
Benchmarking TrieUpdates_merge/extend_ref_old/n=5000_k=5: Warming up for 3.0000 s
Benchmarking TrieUpdates_merge/extend_ref_old/n=5000_k=5: Collecting 100 samples in estimated 5.1111 s (2000 iterations)
Benchmarking TrieUpdates_merge/extend_ref_old/n=5000_k=5: Analyzing
TrieUpdates_merge/extend_ref_old/n=5000_k=5
time: [2.5874 ms 2.6281 ms 2.6703 ms]
Found 2 outliers among 100 measurements (2.00%)
1 (1.00%) high mild
1 (1.00%) high severe
Benchmarking TrieUpdates_merge/extend_ref_new/n=5000_k=5
Benchmarking TrieUpdates_merge/extend_ref_new/n=5000_k=5: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 8.4s, enable flat sampling, or reduce sample count to 50.
Benchmarking TrieUpdates_merge/extend_ref_new/n=5000_k=5: Collecting 100 samples in estimated 8.4188 s (5050 iterations)
Benchmarking TrieUpdates_merge/extend_ref_new/n=5000_k=5: Analyzing
TrieUpdates_merge/extend_ref_new/n=5000_k=5
time: [1.5237 ms 1.5430 ms 1.5627 ms]
Found 8 outliers among 100 measurements (8.00%)
5 (5.00%) high mild
3 (3.00%) high severe
Benchmarking TrieUpdates_merge/kway_merge/n=5000_k=5
Benchmarking TrieUpdates_merge/kway_merge/n=5000_k=5: Warming up for 3.0000 s
Benchmarking TrieUpdates_merge/kway_merge/n=5000_k=5: Collecting 100 samples in estimated 5.1664 s (2200 iterations)
Benchmarking TrieUpdates_merge/kway_merge/n=5000_k=5: Analyzing
TrieUpdates_merge/kway_merge/n=5000_k=5
time: [2.7498 ms 2.8895 ms 3.0347 ms]
Benchmarking TrieUpdates_merge/extend_ref_old/n=5000_k=10
Benchmarking TrieUpdates_merge/extend_ref_old/n=5000_k=10: Warming up for 3.0000 s
Benchmarking TrieUpdates_merge/extend_ref_old/n=5000_k=10: Collecting 100 samples in estimated 5.5135 s (700 iterations)
Benchmarking TrieUpdates_merge/extend_ref_old/n=5000_k=10: Analyzing
TrieUpdates_merge/extend_ref_old/n=5000_k=10
time: [7.6907 ms 7.7442 ms 7.7964 ms]
Found 1 outliers among 100 measurements (1.00%)
1 (1.00%) low mild
Benchmarking TrieUpdates_merge/extend_ref_new/n=5000_k=10
Benchmarking TrieUpdates_merge/extend_ref_new/n=5000_k=10: Warming up for 3.0000 s
Benchmarking TrieUpdates_merge/extend_ref_new/n=5000_k=10: Collecting 100 samples in estimated 5.4655 s (1000 iterations)
Benchmarking TrieUpdates_merge/extend_ref_new/n=5000_k=10: Analyzing
TrieUpdates_merge/extend_ref_new/n=5000_k=10
time: [5.5399 ms 5.5591 ms 5.5792 ms]
Found 3 outliers among 100 measurements (3.00%)
1 (1.00%) low mild
1 (1.00%) high mild
1 (1.00%) high severe
Benchmarking TrieUpdates_merge/kway_merge/n=5000_k=10
Benchmarking TrieUpdates_merge/kway_merge/n=5000_k=10: Warming up for 3.0000 s
Benchmarking TrieUpdates_merge/kway_merge/n=5000_k=10: Collecting 100 samples in estimated 5.2332 s (700 iterations)
Benchmarking TrieUpdates_merge/kway_merge/n=5000_k=10: Analyzing
TrieUpdates_merge/kway_merge/n=5000_k=10
time: [6.8803 ms 6.9723 ms 7.0684 ms]
Found 3 outliers among 100 measurements (3.00%)
3 (3.00%) high mild
Benchmarking TrieUpdates_merge/extend_ref_old/n=5000_k=30
Benchmarking TrieUpdates_merge/extend_ref_old/n=5000_k=30: Warming up for 3.0000 s
Benchmarking TrieUpdates_merge/extend_ref_old/n=5000_k=30: Collecting 100 samples in estimated 5.7495 s (200 iterations)
Benchmarking TrieUpdates_merge/extend_ref_old/n=5000_k=30: Analyzing
TrieUpdates_merge/extend_ref_old/n=5000_k=30
time: [28.415 ms 28.463 ms 28.516 ms]
Found 4 outliers among 100 measurements (4.00%)
1 (1.00%) low mild
1 (1.00%) high mild
2 (2.00%) high severe
Benchmarking TrieUpdates_merge/extend_ref_new/n=5000_k=30
Benchmarking TrieUpdates_merge/extend_ref_new/n=5000_k=30: Warming up for 3.0000 s
Benchmarking TrieUpdates_merge/extend_ref_new/n=5000_k=30: Collecting 100 samples in estimated 6.2089 s (200 iterations)
Benchmarking TrieUpdates_merge/extend_ref_new/n=5000_k=30: Analyzing
TrieUpdates_merge/extend_ref_new/n=5000_k=30
time: [30.929 ms 31.046 ms 31.172 ms]
Found 3 outliers among 100 measurements (3.00%)
3 (3.00%) high mild
Benchmarking TrieUpdates_merge/kway_merge/n=5000_k=30
Benchmarking TrieUpdates_merge/kway_merge/n=5000_k=30: Warming up for 3.0000 s
Benchmarking TrieUpdates_merge/kway_merge/n=5000_k=30: Collecting 100 samples in estimated 6.6824 s (200 iterations)
Benchmarking TrieUpdates_merge/kway_merge/n=5000_k=30: Analyzing
TrieUpdates_merge/kway_merge/n=5000_k=30
time: [33.755 ms 33.868 ms 33.987 ms]
Found 7 outliers among 100 measurements (7.00%)
1 (1.00%) low mild
5 (5.00%) high mild
1 (1.00%) high severe
Benchmarking TrieUpdates_merge/extend_ref_old/n=10000_k=3
Benchmarking TrieUpdates_merge/extend_ref_old/n=10000_k=3: Warming up for 3.0000 s
Benchmarking TrieUpdates_merge/extend_ref_old/n=10000_k=3: Collecting 100 samples in estimated 5.2906 s (1400 iterations)
Benchmarking TrieUpdates_merge/extend_ref_old/n=10000_k=3: Analyzing
TrieUpdates_merge/extend_ref_old/n=10000_k=3
time: [3.7648 ms 3.8037 ms 3.8432 ms]
Found 1 outliers among 100 measurements (1.00%)
1 (1.00%) high mild
Benchmarking TrieUpdates_merge/extend_ref_new/n=10000_k=3
Benchmarking TrieUpdates_merge/extend_ref_new/n=10000_k=3: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 9.0s, enable flat sampling, or reduce sample count to 50.
Benchmarking TrieUpdates_merge/extend_ref_new/n=10000_k=3: Collecting 100 samples in estimated 8.9778 s (5050 iterations)
Benchmarking TrieUpdates_merge/extend_ref_new/n=10000_k=3: Analyzing
TrieUpdates_merge/extend_ref_new/n=10000_k=3
time: [1.8382 ms 1.8622 ms 1.8885 ms]
Found 4 outliers among 100 measurements (4.00%)
4 (4.00%) high mild
Benchmarking TrieUpdates_merge/kway_merge/n=10000_k=3
Benchmarking TrieUpdates_merge/kway_merge/n=10000_k=3: Warming up for 3.0000 s
Benchmarking TrieUpdates_merge/kway_merge/n=10000_k=3: Collecting 100 samples in estimated 5.2317 s (1900 iterations)
Benchmarking TrieUpdates_merge/kway_merge/n=10000_k=3: Analyzing
TrieUpdates_merge/kway_merge/n=10000_k=3
time: [2.6377 ms 2.6661 ms 2.6957 ms]
Found 5 outliers among 100 measurements (5.00%)
4 (4.00%) high mild
1 (1.00%) high severe
Benchmarking TrieUpdates_merge/extend_ref_old/n=10000_k=10
Benchmarking TrieUpdates_merge/extend_ref_old/n=10000_k=10: Warming up for 3.0000 s
Benchmarking TrieUpdates_merge/extend_ref_old/n=10000_k=10: Collecting 100 samples in estimated 5.1610 s (300 iterations)
Benchmarking TrieUpdates_merge/extend_ref_old/n=10000_k=10: Analyzing
TrieUpdates_merge/extend_ref_old/n=10000_k=10
time: [16.975 ms 17.017 ms 17.059 ms]
Found 2 outliers among 100 measurements (2.00%)
2 (2.00%) high mild
Benchmarking TrieUpdates_merge/extend_ref_new/n=10000_k=10
Benchmarking TrieUpdates_merge/extend_ref_new/n=10000_k=10: Warming up for 3.0000 s
Benchmarking TrieUpdates_merge/extend_ref_new/n=10000_k=10: Collecting 100 samples in estimated 5.1954 s (400 iterations)
Benchmarking TrieUpdates_merge/extend_ref_new/n=10000_k=10: Analyzing
TrieUpdates_merge/extend_ref_new/n=10000_k=10
time: [12.997 ms 13.045 ms 13.096 ms]
Found 4 outliers among 100 measurements (4.00%)
3 (3.00%) high mild
1 (1.00%) high severe
Benchmarking TrieUpdates_merge/kway_merge/n=10000_k=10
Benchmarking TrieUpdates_merge/kway_merge/n=10000_k=10: Warming up for 3.0000 s
Benchmarking TrieUpdates_merge/kway_merge/n=10000_k=10: Collecting 100 samples in estimated 5.6595 s (300 iterations)
Benchmarking TrieUpdates_merge/kway_merge/n=10000_k=10: Analyzing
TrieUpdates_merge/kway_merge/n=10000_k=10
time: [18.437 ms 18.532 ms 18.631 ms]
Found 3 outliers among 100 measurements (3.00%)
3 (3.00%) high mild
Benchmarking TrieUpdates_merge/extend_ref_old/n=10000_k=30
Benchmarking TrieUpdates_merge/extend_ref_old/n=10000_k=30: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 6.2s, or reduce sample count to 80.
Benchmarking TrieUpdates_merge/extend_ref_old/n=10000_k=30: Collecting 100 samples in estimated 6.1752 s (100 iterations)
Benchmarking TrieUpdates_merge/extend_ref_old/n=10000_k=30: Analyzing
TrieUpdates_merge/extend_ref_old/n=10000_k=30
time: [61.409 ms 61.576 ms 61.750 ms]
Found 4 outliers among 100 measurements (4.00%)
4 (4.00%) high mild
Benchmarking TrieUpdates_merge/extend_ref_new/n=10000_k=30
Benchmarking TrieUpdates_merge/extend_ref_new/n=10000_k=30: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 7.7s, or reduce sample count to 60.
Benchmarking TrieUpdates_merge/extend_ref_new/n=10000_k=30: Collecting 100 samples in estimated 7.7177 s (100 iterations)
Benchmarking TrieUpdates_merge/extend_ref_new/n=10000_k=30: Analyzing
TrieUpdates_merge/extend_ref_new/n=10000_k=30
time: [77.138 ms 77.594 ms 78.087 ms]
Found 12 outliers among 100 measurements (12.00%)
8 (8.00%) high mild
4 (4.00%) high severe
Benchmarking TrieUpdates_merge/kway_merge/n=10000_k=30
Benchmarking TrieUpdates_merge/kway_merge/n=10000_k=30: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 7.6s, or reduce sample count to 60.
Benchmarking TrieUpdates_merge/kway_merge/n=10000_k=30: Collecting 100 samples in estimated 7.6253 s (100 iterations)
Benchmarking TrieUpdates_merge/kway_merge/n=10000_k=30: Analyzing
TrieUpdates_merge/kway_merge/n=10000_k=30
time: [75.128 ms 75.491 ms 75.876 ms]
Found 3 outliers among 100 measurements (3.00%)
3 (3.00%) high mild
Benchmarking TrieUpdates_merge/extend_ref_old/n=15000_k=3
Benchmarking TrieUpdates_merge/extend_ref_old/n=15000_k=3: Warming up for 3.0000 s
Benchmarking TrieUpdates_merge/extend_ref_old/n=15000_k=3: Collecting 100 samples in estimated 5.5443 s (900 iterations)
Benchmarking TrieUpdates_merge/extend_ref_old/n=15000_k=3: Analyzing
TrieUpdates_merge/extend_ref_old/n=15000_k=3
time: [6.2832 ms 6.3608 ms 6.4369 ms]
Benchmarking TrieUpdates_merge/extend_ref_new/n=15000_k=3
Benchmarking TrieUpdates_merge/extend_ref_new/n=15000_k=3: Warming up for 3.0000 s
Benchmarking TrieUpdates_merge/extend_ref_new/n=15000_k=3: Collecting 100 samples in estimated 5.1977 s (1400 iterations)
Benchmarking TrieUpdates_merge/extend_ref_new/n=15000_k=3: Analyzing
TrieUpdates_merge/extend_ref_new/n=15000_k=3
time: [3.7176 ms 3.7398 ms 3.7628 ms]
Found 2 outliers among 100 measurements (2.00%)
1 (1.00%) high mild
1 (1.00%) high severe
Benchmarking TrieUpdates_merge/kway_merge/n=15000_k=3
Benchmarking TrieUpdates_merge/kway_merge/n=15000_k=3: Warming up for 3.0000 s
Benchmarking TrieUpdates_merge/kway_merge/n=15000_k=3: Collecting 100 samples in estimated 5.5586 s (900 iterations)
Benchmarking TrieUpdates_merge/kway_merge/n=15000_k=3: Analyzing
TrieUpdates_merge/kway_merge/n=15000_k=3
time: [4.8977 ms 4.9623 ms 5.0357 ms]
Found 7 outliers among 100 measurements (7.00%)
3 (3.00%) high mild
4 (4.00%) high severe
Benchmarking TrieUpdates_merge/extend_ref_old/n=15000_k=10
Benchmarking TrieUpdates_merge/extend_ref_old/n=15000_k=10: Warming up for 3.0000 s
Benchmarking TrieUpdates_merge/extend_ref_old/n=15000_k=10: Collecting 100 samples in estimated 5.7020 s (200 iterations)
Benchmarking TrieUpdates_merge/extend_ref_old/n=15000_k=10: Analyzing
TrieUpdates_merge/extend_ref_old/n=15000_k=10
time: [29.844 ms 29.989 ms 30.147 ms]
Found 5 outliers among 100 measurements (5.00%)
5 (5.00%) high mild
Benchmarking TrieUpdates_merge/extend_ref_new/n=15000_k=10
Benchmarking TrieUpdates_merge/extend_ref_new/n=15000_k=10: Warming up for 3.0000 s
Benchmarking TrieUpdates_merge/extend_ref_new/n=15000_k=10: Collecting 100 samples in estimated 6.3322 s (300 iterations)
Benchmarking TrieUpdates_merge/extend_ref_new/n=15000_k=10: Analyzing
TrieUpdates_merge/extend_ref_new/n=15000_k=10
time: [20.981 ms 21.137 ms 21.307 ms]
Found 15 outliers among 100 measurements (15.00%)
7 (7.00%) high mild
8 (8.00%) high severe
Benchmarking TrieUpdates_merge/kway_merge/n=15000_k=10
Benchmarking TrieUpdates_merge/kway_merge/n=15000_k=10: Warming up for 3.0000 s
Benchmarking TrieUpdates_merge/kway_merge/n=15000_k=10: Collecting 100 samples in estimated 5.9317 s (200 iterations)
Benchmarking TrieUpdates_merge/kway_merge/n=15000_k=10: Analyzing
TrieUpdates_merge/kway_merge/n=15000_k=10
time: [29.214 ms 29.308 ms 29.404 ms]
Found 2 outliers among 100 measurements (2.00%)
2 (2.00%) high mild
Benchmarking TrieUpdates_merge/extend_ref_old/n=15000_k=30
Benchmarking TrieUpdates_merge/extend_ref_old/n=15000_k=30: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 8.8s, or reduce sample count to 50.
Benchmarking TrieUpdates_merge/extend_ref_old/n=15000_k=30: Collecting 100 samples in estimated 8.8218 s (100 iterations)
Benchmarking TrieUpdates_merge/extend_ref_old/n=15000_k=30: Analyzing
TrieUpdates_merge/extend_ref_old/n=15000_k=30
time: [87.657 ms 87.763 ms 87.879 ms]
Found 2 outliers among 100 measurements (2.00%)
1 (1.00%) high mild
1 (1.00%) high severe
Benchmarking TrieUpdates_merge/extend_ref_new/n=15000_k=30
Benchmarking TrieUpdates_merge/extend_ref_new/n=15000_k=30: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 14.0s, or reduce sample count to 30.
Benchmarking TrieUpdates_merge/extend_ref_new/n=15000_k=30: Collecting 100 samples in estimated 13.965 s (100 iterations)
Benchmarking TrieUpdates_merge/extend_ref_new/n=15000_k=30: Analyzing
TrieUpdates_merge/extend_ref_new/n=15000_k=30
time: [138.63 ms 138.89 ms 139.18 ms]
Found 7 outliers among 100 measurements (7.00%)
4 (4.00%) high mild
3 (3.00%) high severe
Benchmarking TrieUpdates_merge/kway_merge/n=15000_k=30
Benchmarking TrieUpdates_merge/kway_merge/n=15000_k=30: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 12.8s, or reduce sample count to 30.
Benchmarking TrieUpdates_merge/kway_merge/n=15000_k=30: Collecting 100 samples in estimated 12.780 s (100 iterations)
Benchmarking TrieUpdates_merge/kway_merge/n=15000_k=30: Analyzing
TrieUpdates_merge/kway_merge/n=15000_k=30
time: [127.55 ms 128.22 ms 128.98 ms]
Found 9 outliers among 100 measurements (9.00%)
2 (2.00%) high mild
7 (7.00%) high severe
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment