yatp.bench.txt

     Running benches/chained_spawn.rs (target/release/deps/chained_spawn-c8dc8c936ec4fa3d)
Gnuplot not found, using plotters backend
chained_spawn/yatp::future/256
                        time:   [684.35 µs 684.77 µs 685.25 µs]
Found 4 outliers among 100 measurements (4.00%)
  3 (3.00%) high mild
  1 (1.00%) high severe
chained_spawn/yatp::callback/256
                        time:   [550.01 µs 551.86 µs 553.61 µs]
Benchmarking chained_spawn/yatp::future::multilevel/256: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 5.3s, enable flat sampling, or reduce sample count to 60.
chained_spawn/yatp::future::multilevel/256
                        time:   [1.0491 ms 1.0503 ms 1.0515 ms]
Found 6 outliers among 100 measurements (6.00%)
  4 (4.00%) low mild
  1 (1.00%) high mild
  1 (1.00%) high severe
Benchmarking chained_spawn/yatp::future::priority/256: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 5.8s, enable flat sampling, or reduce sample count to 60.
chained_spawn/yatp::future::priority/256
                        time:   [1.1425 ms 1.1445 ms 1.1465 ms]
Found 3 outliers among 100 measurements (3.00%)
  2 (2.00%) low mild
  1 (1.00%) high severe
chained_spawn/tokio/256 time:   [41.014 µs 42.294 µs 43.578 µs]
chained_spawn/async-std/256
                        time:   [42.964 µs 44.225 µs 45.504 µs]
Found 11 outliers among 100 measurements (11.00%)
  11 (11.00%) low mild
Benchmarking chained_spawn/yatp::future/512: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 6.9s, enable flat sampling, or reduce sample count to 50.
chained_spawn/yatp::future/512
                        time:   [1.3677 ms 1.3688 ms 1.3698 ms]
Found 4 outliers among 100 measurements (4.00%)
  4 (4.00%) high mild
Benchmarking chained_spawn/yatp::callback/512: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 5.4s, enable flat sampling, or reduce sample count to 60.
chained_spawn/yatp::callback/512
                        time:   [1.0645 ms 1.0673 ms 1.0700 ms]
Found 1 outliers among 100 measurements (1.00%)
  1 (1.00%) low mild
chained_spawn/yatp::future::multilevel/512
                        time:   [2.0678 ms 2.0696 ms 2.0713 ms]
chained_spawn/yatp::future::priority/512
                        time:   [2.2541 ms 2.2599 ms 2.2645 ms]
Found 3 outliers among 100 measurements (3.00%)
  1 (1.00%) low severe
  2 (2.00%) low mild
chained_spawn/tokio/512 time:   [72.480 µs 74.580 µs 76.637 µs]
chained_spawn/async-std/512
                        time:   [76.325 µs 78.239 µs 79.802 µs]
chained_spawn/yatp::future/1024
                        time:   [2.7218 ms 2.7236 ms 2.7253 ms]
chained_spawn/yatp::callback/1024
                        time:   [2.0650 ms 2.0682 ms 2.0714 ms]
Found 4 outliers among 100 measurements (4.00%)
  2 (2.00%) low mild
  2 (2.00%) high mild
chained_spawn/yatp::future::multilevel/1024
                        time:   [4.1023 ms 4.1051 ms 4.1079 ms]
chained_spawn/yatp::future::priority/1024
                        time:   [4.4817 ms 4.4885 ms 4.4950 ms]
Found 3 outliers among 100 measurements (3.00%)
  3 (3.00%) low mild
chained_spawn/tokio/1024
                        time:   [133.29 µs 137.18 µs 140.86 µs]
chained_spawn/async-std/1024
                        time:   [129.31 µs 134.64 µs 139.56 µs]

     Running benches/ping_pong.rs (target/release/deps/ping_pong-0db28a93d4622fed)
Gnuplot not found, using plotters backend
Benchmarking ping_pong/yatp::future/256: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 9.1s, enable flat sampling, or reduce sample count to 50.
ping_pong/yatp::future/256
                        time:   [1.8215 ms 1.8314 ms 1.8418 ms]
                        change: [+99.536% +101.65% +104.08%] (p = 0.00 < 0.05)
                        Performance has regressed.
Found 2 outliers among 100 measurements (2.00%)
  2 (2.00%) high mild
Benchmarking ping_pong/yatp::callback/256: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 8.5s, enable flat sampling, or reduce sample count to 50.
ping_pong/yatp::callback/256
                        time:   [1.6268 ms 1.6370 ms 1.6455 ms]
                        change: [+1045.2% +1072.4% +1100.4%] (p = 0.00 < 0.05)
                        Performance has regressed.
Found 8 outliers among 100 measurements (8.00%)
  3 (3.00%) low severe
  5 (5.00%) low mild
ping_pong/yatp::future::multilevel/256
                        time:   [2.0266 ms 2.0297 ms 2.0327 ms]
                        change: [+36.837% +37.555% +38.533%] (p = 0.00 < 0.05)
                        Performance has regressed.
Found 1 outliers among 100 measurements (1.00%)
  1 (1.00%) low mild
Benchmarking ping_pong/yatp::future::priority/256: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 8.3s, enable flat sampling, or reduce sample count to 50.
ping_pong/yatp::future::priority/256
                        time:   [1.6294 ms 1.6307 ms 1.6321 ms]
                        change: [+59.030% +59.676% +60.635%] (p = 0.00 < 0.05)
                        Performance has regressed.
Found 7 outliers among 100 measurements (7.00%)
  6 (6.00%) low severe
  1 (1.00%) high mild
ping_pong/tokio/256     time:   [247.47 µs 253.77 µs 259.37 µs]
                        change: [-5.2422% -2.6759% +0.0662%] (p = 0.05 < 0.05)
                        Change within noise threshold.
Found 8 outliers among 100 measurements (8.00%)
  1 (1.00%) low severe
  7 (7.00%) low mild
ping_pong/async-std/256 time:   [505.06 µs 506.09 µs 507.07 µs]
                        change: [-10.532% -10.017% -9.5641%] (p = 0.00 < 0.05)
                        Performance has improved.
Found 6 outliers among 100 measurements (6.00%)
  2 (2.00%) low severe
  2 (2.00%) low mild
  2 (2.00%) high severe
ping_pong/yatp::future/512
                        time:   [3.7182 ms 3.7230 ms 3.7279 ms]
                        change: [+81.353% +82.510% +83.700%] (p = 0.00 < 0.05)
                        Performance has regressed.
Found 1 outliers among 100 measurements (1.00%)
  1 (1.00%) low mild
ping_pong/yatp::callback/512
                        time:   [3.0720 ms 3.0876 ms 3.1028 ms]
                        change: [+1115.4% +1137.7% +1162.6%] (p = 0.00 < 0.05)
                        Performance has regressed.
Found 2 outliers among 100 measurements (2.00%)
  2 (2.00%) low mild
ping_pong/yatp::future::multilevel/512
                        time:   [4.0480 ms 4.0544 ms 4.0604 ms]
                        change: [+36.037% +36.350% +36.652%] (p = 0.00 < 0.05)
                        Performance has regressed.
Found 3 outliers among 100 measurements (3.00%)
  1 (1.00%) low severe
  2 (2.00%) high mild
ping_pong/yatp::future::priority/512
                        time:   [3.2234 ms 3.2268 ms 3.2301 ms]
                        change: [+58.883% +59.132% +59.378%] (p = 0.00 < 0.05)
                        Performance has regressed.
Found 2 outliers among 100 measurements (2.00%)
  2 (2.00%) low mild
ping_pong/tokio/512     time:   [477.20 µs 493.66 µs 508.32 µs]
                        change: [-7.4323% -4.6369% -1.7836%] (p = 0.00 < 0.05)
                        Performance has improved.
Found 9 outliers among 100 measurements (9.00%)
  9 (9.00%) low mild
Benchmarking ping_pong/async-std/512: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 5.1s, enable flat sampling, or reduce sample count to 60.
ping_pong/async-std/512 time:   [1.0116 ms 1.0139 ms 1.0161 ms]
                        change: [-10.369% -10.010% -9.6580%] (p = 0.00 < 0.05)
                        Performance has improved.
Found 4 outliers among 100 measurements (4.00%)
  2 (2.00%) low mild
  1 (1.00%) high mild
  1 (1.00%) high severe
ping_pong/yatp::future/1024
                        time:   [7.3091 ms 7.3185 ms 7.3279 ms]
                        change: [+74.447% +75.773% +77.162%] (p = 0.00 < 0.05)
                        Performance has regressed.
Found 1 outliers among 100 measurements (1.00%)
  1 (1.00%) low mild
ping_pong/yatp::callback/1024
                        time:   [5.8528 ms 5.9036 ms 5.9440 ms]
                        change: [+1150.0% +1181.1% +1215.6%] (p = 0.00 < 0.05)
                        Performance has regressed.
Found 18 outliers among 100 measurements (18.00%)
  12 (12.00%) low severe
  3 (3.00%) low mild
  3 (3.00%) high mild
ping_pong/yatp::future::multilevel/1024
                        time:   [8.0541 ms 8.0647 ms 8.0753 ms]
                        change: [+35.952% +36.216% +36.487%] (p = 0.00 < 0.05)
                        Performance has regressed.
Found 3 outliers among 100 measurements (3.00%)
  1 (1.00%) low mild
  2 (2.00%) high mild
ping_pong/yatp::future::priority/1024
                        time:   [6.3929 ms 6.4014 ms 6.4100 ms]
                        change: [+57.475% +57.786% +58.095%] (p = 0.00 < 0.05)
                        Performance has regressed.
ping_pong/tokio/1024    time:   [993.79 µs 1.0164 ms 1.0368 ms]
                        change: [-3.3689% +0.0447% +3.7601%] (p = 0.97 > 0.05)
                        No change in performance detected.
Found 8 outliers among 100 measurements (8.00%)
  2 (2.00%) low severe
  6 (6.00%) low mild
ping_pong/async-std/1024
                        time:   [2.0233 ms 2.0277 ms 2.0320 ms]
                        change: [-10.018% -9.7551% -9.4801%] (p = 0.00 < 0.05)
                        Performance has improved.
Found 2 outliers among 100 measurements (2.00%)
  2 (2.00%) low mild

     Running benches/spawn_many.rs (target/release/deps/spawn_many-d82594e2dea84d3d)
Gnuplot not found, using plotters backend
spawn_many/yatp::future/1024
                        time:   [4.0915 ms 4.1108 ms 4.1305 ms]
Found 2 outliers among 100 measurements (2.00%)
  2 (2.00%) high mild
spawn_many/yatp::callback/1024
                        time:   [4.1845 ms 4.2048 ms 4.2249 ms]
Found 2 outliers among 100 measurements (2.00%)
  1 (1.00%) low mild
  1 (1.00%) high mild
spawn_many/yatp::future::multilevel/1024
                        time:   [4.0085 ms 4.0316 ms 4.0559 ms]
Found 1 outliers among 100 measurements (1.00%)
  1 (1.00%) high mild
spawn_many/yatp::future::priority/1024
                        time:   [3.8814 ms 3.9111 ms 3.9419 ms]
Found 5 outliers among 100 measurements (5.00%)
  5 (5.00%) high mild
spawn_many/threadpool/1024
                        time:   [387.42 µs 388.56 µs 389.69 µs]
Found 5 outliers among 100 measurements (5.00%)
  4 (4.00%) high mild
  1 (1.00%) high severe
spawn_many/tokio/1024   time:   [734.65 µs 775.93 µs 813.98 µs]
Found 3 outliers among 100 measurements (3.00%)
  3 (3.00%) low mild
spawn_many/async-std/1024
                        time:   [905.74 µs 909.76 µs 913.82 µs]
Found 4 outliers among 100 measurements (4.00%)
  3 (3.00%) low mild
  1 (1.00%) high mild
spawn_many/yatp::future/4096
                        time:   [16.622 ms 16.697 ms 16.775 ms]
Found 5 outliers among 100 measurements (5.00%)
  1 (1.00%) low mild
  4 (4.00%) high mild
spawn_many/yatp::callback/4096
                        time:   [16.838 ms 16.913 ms 16.989 ms]
Found 1 outliers among 100 measurements (1.00%)
  1 (1.00%) high mild
spawn_many/yatp::future::multilevel/4096
                        time:   [16.214 ms 16.305 ms 16.393 ms]
Found 3 outliers among 100 measurements (3.00%)
  1 (1.00%) low mild
  2 (2.00%) high mild
spawn_many/yatp::future::priority/4096
                        time:   [15.628 ms 15.734 ms 15.843 ms]
Found 2 outliers among 100 measurements (2.00%)
  2 (2.00%) high mild
Benchmarking spawn_many/threadpool/4096: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 8.2s, enable flat sampling, or reduce sample count to 50.
spawn_many/threadpool/4096
                        time:   [1.6104 ms 1.6176 ms 1.6251 ms]
Found 1 outliers among 100 measurements (1.00%)
  1 (1.00%) high mild
spawn_many/tokio/4096   time:   [2.9549 ms 3.0538 ms 3.1504 ms]
Found 2 outliers among 100 measurements (2.00%)
  2 (2.00%) low mild
spawn_many/async-std/4096
                        time:   [3.7151 ms 3.7322 ms 3.7486 ms]
Found 3 outliers among 100 measurements (3.00%)
  3 (3.00%) low mild
spawn_many/yatp::future/8192
                        time:   [33.163 ms 33.318 ms 33.474 ms]
Found 1 outliers among 100 measurements (1.00%)
  1 (1.00%) high mild
spawn_many/yatp::callback/8192
                        time:   [33.730 ms 33.885 ms 34.038 ms]
Found 2 outliers among 100 measurements (2.00%)
  1 (1.00%) low mild
  1 (1.00%) high mild
spawn_many/yatp::future::multilevel/8192
                        time:   [32.276 ms 32.443 ms 32.604 ms]
spawn_many/yatp::future::priority/8192
                        time:   [31.173 ms 31.353 ms 31.536 ms]
Found 1 outliers among 100 measurements (1.00%)
  1 (1.00%) high mild
spawn_many/threadpool/8192
                        time:   [3.2442 ms 3.2564 ms 3.2691 ms]
Found 1 outliers among 100 measurements (1.00%)
  1 (1.00%) high mild
spawn_many/tokio/8192   time:   [5.9356 ms 6.1753 ms 6.4099 ms]
spawn_many/async-std/8192
                        time:   [7.3800 ms 7.4112 ms 7.4424 ms]
Found 1 outliers among 100 measurements (1.00%)
  1 (1.00%) low mild
Benchmarking spawn_many/yatp::future/16384: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 7.2s, or reduce sample count to 60.
spawn_many/yatp::future/16384
                        time:   [66.048 ms 66.336 ms 66.617 ms]
Found 1 outliers among 100 measurements (1.00%)
  1 (1.00%) low mild
Benchmarking spawn_many/yatp::callback/16384: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 7.1s, or reduce sample count to 70.
spawn_many/yatp::callback/16384
                        time:   [67.021 ms 67.368 ms 67.721 ms]
Benchmarking spawn_many/yatp::future::multilevel/16384: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 7.1s, or reduce sample count to 70.
spawn_many/yatp::future::multilevel/16384
                        time:   [64.627 ms 65.041 ms 65.451 ms]
Found 3 outliers among 100 measurements (3.00%)
  1 (1.00%) low mild
  2 (2.00%) high mild
Benchmarking spawn_many/yatp::future::priority/16384: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 6.7s, or reduce sample count to 70.
spawn_many/yatp::future::priority/16384
                        time:   [62.865 ms 63.330 ms 63.817 ms]
Found 2 outliers among 100 measurements (2.00%)
  2 (2.00%) high mild
spawn_many/threadpool/16384
                        time:   [6.4908 ms 6.5169 ms 6.5438 ms]
spawn_many/tokio/16384  time:   [11.992 ms 12.373 ms 12.741 ms]
Found 3 outliers among 100 measurements (3.00%)
  3 (3.00%) low mild
spawn_many/async-std/16384
                        time:   [14.461 ms 14.524 ms 14.588 ms]
Found 1 outliers among 100 measurements (1.00%)
  1 (1.00%) low mild

     Running benches/yield_many.rs (target/release/deps/yield_many-7729db606f3a1b2a)
Gnuplot not found, using plotters backend
yield_many/yatp::future/256
                        time:   [6.6376 ms 6.6768 ms 6.7170 ms]
Found 11 outliers among 100 measurements (11.00%)
  6 (6.00%) low mild
  5 (5.00%) high mild
yield_many/yatp::callback/256
                        time:   [8.6495 ms 8.7014 ms 8.7511 ms]
yield_many/yatp::future::multilevel/256
                        time:   [7.0003 ms 7.0439 ms 7.0876 ms]
Benchmarking yield_many/yatp::future::priority/256: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 6.6s, or reduce sample count to 70.
yield_many/yatp::future::priority/256
                        time:   [63.650 ms 64.138 ms 64.614 ms]
yield_many/tokio/256    time:   [6.9431 ms 7.1550 ms 7.3671 ms]
yield_many/async-std/256
                        time:   [49.132 ms 49.221 ms 49.311 ms]
yield_many/yatp::future/512
                        time:   [6.9206 ms 6.9530 ms 6.9856 ms]
Found 2 outliers among 100 measurements (2.00%)
  2 (2.00%) high mild
yield_many/yatp::callback/512
                        time:   [9.4391 ms 9.4939 ms 9.5517 ms]
Found 4 outliers among 100 measurements (4.00%)
  4 (4.00%) high mild
yield_many/yatp::future::multilevel/512
                        time:   [7.1172 ms 7.1599 ms 7.2033 ms]
Benchmarking yield_many/yatp::future::priority/512: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 13.4s, or reduce sample count to 30.
yield_many/yatp::future::priority/512
                        time:   [130.74 ms 131.28 ms 131.82 ms]
yield_many/tokio/512    time:   [9.1706 ms 9.3111 ms 9.4449 ms]
Benchmarking yield_many/async-std/512: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 9.8s, or reduce sample count to 50.
yield_many/async-std/512
                        time:   [97.858 ms 98.015 ms 98.172 ms]
Found 1 outliers among 100 measurements (1.00%)
  1 (1.00%) high mild
yield_many/yatp::future/1024
                        time:   [7.0910 ms 7.1259 ms 7.1616 ms]
yield_many/yatp::callback/1024
                        time:   [18.804 ms 18.912 ms 19.018 ms]
Found 1 outliers among 100 measurements (1.00%)
  1 (1.00%) high mild
yield_many/yatp::future::multilevel/1024
                        time:   [7.5849 ms 7.6014 ms 7.6193 ms]
Found 5 outliers among 100 measurements (5.00%)
  4 (4.00%) high mild
  1 (1.00%) high severe
Benchmarking yield_many/yatp::future::priority/1024: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 26.7s, or reduce sample count to 10.
yield_many/yatp::future::priority/1024
                        time:   [263.56 ms 264.21 ms 264.84 ms]
yield_many/tokio/1024   time:   [14.988 ms 15.017 ms 15.046 ms]
Benchmarking yield_many/async-std/1024: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 19.5s, or reduce sample count to 20.
yield_many/async-std/1024
                        time:   [194.73 ms 195.01 ms 195.29 ms]