Skip to content

chore: prepare v0.11.0 - #2239

Merged
mxinden merged 3 commits into
mozilla:mainfrom
mxinden:release-v0.11.0
Nov 27, 2024
Merged

mxinden merged 3 commits into
mozilla:mainfrom
mxinden:release-v0.11.0

Conversation

@mxinden

@mxinden mxinden commented Nov 19, 2024

Copy link
Copy Markdown
Member

New release to get #2237 into mozilla-central.

Minor bump (v0.10.0 -> v0.11.0) due to #2216.

@codecov

codecov Bot commented Nov 19, 2024 •

Copy link
Copy Markdown

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 95.38%. Comparing base (998571d) to head (dbd4bfd).
Report is 1 commits behind head on main.

Additional details and impacted files
@@           Coverage Diff           @@
##             main    #2239   +/-   ##
=======================================
  Coverage   95.38%   95.38%           
=======================================
  Files         112      112           
  Lines       36593    36593           
=======================================
  Hits        34903    34903           
  Misses       1690     1690           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@github-actions

github-actions Bot commented Nov 19, 2024 •

Copy link
Copy Markdown
Contributor

Failed Interop Tests

QUIC Interop Runner, client vs. server

neqo-latest as client

neqo-latest as server

All results

Succeeded Interop Tests

QUIC Interop Runner, client vs. server

neqo-latest as client

neqo-latest as server

Unsupported Interop Tests

QUIC Interop Runner, client vs. server

neqo-latest as client

neqo-latest as server

@mxinden

mxinden commented Nov 19, 2024 •

Copy link
Copy Markdown
Member Author

mozilla-central depends on url v2.5.1:

https://searchfox.org/mozilla-central/rev/6050bf4eca89956c9d91bfd89fa59294ae32a689/Cargo.lock#6715-6725

The latest version of url is v2.5.3, which we automatically updated to, given that we don't check in a Cargo.lock (yet #2208).

url v0.2.5.3introduced thestd` feature which broke our CI. #2219 enabled it.

Given that mozilla-central still uses url v2.5.1 without the std feature, we can't use Neqo v0.11.0 as it is today in mozilla-central.

Moving to draft for now, until I figure out a way forward.

@mxinden
mxinden marked this pull request as draft November 19, 2024 08:56
@github-actions

github-actions Bot commented Nov 19, 2024 •

Copy link
Copy Markdown
Contributor

Benchmark results

Performance differences relative to 998571d.

coalesce_acked_from_zero 1+1 entries: No change in performance detected.
       time:   [99.163 ns 99.494 ns 99.828 ns]
       change: [-6.8676% -2.3477% +0.5382%] (p = 0.35 > 0.05)

Found 13 outliers among 100 measurements (13.00%)
9 (9.00%) high mild
4 (4.00%) high severe

coalesce_acked_from_zero 3+1 entries: Change within noise threshold.
       time:   [117.28 ns 117.64 ns 118.04 ns]
       change: [-0.8045% -0.4771% -0.0795%] (p = 0.01 < 0.05)

Found 17 outliers among 100 measurements (17.00%)
2 (2.00%) low severe
3 (3.00%) high mild
12 (12.00%) high severe

coalesce_acked_from_zero 10+1 entries: Change within noise threshold.
       time:   [117.06 ns 117.66 ns 118.32 ns]
       change: [-1.5010% -0.8145% -0.2345%] (p = 0.01 < 0.05)

Found 13 outliers among 100 measurements (13.00%)
3 (3.00%) low severe
1 (1.00%) low mild
9 (9.00%) high severe

coalesce_acked_from_zero 1000+1 entries: 💚 Performance has improved.
       time:   [97.472 ns 97.621 ns 97.787 ns]
       change: [-2.8047% -1.9205% -1.0299%] (p = 0.00 < 0.05)

Found 13 outliers among 100 measurements (13.00%)
4 (4.00%) high mild
9 (9.00%) high severe

RxStreamOrderer::inbound_frame(): No change in performance detected.
       time:   [111.84 ms 111.90 ms 111.95 ms]
       change: [-0.0653% +0.0012% +0.0632%] (p = 0.97 > 0.05)

Found 8 outliers among 100 measurements (8.00%)
7 (7.00%) low mild
1 (1.00%) high mild

SentPackets::take_ranges: No change in performance detected.
       time:   [5.4941 µs 5.6429 µs 5.7931 µs]
       change: [-15.922% -1.1663% +17.731%] (p = 0.87 > 0.05)

Found 4 outliers among 100 measurements (4.00%)
3 (3.00%) high mild
1 (1.00%) high severe

transfer/pacing-false/varying-seeds: No change in performance detected.
       time:   [24.763 ms 25.849 ms 26.943 ms]
       change: [-10.694% -5.2797% +0.3671%] (p = 0.07 > 0.05)

Found 3 outliers among 100 measurements (3.00%)
1 (1.00%) low mild
2 (2.00%) high mild

transfer/pacing-true/varying-seeds: No change in performance detected.
       time:   [32.797 ms 34.495 ms 36.219 ms]
       change: [-10.784% -4.1475% +2.9479%] (p = 0.25 > 0.05)
transfer/pacing-false/same-seed: No change in performance detected.
       time:   [24.972 ms 25.635 ms 26.303 ms]
       change: [-4.8731% -0.5529% +3.6871%] (p = 0.81 > 0.05)

Found 1 outliers among 100 measurements (1.00%)
1 (1.00%) low mild

transfer/pacing-true/same-seed: No change in performance detected.
       time:   [39.561 ms 41.669 ms 43.828 ms]
       change: [-9.0484% -2.0661% +5.6929%] (p = 0.57 > 0.05)
1-conn/1-100mb-resp/mtu-1504 (aka. Download)/client: 💔 Performance has regressed.
       time:   [914.65 ms 923.63 ms 932.76 ms]
       thrpt:  [107.21 MiB/s 108.27 MiB/s 109.33 MiB/s]
change:
       time:   [+2.9409% +4.4309% +6.0156%] (p = 0.00 < 0.05)
       thrpt:  [-5.6743% -4.2429% -2.8569%]
1-conn/10_000-parallel-1b-resp/mtu-1504 (aka. RPS)/client: Change within noise threshold.
       time:   [322.50 ms 325.85 ms 329.28 ms]
       thrpt:  [30.369 Kelem/s 30.689 Kelem/s 31.008 Kelem/s]
change:
       time:   [+0.9474% +2.3903% +3.8471%] (p = 0.00 < 0.05)
       thrpt:  [-3.7046% -2.3345% -0.9385%]
1-conn/1-1b-resp/mtu-1504 (aka. HPS)/client: No change in performance detected.
       time:   [33.686 ms 33.804 ms 33.921 ms]
       thrpt:  [29.480  elem/s 29.582  elem/s 29.686  elem/s]
change:
       time:   [-0.9927% -0.2857% +0.3519%] (p = 0.42 > 0.05)
       thrpt:  [-0.3506% +0.2865% +1.0027%]
1-conn/1-100mb-resp/mtu-1504 (aka. Upload)/client: 💔 Performance has regressed.
       time:   [1.7033 s 1.7216 s 1.7400 s]
       thrpt:  [57.470 MiB/s 58.085 MiB/s 58.709 MiB/s]
change:
       time:   [+2.0733% +3.6415% +5.2649%] (p = 0.00 < 0.05)
       thrpt:  [-5.0016% -3.5135% -2.0312%]

Client/server transfer results

Transfer of 33554432 bytes over loopback.

Client Server CC Pacing MTU Mean [ms] Min [ms] Max [ms]
gquiche gquiche 1504 543.9 ± 58.8 514.3 709.4
neqo gquiche reno on 1504 814.7 ± 65.2 779.0 998.2
neqo gquiche reno 1504 788.4 ± 64.0 747.5 958.0
neqo gquiche cubic on 1504 813.8 ± 70.2 762.6 961.2
neqo gquiche cubic 1504 799.5 ± 14.9 782.0 835.4
msquic msquic 1504 203.3 ± 103.1 106.6 345.5
neqo msquic reno on 1504 244.9 ± 60.2 208.9 429.9
neqo msquic reno 1504 269.9 ± 80.1 207.2 424.0
neqo msquic cubic on 1504 252.5 ± 62.4 210.7 421.4
neqo msquic cubic 1504 229.5 ± 11.1 206.0 248.2
gquiche neqo reno on 1504 709.7 ± 126.6 568.2 1001.3
gquiche neqo reno 1504 707.1 ± 112.3 562.3 878.2
gquiche neqo cubic on 1504 700.2 ± 105.7 557.5 912.5
gquiche neqo cubic 1504 702.3 ± 99.5 562.7 899.1
msquic neqo reno on 1504 505.1 ± 53.6 461.4 622.4
msquic neqo reno 1504 505.8 ± 64.0 444.8 659.7
msquic neqo cubic on 1504 511.2 ± 41.6 479.6 600.3
msquic neqo cubic 1504 489.1 ± 36.6 464.2 588.7
neqo neqo reno on 1504 581.5 ± 95.5 484.6 807.0
neqo neqo reno 1504 547.5 ± 66.5 454.6 646.7
neqo neqo cubic on 1504 620.4 ± 127.9 532.7 967.2
neqo neqo cubic 1504 561.3 ± 25.4 499.5 584.4

⬇️ Download logs

@larseggert

Copy link
Copy Markdown
Collaborator

Sounds like we need to pin url to 2.5.1?

@mxinden mxinden mentioned this pull request Nov 19, 2024
@mxinden

mxinden commented Nov 26, 2024

Copy link
Copy Markdown
Member Author

Waiting for https://phabricator.services.mozilla.com/D229493 to land, updating mozilla-central to url v2.5.4. I will proceed here afterwards.

@mxinden
mxinden marked this pull request as ready for review November 27, 2024 19:49
@mxinden
mxinden enabled auto-merge November 27, 2024 20:03
@mxinden
mxinden added this pull request to the merge queue Nov 27, 2024
Merged via the queue into mozilla:main with commit c6d5502 Nov 27, 2024
@mxinden
mxinden deleted the release-v0.11.0 branch November 27, 2024 20:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants