[SYSTEMDS-3946] Merge PR Enable sending of large (>2GiB) FederatedRequests - #2591

Closed

ywcb00 wants to merge 14 commits into

apache:mainfrom

ywcb00:pr-2496

Commits on Sep 3, 2026

[SYSTEMDS-3946] Enable sending of large (>2GiB) FederatedRequests and Responses

Biranavan-Parameswaran
authored and
ywcb00
committed
5e1d0a2
[SYSTEMDS-3946] Streaming codec routing, chunk tuning, tests, review fixes

Biranavan-Parameswaran
authored and
ywcb00
committed
0a01a8b
chore: trigger PR update

Biranavan-Parameswaran
authored and
ywcb00
committed
573fd85
[SYSTEMDS-3946] Fix Eclipse formatting on PR-edited lines

Biranavan-Parameswaran
authored and
ywcb00
committed
65e0840
[SYSTEMDS-3946] Test chunk codec error propagation and frame release

Biranavan-Parameswaran
authored and
ywcb00
committed
72135fb
[SYSTEMDS-3946] Rename chunk decoder locals per review

Biranavan-Parameswaran
authored and
ywcb00
committed
e1e3ca4
[SYSTEMDS-3946] Javadoc for the streaming chunk codec

Biranavan-Parameswaran
authored and
ywcb00
committed
ea99511
[SYSTEMDS-3946] Test unknown chunk frame type

Biranavan-Parameswaran
authored and
ywcb00
committed
bb8136b
refactor(main/runtime/controlprogram/federated/FederatedChunkProtocol.java): change class and members to visibility public
ywcb00
committed
3cc4f03
refactor(test/functions/federated/io/FederatedMaxPayloadTest.java): move test to io folder instead of network folder and delete the empty network folder
ywcb00
committed
d9a9e1c
fix(main/runtime/controlprogram/federated/FederatedData.java): add the federated request encoder again
ywcb00
committed
08c05f6
fix(main/runtime/controlprogram/federated/FederatedResponse.java): modify the predicate if it is reusable by lineage to always be true when the lineage object is not null
ywcb00
committed
a7b3da4
chore(**): remove unused imports
ywcb00
committed
6ccf70c
fix(main/runtime/controlprogram/federated/FederatedChunkDecoder.java): fix problem with failing python test in cases with low computing power (e.g., only two cores; set by 'taskset 0,1 ./runTest)

Biranavan-Parameswaran
authored and
ywcb00
committed
c17574a

Navigation Menu

Uh oh!

[SYSTEMDS-3946] Merge PR Enable sending of large (>2GiB) FederatedRequests - #2591

[SYSTEMDS-3946] Merge PR Enable sending of large (>2GiB) FederatedRequests#2591
ywcb00 wants to merge 14 commits into
apache:mainfrom
ywcb00:pr-2496

Commits on Sep 3, 2026

[SYSTEMDS-3946] Enable sending of large (>2GiB) FederatedRequests and Responses

[SYSTEMDS-3946] Streaming codec routing, chunk tuning, tests, review fixes

chore: trigger PR update

[SYSTEMDS-3946] Fix Eclipse formatting on PR-edited lines

[SYSTEMDS-3946] Test chunk codec error propagation and frame release

[SYSTEMDS-3946] Rename chunk decoder locals per review

[SYSTEMDS-3946] Javadoc for the streaming chunk codec

[SYSTEMDS-3946] Test unknown chunk frame type

refactor(main/runtime/controlprogram/federated/FederatedChunkProtocol.java): change class and members to visibility public

refactor(test/functions/federated/io/FederatedMaxPayloadTest.java): move test to io folder instead of network folder and delete the empty network folder

fix(main/runtime/controlprogram/federated/FederatedData.java): add the federated request encoder again

fix(main/runtime/controlprogram/federated/FederatedResponse.java): modify the predicate if it is reusable by lineage to always be true when the lineage object is not null

chore(**): remove unused imports

fix(main/runtime/controlprogram/federated/FederatedChunkDecoder.java): fix problem with failing python test in cases with low computing power (e.g., only two cores; set by 'taskset 0,1 ./runTest)