Status of testing of Apache Airflow `3.1.2rc2` & Task SDK `1.1.2rc2`

[kaxil]

We are kindly requesting that contributors to Apache Airflow RC 3.1.2rc2 help test the RC.

Please let us know by commenting if the issue is addressed in the latest RC.

• Fix task instance display in task group grid view (#55670): @yimingpeng @jscheffl
  Linked issues:
  • Task Instances not correctly displayed in task group header in grid view (#55319)
• Respect task retries for signal killed tasks (#55767): @amoghrajesh
• Fix triggerer errors after Airflow 2 to 3 migration (#55884): @ephraimbuddy
• Add triggering_user_name to DagRunProtocol interface (#56193): @dheerajturaga
• Migrate retry handler in task SDK API client to use tenacity instead of retryhttp (#56762): @amoghrajesh
• UI - Download Tasks Logs button (#56771): @pierrejeambrun
• [v3-1-test] Implement integration test for airflowctl with 3.1 (#56124) (#56986): @bugraoz93
  Linked issues:
  • Caught if commands is not an airflowctl command in airflowctl integration tests (#56991)
• [v3-1-test] Fix Outlet Event Extra Data is Empty in Task Instance Success Listener (#54568) (#57031): @sjyangkevin
• [v3-1-test] fix get latest serialized_dag model query to prevent "Out of sort memory" error (#55589) (#57042): @wjddn279 @github-actions[bot]
• [v3-1-test] Fix: Adjust PanelButtons spacing and alignment (#56570) (#57062): @potiuk @github-actions[bot] @anshuksi282-ksolves
• [v3-1-test] Add possibility of removing extra translations missing in en (#57060) (#57064): @potiuk @github-actions[bot]
• [v3-1-test] improve plugin system documentation for clarity and completeness (#57068): @bbovenzi @Lohith625
  Linked issues:
  • docs:improve plugin system documentation for clarity and completeness (#56177)
• [v3-1-test] Fix grid links for tasks with retries (#57063) (#57097): @pierrejeambrun
• [v3-1-test] Port Airflow Python client changes (#57103) (#57107): @kaxil
• Fix dag-processor crash when renaming DAG tag case on MySQL (#57113): @kaxil @yanshil
  Linked issues:
  • Dag Tag renaming (from lower case to upper case) cause dag-processor failure (#56940)
• Fix iterating through ObjectStoragePath (#57156): @mixilchenko
• Sync airflowctl from main to v3-1-test to include all changes in integration tests (#57171): @bugraoz93
  Linked issues:
  • [v3-1-test] Implement integration test for airflowctl with 3.1 (#56124) (#56986)
• [v3-1-test] Use exc_info for task instance heartbeat failure exception logging (#57172) (#57179): @potiuk @amoghrajesh
  Linked issues:
  • Upgrade ruff to latest version (0.12.1) (#52562)
• [v3-1-test] Bump zizmor version to 1.16.0 to fix CI (#57190) (#57195): @amoghrajesh
• fix: Add auto-refresh functionality to Required Actions page (#56404) (#57207): @pierrejeambrun @rich7420
• [v3-1-test] Fix systemd service files issues (#57126) (#57231): @alamashir @frodo2000
  Linked issues:
  • Systemd scripts (#53706)
• [v3-1-test] Make single workflow to run both AMD and ARM builds (#56887) (#57232): @gopidesupavan
• [v3-1-test] Automatically publish "apache-airflow-providers" docs (#57229) (#57244): @potiuk
• [v3-1-test] Upgrade CI/dev tooling to latest versions (#57245): @potiuk
• [v3-1-test] CI: Fix workflow name (#57246) (#57251): @potiuk @gopidesupavan
• [v3-1-test] Review and modernize release check process for Airflow: (… (#57252): @potiuk
• [v3-1-test] Auto-compile UI assets on Breeze start-airflow command (#57219) (#57253): @jason810496
• [v3-1-test] Update release docs for Helm Chart to use breeze workflow-run (#57255) (#57257): @potiuk
• [v3-1-test] Fix runner type assignment in selective checks (#57258): @gopidesupavan
• [v3-1-test] Extract prek hooks for Providers (#57250) (#57260): @potiuk @jscheffl
• [v3-1-test] Disable some integration tests for ARM (#57259) (#57261): @potiuk
• [v3-1-test] Only show latest minor versions in version drop-down in docs (#57243) (#57262): @potiuk
• [v3-1-test] Extract prek hooks for Task-SDK (#57264) (#57282): @jscheffl
• [v3-1-test] Add better platform diagnostics to see which platform is used (#57284) (#57285): @potiuk
• [v3-1-test] Clean up some root discovery in prek scripts (#57290) (#57291): @jscheffl
• [v3-1-test] Fix 3-1-test breeze unit tests (#57300): @potiuk
• Upgrade Happy-Dom in Plugin Template as well (#57287) (#57301): @jscheffl
  Linked issues:
  • Upgrade Happy-Dom in Plugin Template as well (#57287)
• [v3-1-test] Extract prek hooks for Helm (#57263) (#57303): @jscheffl
• DagBag re-added to exclusion list for task-sdk imports (#57304): @potiuk
• [v3-1-test] Replace last pylint usage by ruff rule (#57294) (#57307): @jscheffl
• [v3-1-test] Extract prek hooks for airflowctl (#57308) (#57312): @jscheffl
• [v3-1-test] Fix wrong path pattern after moving prek check to chart folder (#57311) (#57313): @jscheffl
• [v3-1-test] Fix dag processor crash by ignoring callbacks from other bundles (#57192) (#57330): @ephraimbuddy @tirkarthi
  Linked issues:
  • dag processor crashes trying to process callback request for another bundle (#57081)
• [v3-1-test] Fix formatting of commands to download RAT and unpacking it (#57327) (#57331): @amoghrajesh
• [v3-1-test] Add initial docs for airflow-ctl release process (#57318) (#57332): @potiuk
• Move structlog imports into a TYPE_CHECKING block to untie version bumps (#57335): @amoghrajesh
• [v3-1-test] remove outdated note from upgrading docs (#57338) (#57345): @eladkal
• [v3-1-test] Fix asset name overflow in DAG list view (#57108) (#57363): @TyrellHaywood
• [v3-1-test] Fix memory leak in Client via SSL context creation (#57334) (#57374): @wjddn279
• [v3-1-test] Fix job label extraction from the workflow jobs response (#57375) (#57376): @gopidesupavan
• [v3-1-test] Add better logging for jobs label (#57378) (#57379): @gopidesupavan
• [v3-1-test] Add Content-Type to Request Header in Task SDK calls (#57377) (#57386): @jscheffl
• [v3-1-test] Add typer-slim as a common development dependency (#57383) (#57387): @potiuk
• [v3-1-test] Protect against reproducibility issue with Python client (#57390) (#57391): @potiuk
• [v3-1-test] Move docker to /mnt for the "Publish docs" workflow (#57371) (#57394): @potiuk
• [v3-1-test] Upgrade prek to most recent version (#57384) (#57395): @jscheffl
• [v3-1-test] Synchronize boto3 and sqlalchemy dependency lower-binds (… (#57396): @potiuk
• Remove callbacks from DAG default_args when serializating it (#57397): @kaxil
• [v3-1-test] Update main with Airflow 3.1.1 release details (#57392) (#57402): @potiuk @kaxil
• [v3-1-test] fix: make _get_ssl_context_cached a static method (#57401) (#57403): @Lee-W
• [v3-1-test] Improve clarity on api workers recommendation in docs (#5… (#57404): @potiuk @r-richmond
• [v3-1-test] Update reproducible hash (#57407): @potiuk
• [v3-1-test] Log execution API server URL at task startup (#57343) (#57409): @amoghrajesh
• [v3-1-test] [API] Use BulkTaskInstanceBody for patching tis with new … (#57412): @Prajwal7842 @jason810496
• [v3-1-test] Add hover rotation animation to AirflowPin (#57326) (#57440): @pierrejeambrun @choo121600
• [v3-1-test] Fix n+1 queries in ui/dags endpoint and use a compact response model. (#57425) (#57444): @tirkarthi
• [v3-1-test] Feat: Add XCom 'Timestamp' and unify task columns (#57053) (#57447): @anshuksi282-ksolves
• [v3-1-test] Fix text selection jumping in logs pane to match text editor behavior (#57309) (#57453): @dheerajturaga
• Fix connection retrieval in DagProcessorManager for bundle initialization (#57459): @dheerajturaga
• Optimize DAG list query for users with limited access (#57460): @kaxil @tirkarthi
  Linked issues:
  • generate_dag_with_latest_run_query queries all dagruns irrespective of the dag ids accessible (#57427)
• [v3-1-test] Add number of queries guard in public backfill list endpoints (#57439) (#57482): @pierrejeambrun
• [v3-1-test] Add Guan-Ming as committer (#57462) (#57484): @guan404ming
• [v3-1-test] Fix pre-commit zizmor hook version update to fix CI upgrade check failure. (#57476) (#57486): @sunank200
• [v3-1-test] Add number of queries guard in public connection list endpoints (#57442) (#57489): @pierrejeambrun
• [v3-1-test] fix: dag_docs content not scrollable when too long (#57509) (#57518): @Dennnnny
• [v3-1-test] chore: update navigation z-index using Chakra token (#57493) (#57520): @choo121600 @jscheffl
• [v3-1-test] [Doc] Fixing some typos and spelling errors (#57225) (#57521): @didier-durand
• [v3-1-test] Fix instance_name in UI docs (#57380) (#57523): @Zinkue
• [v3-1-test] Enable ruff PLW0120 rule (#57456) (#57525): @jscheffl
• Docs: Fix missing Airflow macro module list in template documentation (#57529): @humit0 @kaxil
  Linked issues:
  • Deprecate airflow.macros in favor of Task SDK version (#53545)
• [v3-1-test] Add number of queries guard in public dag tags list endpoints (#57499) (#57540): @pierrejeambrun
• [v3-1-test] Add query guard in public asset list endpoints (#57438) (#57543): @pierrejeambrun
• [v3-1-test] Add number of queries guard in public dag warnings list endpoint (#57503) (#57546): @pierrejeambrun
• Reduce log level for "Connection not found" event from error to warning for chosen Connections. (#57548): @Crowiant
• [v3-1-test] Fix HITL operators failing when using notifiers (#57494) (#57551): @amoghrajesh
• [v3-1-test] Add number of queries guard in public xcom entries list endpoints (#55936) (#57554): @guan404ming
• [v3-1-test] Add number of queries guard in public dags list endpoints (#57506) (#57556): @pierrejeambrun
• [v3-1-test] Add number of queries guard in public event logs list endpoints (#57508) (#57558): @pierrejeambrun
• [v3-1-test] Better highlighting of selected task instance and edges in grid view (#57275) (#57560): @dheerajturaga
• Backport nav updates to v3 1 test (#57565): @kaxil @ryanahamilton
• [v3-1-test] Add number of queries guard in public import errors list endpoints (#57557) (#57569): @pierrejeambrun
• [v3-1-test] Fix n+1 query to fetch tags in the dags list page (#57270) (#57570): @pierrejeambrun @kaxil
• [v3-1-test] Add --answer flag support to breeze run command (#57589) (#57591): @kaxil
• Optimize dynamic DAG updates to avoid loading large serialized DAGs (#57592): @kaxil
• [v3-1-test] Remove duplicate trove classifier (#57595) (#57597): @kaxil
• [v3-1-test] ci(github-actions): Upgrade uv and ruff versions to fix CI (#57602): @Lee-W
• [v3-1-test] Alias task_display_name for EventLogResponse (#55160) (#57609): @pierrejeambrun @guan404ming
• [v3-1-test] Add number of queries guard in public import jobs endpoints (#57559) (#57611): @pierrejeambrun
• [v3-1-test] Add number of queries guard in public dag reports list endpoints (#57496) (#57612): @pierrejeambrun
• [v3-1-test] SerDe: Check more strictly for pydantic model (#56758) (#57616): @Desdroid @amoghrajesh
• [v3-1-test] Add number of queries guard in public plugins list endpoints (#57562) (#57617): @pierrejeambrun

Thanks to all who contributed to the release (probably not a complete list!):
@Dennnnny @sunank200 @eladkal @mixilchenko @frodo2000 @Lee-W @humit0 @kaxil @ephraimbuddy @TyrellHaywood @Zinkue @yimingpeng @bbovenzi @sjyangkevin @wjddn279 @dheerajturaga @anshuksi282-ksolves @gopidesupavan @bugraoz93 @amoghrajesh @guan404ming @didier-durand @ryanahamilton @r-richmond @pierrejeambrun @potiuk @alamashir @Lohith625 @Desdroid @rich7420 @tirkarthi @jason810496 @choo121600 @jscheffl @Prajwal7842 @Crowiant @yanshil

[dheerajturaga]

tested all my changes #56193 #57453 #57453 #57560 , LGTM! Thanks @kaxil !

[Dennnnny]

tested my change #57518, it's all good. Thank you @kaxil

[yimingpeng]

Tested my change #55670, looks good to me. Thanks @kaxil

Note that only the first issue mentioned #55319 was addressed, WIP on another PR to address the 2nd, thanks

[jscheffl]

Tested my back-ports and contributions, all look good!

[alamashir]

Tested my change #57231 and looking good. Thanks @kaxil

[guan404ming]

Verified my changes and looked good, thanks!

[sjyangkevin]

For #54568 and #57031, I didn't get the chance to make the code changes based on the feedback #54568 (comment), due to very limited bandwidth. @uranusjr @Lee-W , I am wondering if there still could be a risk making it an attribute; I would be available mid next week to investigate deeper into it and incorporate the feedback into code change. thanks, and sorry for any inconvenience.

[Zinkue]

Hi, I am new on this and I have a question. My issue was related to fixing/updating the docs. How I can "test" my changes?

[jscheffl]

Hi, I am new on this and I have a question. My issue was related to fixing/updating the docs. How I can "test" my changes?

We have a staging docs site where current state of development and pre-releases are published to: https://airflow.staged.apache.org/docs/apache-airflow/3.1.2/index.html

[Zinkue]

Tested #57523 and looks good!

[choo121600]

My change looks good 😉

• [v3-1-test] Add hover rotation animation to AirflowPin (#57326) #57440
• [v3-1-test] chore: update navigation z-index using Chakra token (#57493) #57520

[potiuk]

Checked all my changes are in. Most of them in dev tooling.

[wjddn279]

I confirmed the bugs were resolved in both PRs.

#57042
I confirmed that the modified query was correctly applied and working as expected.

#57374
I verified that memory usage does not exceed 700KB with SSL cache enabled