Skip to content

feat(ReloadingProducer): add concept of logical to physical topic - #581

Merged
bmckerry merged 1 commit into
mainfrom
ben/logical-to-physical-topics
Oct 20, 2026
Merged

bmckerry merged 1 commit into
mainfrom
ben/logical-to-physical-topics

Conversation

@bmckerry

Copy link
Copy Markdown
Member

Ref STREAM-1922

This PR makes a breaking change to the config blob format, replacing TopicEntry with LogicalTopicEntry that maps to a PhysicalTopicEntry. ReloadingKafkaProducer forwards messages produced to the logical topic to the correct physical topic.

  • This also removes the old concept of logical_topic entirely, which was used as an alias for the topic name. Users produce to the topic name listed in LogicalTopicEntry, and the reloading client abstracts the physical topic away from the user by swapping in the correct destination for the physical topic
  • The relation between logical and physical topics is 1:1 for simplicity, this will be expanded in a later PR to be a 1:n relation

@bmckerry
bmckerry requested review from a team as code owners October 19, 2026 18:25
@linear-code

linear-code Bot commented Oct 19, 2026

Copy link
Copy Markdown

STREAM-1922

@bmckerry
bmckerry merged commit 036dd3b into main Oct 20, 2026
22 checks passed
@bmckerry
bmckerry deleted the ben/logical-to-physical-topics branch October 20, 2026 14:27
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants