Repository navigation
fix(curation): count parsed queries during dry-run - #736
Conversation
There was a problem hiding this comment.
Copilot was unable to review this pull request because the user who requested the review has insufficient remaining quota.
An organization owner can choose the repository organization as the billing source for reviews requested by members with a paid Copilot license. Learn about Copilot code review billing.
[Medium impact] The PR appears safe to merge; no actionable issues were found.
|
kstonekuan
left a comment
There was a problem hiding this comment.
Thanks for the fix. Ruff, formatting, ty, and the full suite passed (2564 passed, 8 skipped). LGTM.
Summary
Make
curate(..., output=None)and CLI--dry-runaccept saved SQL ending in;, a final line comment, or both. These queries already write manifests successfully; the dry-run count wrapper introduces their syntax errors.Count the parsed DuckDB relation after the unchanged statement gate. Extend existing SQL-surface and CLI tests, including
--sql-file.Evidence
Before: five regression cases fail on main
43380ac; both CLI input modes exit 2. Four selected controls pass, including manifest writes.After: 183 catalog/curation tests pass, including existing non-single-SELECT refusal cases.
A real synthetic MCAP →
App.test(record=True)→ catalog → saved SQL-file run previously failed dry-run but wrote a one-row manifest. Afterward, both CLI modes exit 0 with one row andjoints: 1/1 (100%). Dry-run creates no manifest.Exact validation from the repository root:
Python 3.14 full suite: 2,564 passed, 8 skipped. Python 3.11 focused suite: 42 passed, 141 deselected in a separate environment. Skips require network opt-in, model assets, Docker, or a live bucket. Quality checks passed; full-suite prerequisites included FFmpeg 8.1 and a C compiler.
Merge Danger
Door: two-way
Revertible without data migration.
Blast Radius: curation
Only report-only counts change. Statement validation and constrained connection settings remain in place. No dependencies, stored formats, canonical bytes, or manifest-publication changes.
Need help on this PR? Tag
@codesmith-botwith what you need.