Repository navigation
Conversation
Build on the WHO implementation, fixtures and historical backend comparison from PR MedARC-AI#6. Co-authored-by: Ashu <ashutosh@root.credit>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
WHO landing pages contain only an Overview. This adopts Ashu's WHO implementation from #6 (commit
ca7a330fc2e87022e24e6b1b72130b3ec5002408) and ports it onto current main's shared scraper registry, combining the Overview with linked PDF text when conversion succeeds.pdfextra and root PDF group; recordfullversusoverviewcontent scope and recover from PDF download/conversion failures.codex/prefix.Credit: Ashu supplied the original WHO implementation, fixtures and historical five-document backend comparison. The adoption commit includes a co-author trailer. Original #6 remains open. New OCR diagnostics are isolated in #32; CCO is isolated in #30.
Validation:
uv run ruff check .,uv run ruff format --check .,AMFV_CHECK_GOLDEN=1 uv run --group pdf pytest -q(88 passed, four third-party deprecation warnings), anduv build --package amfv-datasets. A normal development install without PDF dependencies previously passed 81 tests with seven optional tests skipped. Live checks covered the first listing API page and an Overview-only publication; full-text checks used two six-page real excerpts and mocked HTTP. No full-corpus scrape was performed.