Repository navigation
Link the public JATS benchmark from the README, docs and limitations page - #206
Merged
Merged
Conversation
…page The 15 October whole-paper test is now public as scienceverse/bibr-jats-eval: its papers, answer key and per-paper scores for bibr and GROBID. The limitations page links it from the whole-paper and scanned-paper rows and says that new scores on those papers no longer count as sealed. The README, the docs home page and the evaluation guide point to it.
Codecov Report✅ All modified and coverable lines are covered by tests. Additional details and impacted files@@ Coverage Diff @@
## main #206 +/- ##
==========================================
- Coverage 90.55% 90.55% -0.01%
==========================================
Files 309 309
Lines 57282 57282
Branches 10374 10374
==========================================
- Hits 51873 51872 -1
Misses 3450 3450
- Partials 1959 1960 +1 🚀 New features to boost your workflow:
|
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Requested by Jakub · project thread
Before: the limitations page calls the 300-paper JATS result a sealed test, and nothing on the site or in the README links to its data.
After: the README, the docs home page, the evaluation guide and the limitations page link to the public benchmark, scienceverse/bibr-jats-eval, with its papers, answer key and per-paper scores. The limitations page marks that result "Sealed test, now public" and says new scores on those papers no longer count as sealed.
How: text-only edits to
LIMITATIONS.md,README.md,docs/index.mdanddocs/contributing/evaluation.md.mkdocs build --strictpasses, and the public-docs guard finds nothing in the changed files.