Skip to content

deps: bump tokenizers from 0.21.4 to 0.23.3 - #96

Closed
dependabot[bot] wants to merge 1 commit into
mainfrom
dependabot/pip/tokenizers-0.23.3
Closed

dependabot[bot] wants to merge 1 commit into
mainfrom
dependabot/pip/tokenizers-0.23.3

Conversation

@dependabot

@dependabot dependabot Bot commented on behalf of github Oct 25, 2026 •

Copy link
Copy Markdown
Contributor

Bumps tokenizers from 0.21.4 to 0.23.3.

Release notes

Sourced from tokenizers's releases.

Release v0.23.3 (python only)

Release v0.23.3

Python package release, other packages are unchanged

🚨 Fixs a breaking change introduced in v0.23.1

What's changed

Patch for the python package with three fixes:

Full Changelog: huggingface/tokenizers@v0.23.2...v0.23.3

v0.23.2

This is the last v0 release, we are moving to v1!!

More details coming soon 👀

What's Changed

New Contributors

Full Changelog: huggingface/tokenizers@v0.23.1...v0.23.2

... (truncated)

Commits
  • 3012770 comment out semver to run rust tests
  • 62c96d3 fix: restore overflowing
  • 580ffcb account for text_signature
  • 14e6dce fix(python): ship submodule stubs as <sub>/init.pyi
  • 935453f chore(python): delete the stale hand-written trainers stub
  • 65903e3 ci: disable rust and node publishing on the 0.23.x branch
  • 2b110f4 ci: remove CI.yml, it publishes to PyPI with a token on every tag
  • ac1dfef ci(python-release): use main's Trusted Publishing release workflow
  • 5ea330f release(python): v0.23.3, allow huggingface_hub <3
  • c2b33f8 update release
  • Additional commits viewable in compare view

@dependabot dependabot Bot added dependencies Pull requests that update a dependency file python Pull requests that update python code labels Oct 25, 2026
Bumps [tokenizers](https://github.com/huggingface/tokenizers) from 0.21.4 to 0.23.3.
- [Release notes](https://github.com/huggingface/tokenizers/releases)
- [Commits](huggingface/tokenizers@v0.21.4...v0.23.3)

---
updated-dependencies:
- dependency-name: tokenizers
  dependency-version: 0.23.3
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
@dependabot
dependabot Bot force-pushed the dependabot/pip/tokenizers-0.23.3 branch from 3dde22b to 114a0f8 Compare October 26, 2026 15:28
@cristiangirlea

Copy link
Copy Markdown
Owner

Superseded by #106, which lands this bump together with the regenerated hash lock (merged as a1198de).

@dependabot @github

dependabot Bot commented on behalf of github Oct 26, 2026

Copy link
Copy Markdown
Contributor Author

OK, I won't notify you again about this release, but will get in touch when a new version is available. If you'd rather skip all updates until the next major or minor version, let me know by commenting @dependabot ignore this major version or @dependabot ignore this minor version. You can also ignore all major, minor, or patch releases for a dependency by adding an ignore condition with the desired update_types to your config file.

If you change your mind, just re-open this PR and I'll resolve any conflicts on it.

@cristiangirlea
cristiangirlea deleted the dependabot/pip/tokenizers-0.23.3 branch October 26, 2026 15:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

dependencies Pull requests that update a dependency file python Pull requests that update python code

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant