Skip to content

build(deps): bump github.com/huggingface/swift-transformers from 1.3.5 to 1.4.0 in /Packages/VocelloQwen3Core - #120

Closed
dependabot[bot] wants to merge 1 commit into
mainfrom
dependabot/swift/Packages/VocelloQwen3Core/github.com/huggingface/swift-transformers-1.4.0
Closed

dependabot[bot] wants to merge 1 commit into
mainfrom
dependabot/swift/Packages/VocelloQwen3Core/github.com/huggingface/swift-transformers-1.4.0

Conversation

@dependabot

@dependabot dependabot Bot commented on behalf of github Nov 9, 2026 •

Copy link
Copy Markdown
Contributor

Bumps github.com/huggingface/swift-transformers from 1.3.5 to 1.4.0.

Release notes

Sourced from github.com/huggingface/swift-transformers's releases.

1.4.0

Notes and Migration Guide

Tokenizer decoding compatibility change

The decoding cleanup policy now matches Transformers 5.7.0:

  • clean_up_tokenization_spaces defaults to false when absent from the tokenizer config.
  • BPE tokenizers skip cleanup even when that setting is true, preserving spaces around punctuation and contractions. For example, x != y now stays x != y instead of becoming x!= y.

This can change decoded text, including generated output, for existing models. Encoding and token IDs are unchanged. Affected models include Llama 3.x configurations with cleanup enabled, and tokenizers that omit the setting. Configurations with cleanup explicitly disabled retain their behavior.

To retain cleanup, set clean_up_tokenization_spaces to true in tokenizer_config.json. For BPE tokenizers, also set clean_up_tokenization_spaces_for_bpe_even_though_it_will_corrupt_output to true.

See [swift-transformers #391](huggingface/swift-transformers#391) and the related upstream Transformers change.

Regex compilation errors and throwing initialization

Tokenizers now throw TokenizerError.invalidRegex during loading when a Split pre-tokenizer or Replace normalizer/decoder regex cannot be compiled, including inside a Sequence. Previously, invalid Split patterns silently left the input unsplit, while invalid Replace patterns terminated the process. The new TokenizerError.invalidRegex includes the pattern and underlying Foundation error. Patterns accepted by upstream may still fail if their syntax is unsupported by Foundation’s regex engine.

Source compatibility: PreTokenizer.init(config:), Normalizer.init(config:), and Decoder.init(config:) now declare throws. Calls through these protocol metatypes or generic constraints (for example, T: Normalizer) must use try and handle or propagate initialization errors:

// Before
let tokenizer = T(config: config)
// After (inside a throwing function)
let tokenizer = try T(config: config)

Existing nonthrowing implementations still conform to these protocols. Ordinary AutoTokenizer.from(...) calls already require try and need no source changes. Valid Split and Replace regex patterns retain their behavior.

See [swift-transformers #407](huggingface/swift-transformers#407) and #409.

What's Changed

... (truncated)

Commits
  • 402a8a1 Update README (#421)
  • 93e4db6 BPETokenizer: faster UTF-16 decoding and merge-rank construction at load (#419)
  • 2ed057d Fuse unknown tokens in linear time (#420)
  • deaec6c fix(Tokenizers): avoid quadratic regex matching for added tokens without whit...
  • c5c58cc Use BinaryDistinctString for consistent hashing in Linux and macOS (#418)
  • 6eeed01 Fix WordPieceDecoder crash on empty input and ByteFallbackDecoder trailing by...
  • ee21658 [CI] Test offline tokenizers on Linux (#417)
  • 8ccf92b BPETokenizer: build vocab and merge strings natively to speed up load (#416)
  • 1987402 fix: flush byte fallback runs at end of input (#414)
  • 12f91a3 Allow swift-jinja 3.0 (#415)
  • Additional commits viewable in compare view

@dependabot
dependabot Bot requested a review from PowerBeef as a code owner November 9, 2026 15:09
@vercel

vercel Bot commented Nov 9, 2026 •

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated
vocello-website Ready Ready Preview Nov 21, 2026 2:08am UTC

@dependabot @github

dependabot Bot commented on behalf of github Nov 9, 2026

Copy link
Copy Markdown
Contributor Author

Labels

The following labels could not be found: backend, dependencies. Please create them before Dependabot can add them to a pull request.

Please fix the above issues or remove invalid values from dependabot.yml.

Bumps [github.com/huggingface/swift-transformers](https://github.com/huggingface/swift-transformers) from 1.3.5 to 1.4.0.
- [Release notes](https://github.com/huggingface/swift-transformers/releases)
- [Commits](huggingface/swift-transformers@1.3.5...1.4.0)

---
updated-dependencies:
- dependency-name: github.com/huggingface/swift-transformers
  dependency-version: 1.4.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
@dependabot dependabot Bot changed the title build(deps): Bump github.com/huggingface/swift-transformers from 1.3.5 to 1.4.0 in /Packages/VocelloQwen3Core build(deps): bump github.com/huggingface/swift-transformers from 1.3.5 to 1.4.0 in /Packages/VocelloQwen3Core Nov 21, 2026
@dependabot
dependabot Bot force-pushed the dependabot/swift/Packages/VocelloQwen3Core/github.com/huggingface/swift-transformers-1.4.0 branch from b7b76c5 to 352de1e Compare November 21, 2026 02:08
PowerBeef added a commit that referenced this pull request Nov 21, 2026
…CI/Dependabot hygiene (DW-04)

Why:
1. Remove design_references/ (108 files, 15.57 MB, all 100755 mode, including a retired Vocello 2.0 SKILL.md citing deleted CLAUDE.md, fictional speakers in data.js, and 34 pasted screenshots), orphaned docs media (docs/logo.png, docs/social_preview.png, docs/screenshots/vocello-ios-studio.png, docs/readme_banner_vocello.png), unchecked .tool-versions, and 6 unreferenced website/public/assets/screens/{delivery-presets,model-downloads}.{png,avif,-1040.avif} triplets (1.51 MB trimmed from Vercel deploys).
2. Reconcile docs/reference/content-rights-review.md for 3.1 / Xcode 27.2 / three hybrid artifacts, retire Group #8 (replaced by docs/readme/hero.svg), and record the recomputed Group #9 screenshot fingerprint (14 files, 368430a47505) alongside the historical a60dd20 attestation.
3. Remove the daily 05:30 UTC cron from .github/workflows/xcode-preview.yml (now workflow_dispatch-only since ci.yml runs GA xcode-27 every push), clean stale Xcode 26 comments in native-toolchain/security workflows, and set open-pull-requests-limit: 0 on exact-pin github-actions and swift ecosystems in .github/dependabot.yml (monitored weekly by swift-dependency-watch.yml).

Verified:
- ./scripts/check_project_inputs.sh --python none: 39/39 contract validators PASS (privacy scan PASS across 1,923 paths; supply-chain, public-facts, qwen3-core, roadmap, docs-index all PASS).
- scripts/dev.sh py scripts/tests/test_public_facts_contract.py scripts/tests/test_supply_chain_contract.py scripts/tests/test_contract_gate.py scripts/tests/test_qwen3_core_contract.py: 96 passed, 42 subtests passed.
- npm --prefix website run lint && test && build: Website contract PASS, 24/24 tests PASS, Rendered accessibility contract PASS, SSR/prerender build PASS.

Known limits:
Remote GitHub cleanup (closing Dependabot PRs #115/#120 and pruning stale origin/dependabot/* branches) and pushing local main commits wait for explicit maintainer authorization.
@PowerBeef

Copy link
Copy Markdown
Owner

Closing: Packages/VocelloQwen3Core exact Swift pins move only in lockstep with project.yml/COMPATIBILITY.json and benchmark review (monitored weekly by swift-dependency-watch.yml). Automated swift PRs are now disabled in .github/dependabot.yml.

@PowerBeef PowerBeef closed this Nov 21, 2026
@PowerBeef
PowerBeef deleted the dependabot/swift/Packages/VocelloQwen3Core/github.com/huggingface/swift-transformers-1.4.0 branch November 21, 2026 06:13
@dependabot @github

dependabot Bot commented on behalf of github Nov 21, 2026

Copy link
Copy Markdown
Contributor Author

OK, I won't notify you again about this release, but will get in touch when a new version is available. If you'd rather skip all updates until the next major or minor version, let me know by commenting @dependabot ignore this major version or @dependabot ignore this minor version. You can also ignore all major, minor, or patch releases for a dependency by adding an ignore condition with the desired update_types to your config file.

If you change your mind, just re-open this PR and I'll resolve any conflicts on it.

This branch was successfully deployed

1 active deployment
Preview — 352de1e5 Deployed Nov 21, 2026 by vercel[bot]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant