Skip to content

Validate tokenizer compatibility in Gemma4Sampler - #787

Open
sylvesterkaczmarek wants to merge 2 commits into
google-deepmind:mainfrom
sylvesterkaczmarek:fix/gemma4-sampler-tokenizer-validation
Open

Validate tokenizer compatibility in Gemma4Sampler#787
sylvesterkaczmarek wants to merge 2 commits into
google-deepmind:mainfrom
sylvesterkaczmarek:fix/gemma4-sampler-tokenizer-validation

test: cover Gemma4Sampler tokenizer mismatch

daed36e
Select commit
Loading
Failed to load commit list.
Google CLA / cla/google succeeded Aug 31, 2026 in 1s

✅ All contributors are covered under a CLA with Google

See https://cla.developers.google.com/ for more info about Google's Contributor License Agreement (CLA).

ℹ️ Googlers: Go here to view more details and manage scans for this pull request.

Details

The following contributors were found for this pull request:

daed36e Author: @sylvesterkaczmarek <16242628+sylvesterkaczmarek​@users.noreply.github.com>

(Only the first commit for a unique contributor is listed.)