Skip to content

Report truncated_tokens_count in tokens on the transformers backend - #1435

Open
isHeSatoshi wants to merge 1 commit into
huggingface:mainfrom
isHeSatoshi:fix/greedy-until-truncated-token-count
Open

isHeSatoshi wants to merge 1 commit into
huggingface:mainfrom
isHeSatoshi:fix/greedy-until-truncated-token-count

Report truncated_tokens_count in tokens on the transformers backend

14dff72
Select commit
Loading
Failed to load commit list.