Skip to content

refactor: remove redundant modelMaxLength and expose token arrays

426cea0
Select commit
Loading
Failed to load commit list.
Merged

Refactor Tokenizer properties and visibility #5

refactor: remove redundant modelMaxLength and expose token arrays
426cea0
Select commit
Loading
Failed to load commit list.