Skip to content

Tags: fabiustech/tokenizer

Tags

v0.1.2

Toggle v0.1.2's commit message 
fix

v0.1.1

Toggle v0.1.1's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Verified
Learn about vigilant mode 
Merge pull request #1 from fabiustech/draft/use-go-embed

Use go:embed for pretrained gpt2 tokenizer, add missing json