FoundationVision
/

unitok_tokenizer

Feature Extraction

Model card Files Files and versions Community

unitok_tokenizer

Ctrl+K

Ctrl+K

3 contributors

History: 2 commits

machuofan

init

d013ff3 5 months ago

external
init 5 months ago
.gitattributes

1.52 kB

initial commit 5 months ago
README.md

31 Bytes

initial commit 5 months ago
unitok_tokenizer.pth
Detected Pickle imports (4)
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.FloatStorage",
- "torch.bfloat16"
How to fix it?
9.93 GB
LFS

init 5 months ago