Ctrl+K

1 contributor

History: 3 commits

sonquoctran

Upload tokenizer

4f66364 verified 10 months ago

.gitattributes

1.52 kB

initial commit 10 months ago
README.md

5.17 kB

Upload tokenizer 10 months ago
config.json

770 Bytes

Upload folder using huggingface_hub 10 months ago
merges.txt

456 kB

Upload tokenizer 10 months ago
optimizer.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.FloatStorage"
What is a pickle import?
997 MB
xet

Upload folder using huggingface_hub 10 months ago
pytorch_model.bin
Detected Pickle imports (4)
- "torch.FloatStorage",
- "torch.LongStorage",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict"
What is a pickle import?
499 MB
xet

Upload folder using huggingface_hub 10 months ago
rng_state.pth
Detected Pickle imports (7)
- "_codecs.encode",
- "torch._utils._rebuild_tensor_v2",
- "torch.ByteStorage",
- "numpy.core.multiarray._reconstruct",
- "numpy.dtype",
- "numpy.ndarray",
- "collections.OrderedDict"
How to fix it?
14.1 kB
xet

Upload folder using huggingface_hub 10 months ago
scheduler.pt
Pickle imports
- No problematic imports detected
What is a pickle import?
326 Bytes
xet

Upload folder using huggingface_hub 10 months ago
special_tokens_map.json

964 Bytes

Upload tokenizer 10 months ago
tokenizer.json

2.11 MB

Upload tokenizer 10 months ago
tokenizer_config.json

1.28 kB

Upload tokenizer 10 months ago
trainer_state.json

248 kB

Upload folder using huggingface_hub 10 months ago
training_args.bin
Detected Pickle imports (4)
- "transformers.trainer_utils.IntervalStrategy",
- "transformers.trainer_utils.SchedulerType",
- "torch.device",
- "transformers.training_args.TrainingArguments"
How to fix it?
2.46 kB
xet

Upload folder using huggingface_hub 10 months ago
vocab.json

798 kB

Upload folder using huggingface_hub 10 months ago

Detected Pickle imports (3)

Detected Pickle imports (4)

Detected Pickle imports (7)

Pickle imports

Detected Pickle imports (4)