test_tokenizer_issue / checkpoint-16

1 contributor

History: 1 commit

TokenBender

Upload folder using huggingface_hub

8cada09 verified 11 months ago

README.md

5.12 kB

Upload folder using huggingface_hub 11 months ago
adapter_config.json

724 Bytes

Upload folder using huggingface_hub 11 months ago
adapter_model.safetensors

313 MB
LFS

Upload folder using huggingface_hub 11 months ago
optimizer.pt
Detected Pickle imports (4)
- "torch._utils._rebuild_tensor_v2",
- "torch.FloatStorage",
- "torch.BFloat16Storage",
- "collections.OrderedDict"
What is a pickle import?
101 MB
LFS

Upload folder using huggingface_hub 11 months ago
rng_state.pth
Detected Pickle imports (7)
- "numpy.ndarray",
- "_codecs.encode",
- "numpy.dtype",
- "torch._utils._rebuild_tensor_v2",
- "torch.ByteStorage",
- "numpy.core.multiarray._reconstruct",
- "collections.OrderedDict"
How to fix it?
14.2 kB
LFS

Upload folder using huggingface_hub 11 months ago
scheduler.pt
Pickle imports
- No problematic imports detected
What is a pickle import?
1.06 kB
LFS

Upload folder using huggingface_hub 11 months ago
special_tokens_map.json

557 Bytes

Upload folder using huggingface_hub 11 months ago
tokenizer.json

1.84 MB

Upload folder using huggingface_hub 11 months ago
tokenizer_config.json

1.59 kB

Upload folder using huggingface_hub 11 months ago
trainer_state.json

2.67 kB

Upload folder using huggingface_hub 11 months ago
training_args.bin
Detected Pickle imports (9)
- "transformers.training_args.TrainingArguments",
- "torch.device",
- "transformers.training_args.OptimizerNames",
- "transformers.trainer_utils.HubStrategy",
- "transformers.trainer_utils.SchedulerType",
- "accelerate.state.PartialState",
- "transformers.trainer_pt_utils.AcceleratorConfig",
- "transformers.trainer_utils.IntervalStrategy",
- "accelerate.utils.dataclasses.DistributedType"
How to fix it?
4.92 kB
LFS

Upload folder using huggingface_hub 11 months ago

Detected Pickle imports (4)

Detected Pickle imports (7)

Pickle imports

Detected Pickle imports (9)