Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
pico-lm
/
pico-decoder-tiny
like
1
Follow
Pico Language Model
40
Text Generation
Safetensors
pico-lm/pretokenized-dolma
English
pico
custom_code
License:
apache-2.0
Model card
Files
Files and versions
Community
1
main
pico-decoder-tiny
/
fabric_state
/
checkpoint
Ctrl+K
Ctrl+K
1 contributor
History:
1 commit
rdiehlmartinez
pico-decoder-tiny-1 trained to 50k steps
d114a5e
8 days ago
bf16_zero_pp_rank_0_mp_rank_00_optim_states.pt
pickle
Detected Pickle imports (6)
"deepspeed.runtime.fp16.loss_scaler.LossScaler"
,
"deepspeed.utils.tensor_fragment.fragment_address"
,
"deepspeed.runtime.zero.config.ZeroStageEnum"
,
"torch.FloatStorage"
,
"collections.OrderedDict"
,
"torch._utils._rebuild_tensor_v2"
How to fix it?
8.47 MB
LFS
pico-decoder-tiny-1 trained to 50k steps
8 days ago
bf16_zero_pp_rank_10_mp_rank_00_optim_states.pt
pickle
Detected Pickle imports (6)
"deepspeed.runtime.fp16.loss_scaler.LossScaler"
,
"deepspeed.utils.tensor_fragment.fragment_address"
,
"deepspeed.runtime.zero.config.ZeroStageEnum"
,
"torch.FloatStorage"
,
"collections.OrderedDict"
,
"torch._utils._rebuild_tensor_v2"
How to fix it?
8.47 MB
LFS
pico-decoder-tiny-1 trained to 50k steps
8 days ago
bf16_zero_pp_rank_11_mp_rank_00_optim_states.pt
pickle
Detected Pickle imports (6)
"deepspeed.runtime.fp16.loss_scaler.LossScaler"
,
"deepspeed.utils.tensor_fragment.fragment_address"
,
"deepspeed.runtime.zero.config.ZeroStageEnum"
,
"torch.FloatStorage"
,
"collections.OrderedDict"
,
"torch._utils._rebuild_tensor_v2"
How to fix it?
8.47 MB
LFS
pico-decoder-tiny-1 trained to 50k steps
8 days ago
bf16_zero_pp_rank_12_mp_rank_00_optim_states.pt
pickle
Detected Pickle imports (6)
"deepspeed.runtime.fp16.loss_scaler.LossScaler"
,
"deepspeed.utils.tensor_fragment.fragment_address"
,
"deepspeed.runtime.zero.config.ZeroStageEnum"
,
"torch.FloatStorage"
,
"collections.OrderedDict"
,
"torch._utils._rebuild_tensor_v2"
How to fix it?
8.47 MB
LFS
pico-decoder-tiny-1 trained to 50k steps
8 days ago
bf16_zero_pp_rank_13_mp_rank_00_optim_states.pt
pickle
Detected Pickle imports (6)
"deepspeed.runtime.fp16.loss_scaler.LossScaler"
,
"deepspeed.utils.tensor_fragment.fragment_address"
,
"deepspeed.runtime.zero.config.ZeroStageEnum"
,
"torch.FloatStorage"
,
"collections.OrderedDict"
,
"torch._utils._rebuild_tensor_v2"
How to fix it?
8.47 MB
LFS
pico-decoder-tiny-1 trained to 50k steps
8 days ago
bf16_zero_pp_rank_14_mp_rank_00_optim_states.pt
pickle
Detected Pickle imports (6)
"deepspeed.runtime.fp16.loss_scaler.LossScaler"
,
"deepspeed.utils.tensor_fragment.fragment_address"
,
"deepspeed.runtime.zero.config.ZeroStageEnum"
,
"torch.FloatStorage"
,
"collections.OrderedDict"
,
"torch._utils._rebuild_tensor_v2"
How to fix it?
8.47 MB
LFS
pico-decoder-tiny-1 trained to 50k steps
8 days ago
bf16_zero_pp_rank_15_mp_rank_00_optim_states.pt
pickle
Detected Pickle imports (6)
"deepspeed.runtime.fp16.loss_scaler.LossScaler"
,
"deepspeed.utils.tensor_fragment.fragment_address"
,
"deepspeed.runtime.zero.config.ZeroStageEnum"
,
"torch.FloatStorage"
,
"collections.OrderedDict"
,
"torch._utils._rebuild_tensor_v2"
How to fix it?
8.47 MB
LFS
pico-decoder-tiny-1 trained to 50k steps
8 days ago
bf16_zero_pp_rank_1_mp_rank_00_optim_states.pt
pickle
Detected Pickle imports (6)
"deepspeed.runtime.fp16.loss_scaler.LossScaler"
,
"deepspeed.utils.tensor_fragment.fragment_address"
,
"deepspeed.runtime.zero.config.ZeroStageEnum"
,
"torch.FloatStorage"
,
"collections.OrderedDict"
,
"torch._utils._rebuild_tensor_v2"
How to fix it?
8.47 MB
LFS
pico-decoder-tiny-1 trained to 50k steps
8 days ago
bf16_zero_pp_rank_2_mp_rank_00_optim_states.pt
pickle
Detected Pickle imports (6)
"deepspeed.runtime.fp16.loss_scaler.LossScaler"
,
"deepspeed.utils.tensor_fragment.fragment_address"
,
"deepspeed.runtime.zero.config.ZeroStageEnum"
,
"torch.FloatStorage"
,
"collections.OrderedDict"
,
"torch._utils._rebuild_tensor_v2"
How to fix it?
8.47 MB
LFS
pico-decoder-tiny-1 trained to 50k steps
8 days ago
bf16_zero_pp_rank_3_mp_rank_00_optim_states.pt
pickle
Detected Pickle imports (6)
"deepspeed.runtime.fp16.loss_scaler.LossScaler"
,
"deepspeed.utils.tensor_fragment.fragment_address"
,
"deepspeed.runtime.zero.config.ZeroStageEnum"
,
"torch.FloatStorage"
,
"collections.OrderedDict"
,
"torch._utils._rebuild_tensor_v2"
How to fix it?
8.47 MB
LFS
pico-decoder-tiny-1 trained to 50k steps
8 days ago
bf16_zero_pp_rank_4_mp_rank_00_optim_states.pt
pickle
Detected Pickle imports (6)
"deepspeed.runtime.fp16.loss_scaler.LossScaler"
,
"deepspeed.utils.tensor_fragment.fragment_address"
,
"deepspeed.runtime.zero.config.ZeroStageEnum"
,
"torch.FloatStorage"
,
"collections.OrderedDict"
,
"torch._utils._rebuild_tensor_v2"
How to fix it?
8.47 MB
LFS
pico-decoder-tiny-1 trained to 50k steps
8 days ago
bf16_zero_pp_rank_5_mp_rank_00_optim_states.pt
pickle
Detected Pickle imports (6)
"deepspeed.runtime.fp16.loss_scaler.LossScaler"
,
"deepspeed.utils.tensor_fragment.fragment_address"
,
"deepspeed.runtime.zero.config.ZeroStageEnum"
,
"torch.FloatStorage"
,
"collections.OrderedDict"
,
"torch._utils._rebuild_tensor_v2"
How to fix it?
8.47 MB
LFS
pico-decoder-tiny-1 trained to 50k steps
8 days ago
bf16_zero_pp_rank_6_mp_rank_00_optim_states.pt
pickle
Detected Pickle imports (6)
"deepspeed.runtime.fp16.loss_scaler.LossScaler"
,
"deepspeed.utils.tensor_fragment.fragment_address"
,
"deepspeed.runtime.zero.config.ZeroStageEnum"
,
"torch.FloatStorage"
,
"collections.OrderedDict"
,
"torch._utils._rebuild_tensor_v2"
How to fix it?
8.47 MB
LFS
pico-decoder-tiny-1 trained to 50k steps
8 days ago
bf16_zero_pp_rank_7_mp_rank_00_optim_states.pt
pickle
Detected Pickle imports (6)
"deepspeed.runtime.fp16.loss_scaler.LossScaler"
,
"deepspeed.utils.tensor_fragment.fragment_address"
,
"deepspeed.runtime.zero.config.ZeroStageEnum"
,
"torch.FloatStorage"
,
"collections.OrderedDict"
,
"torch._utils._rebuild_tensor_v2"
How to fix it?
8.47 MB
LFS
pico-decoder-tiny-1 trained to 50k steps
8 days ago
bf16_zero_pp_rank_8_mp_rank_00_optim_states.pt
pickle
Detected Pickle imports (6)
"deepspeed.runtime.fp16.loss_scaler.LossScaler"
,
"deepspeed.utils.tensor_fragment.fragment_address"
,
"deepspeed.runtime.zero.config.ZeroStageEnum"
,
"torch.FloatStorage"
,
"collections.OrderedDict"
,
"torch._utils._rebuild_tensor_v2"
How to fix it?
8.47 MB
LFS
pico-decoder-tiny-1 trained to 50k steps
8 days ago
bf16_zero_pp_rank_9_mp_rank_00_optim_states.pt
pickle
Detected Pickle imports (6)
"deepspeed.runtime.fp16.loss_scaler.LossScaler"
,
"deepspeed.utils.tensor_fragment.fragment_address"
,
"deepspeed.runtime.zero.config.ZeroStageEnum"
,
"torch.FloatStorage"
,
"collections.OrderedDict"
,
"torch._utils._rebuild_tensor_v2"
How to fix it?
8.47 MB
LFS
pico-decoder-tiny-1 trained to 50k steps
8 days ago
mp_rank_00_model_states.pt
pickle
Detected Pickle imports (5)
"torch.BFloat16Storage"
,
"torch.Size"
,
"__builtin__.set"
,
"torch._utils._rebuild_tensor_v2"
,
"collections.OrderedDict"
How to fix it?
22.6 MB
LFS
pico-decoder-tiny-1 trained to 50k steps
8 days ago
