Update README.md
Browse files
README.md
CHANGED
@@ -1,5 +1,5 @@
|
|
1 |
-
Since Huggingface has
|
2 |
-
I have
|
3 |
|
4 |
C:\Users\User\OneDrive\Desktop\SmolLM2>python SmolLM2_360M_model_debugging.py
|
5 |
Warning: SentencePiece not found, using rudimentary BPE tokenizer. Install SentencePiece for better performance.
|
|
|
1 |
+
Since Huggingface has omitted to publish a standalone pytorch SmolLM2_360M_model.py to load and finetune and run inference of the released model weights and config at https://huggingface.co/HuggingFaceTB/SmolLM2-360M/
|
2 |
+
I have attempted to construct a model.py that can load and at least do inference mode using the published weights and config. One a functioning pytorch model.py is built, it may be possible to export a torchscript version of the SmolLM2 model that can be implemented on non-python hardware such as MPUs or Risc machines or Smartphones, in edge devices. The SmolLM2_360M_model.py runs but is unable to load the safetensors data. Here is the encountered error:
|
3 |
|
4 |
C:\Users\User\OneDrive\Desktop\SmolLM2>python SmolLM2_360M_model_debugging.py
|
5 |
Warning: SentencePiece not found, using rudimentary BPE tokenizer. Install SentencePiece for better performance.
|