Update README.md

README.md

@@ -1,3 +1,37 @@
----
-license: apache-2.0
----
+Since Huggingface has omitte to publish a standalone SmolLM2_360M_model.py to load and finetune and run inference of the released model weights at https://huggingface.co/HuggingFaceTB/SmolLM2-360M/
+I have attempte to construct a model.py that can load and at least inference mode the weights. The SmolLM2_360M_model.py runs but is unable to load the safetensors data.  Here is the encountered error:
+
+C:\Users\User\OneDrive\Desktop\SmolLM2>python SmolLM2_360M_model_debugging.py
+Warning: SentencePiece not found, using rudimentary BPE tokenizer. Install SentencePiece for better performance.
+
+A module that was compiled using NumPy 1.x cannot be run in
+NumPy 2.1.3 as it may crash. To support both 1.x and 2.x
+versions of NumPy, modules must be compiled with NumPy 2.0.
+Some module may need to rebuild instead e.g. with 'pybind11>=2.12'.
+
+If you are a user of the module, the easiest solution will be to
+downgrade to 'numpy<2' or try to upgrade the affected module.
+We expect that some modules will need time to support NumPy 2.
+
+Traceback (most recent call last):  File "C:\Users\User\OneDrive\Desktop\SmolLM2\SmolLM2_360M_model_debugging.py", line 470, in <module>
+    model = SmolLM2_360M(config_path)
+  File "C:\Users\User\OneDrive\Desktop\SmolLM2\SmolLM2_360M_model_debugging.py", line 243, in __init__
+    self.embed_tokens = nn.Embedding(self.vocab_size, self.hidden_size)
+  File "C:\Users\User\AppData\Local\Programs\Python\Python311\Lib\site-packages\torch\nn\modules\sparse.py", line 142, in __init__
+    self.weight = Parameter(torch.empty((num_embeddings, embedding_dim), **factory_kwargs),
+C:\Users\User\AppData\Local\Programs\Python\Python311\Lib\site-packages\torch\nn\modules\sparse.py:142: UserWarning: Failed to initialize NumPy: _ARRAY_API not found (Triggered internally at ..\torch\csrc\utils\tensor_numpy.cpp:84.)
+  self.weight = Parameter(torch.empty((num_embeddings, embedding_dim), **factory_kwargs),
+An error occurred while loading weights: File does not contain tensor lm_head.weight
+
+C:\Users\User\OneDrive\Desktop\SmolLM2>
+
+So, what is the story with safetensors "File does not contain tensor lm_head.weight"
+
+Is there a python script for inspecting the safetensors file?
+
+Why does model.safetensors file "not contain tensor lm_head.weight"?
+
+
+---
+license: apache-2.0
+---