eliebak HF staff commited on
Commit
08113ae
·
verified ·
1 Parent(s): 1f21d13

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -5
README.md CHANGED
@@ -87,19 +87,16 @@ Memory footprint: 162.87 MB
87
  >>> print(f"Memory footprint: {model.get_memory_footprint() / 1e6:.2f} MB")
88
  Memory footprint: 109.78 MB
89
  ```
90
- ### Attribution & Other Requirements
91
-
92
- The pretraining dataset of the model was filtered for permissive licenses and code with no license only. Nevertheless, the model can generate source code verbatim from the dataset. The code's license might require attribution and/or other specific requirements that must be respected. We provide a [search index](https://huggingface.co/spaces/bigcode/search-v2) that lets you search through the pretraining data to identify where the generated code came from, and apply the proper attribution to your code.
93
 
94
  # Limitations
95
 
96
- The model has been trained on source code from 600+ programming languages. The predominant language in source is English although other languages are also present. As such the model is capable to generate code snippets provided some context but the generated code is not guaranteed to work as intended. It can be inefficient, contain bugs or exploits. See [the paper](https://huggingface.co/papers/2402.19173) for an in-depth discussion of the model limitations.
97
 
98
  # Training
99
 
100
  ## Model
101
 
102
- - **Architecture:** See the blog post
103
  - **Pretraining steps:** 600k
104
  - **Pretraining tokens:** 600B
105
  - **Precision:** bfloat16
 
87
  >>> print(f"Memory footprint: {model.get_memory_footprint() / 1e6:.2f} MB")
88
  Memory footprint: 109.78 MB
89
  ```
 
 
 
90
 
91
  # Limitations
92
 
93
+ While SmolLM models have been trained on a diverse dataset including educational content and synthetic texts, they have limitations. The models primarily understand and generate content in English. They can produce text on a variety of topics, but the generated content may not always be factually accurate, logically consistent, or free from biases present in the training data. These models should be used as assistive tools rather than definitive sources of information. Users should always verify important information and critically evaluate any generated content. For a more comprehensive discussion of the models' capabilities and limitations, please refer to our full blog post.
94
 
95
  # Training
96
 
97
  ## Model
98
 
99
+ - **Architecture:** For architecture detail, see the blog post
100
  - **Pretraining steps:** 600k
101
  - **Pretraining tokens:** 600B
102
  - **Precision:** bfloat16