aloobun commited on
Commit
f95c008
·
verified ·
1 Parent(s): 205fcc5

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -101,7 +101,7 @@ language:
101
 
102
  # SentenceTransformer based on Model Distillation
103
 
104
- I initialize the student model by pruning the teacher model, retaining only 8 layers, in an attempt to create a lighter, faster version.
105
 
106
 
107
  - the top left graph shows how well your model's predictions match reality. Spearman correlation = 0.887
 
101
 
102
  # SentenceTransformer based on Model Distillation
103
 
104
+ In this experiment with knowledge distillation for embedding models, i retained 8 layers from the teacher model. This is an attempt to create a lighter, faster version.
105
 
106
 
107
  - the top left graph shows how well your model's predictions match reality. Spearman correlation = 0.887