ksyang commited on
Commit
84c42ed
·
verified ·
1 Parent(s): f970dfd

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -1
README.md CHANGED
@@ -4,11 +4,13 @@ license: apache-2.0
4
 
5
  # **GeM2-Llamion-14B**
6
 
 
 
7
  We have released **Llamion** as **GeM 2.0**, the second series of generative models developed by VAIV Company to address the our principal business needs.
8
 
9
  **Llamion** (Llamafied Orion) is derived from transforming the [Orion model](https://huggingface.co/OrionStarAI/Orion-14B-Base)
10
  into [the standard LLaMA architecture](https://github.com/huggingface/transformers/blob/main/src/transformers/models/llama/modeling_llama.py)
11
- through parameter mapping and offline distillation. More details will be available in our upcoming paper, which will be accessible on this page.
12
 
13
  <!-- Note that this model has NOT been contaminated to artificially inflate its scores for the Open LLM Leaderboards,
14
  unlike some recent models which have been intentionally tainted. -->
 
4
 
5
  # **GeM2-Llamion-14B**
6
 
7
+ This repository is the replica of [Llamion-14B](vaiv/llamion-14b-base).
8
+
9
  We have released **Llamion** as **GeM 2.0**, the second series of generative models developed by VAIV Company to address the our principal business needs.
10
 
11
  **Llamion** (Llamafied Orion) is derived from transforming the [Orion model](https://huggingface.co/OrionStarAI/Orion-14B-Base)
12
  into [the standard LLaMA architecture](https://github.com/huggingface/transformers/blob/main/src/transformers/models/llama/modeling_llama.py)
13
+ through parameter mapping and offline distillation.
14
 
15
  <!-- Note that this model has NOT been contaminated to artificially inflate its scores for the Open LLM Leaderboards,
16
  unlike some recent models which have been intentionally tainted. -->