Commit
•
a54ea98
1
Parent(s):
6f25b98
Update docs/architecture.md (#2)
Browse files- Update docs/architecture.md (f791133a63ad3dcc1bbbd91e2397fb5689d8d571)
Co-authored-by: Jessica López <[email protected]>
- docs/architecture.md +1 -1
docs/architecture.md
CHANGED
@@ -44,7 +44,7 @@ Mars 5 follows a two-stage AR-NAR design according to the diagram on the main pa
|
|
44 |
|
45 |
#### AR component
|
46 |
|
47 |
-
The AR model follows a Mistral-style
|
48 |
Overall, the AR and NAR model is going to predict all 8 codebook entries of the Encodec 6kbps codec.
|
49 |
The AR model design is given below:
|
50 |
|
|
|
44 |
|
45 |
#### AR component
|
46 |
|
47 |
+
The AR model follows a Mistral-style decoder-only transformer model to predict Encodec L0 codes (the lowest/most coarse level quantization codes).
|
48 |
Overall, the AR and NAR model is going to predict all 8 codebook entries of the Encodec 6kbps codec.
|
49 |
The AR model design is given below:
|
50 |
|