Collections

First Prototype of the second iteration of MoLora utilizing mixture of expert techniques applied to the Llama2 model.

Model assets for the first Mixture-of-Lora technique applied to Llama. https://bit.ly/48bqshl