AI & ML interests

Artificial General Intelligence, Small Models Capabilities Improvements, Small Models Reasoning Improvements, Multimodal Models, Consumer-Grade GPUs, Preference alignment, Supervised fine-tuning

Recent Activity

kaykyramos  updated a model about 12 hours ago
orion-research/Qwen2-VL-2B-LM-Only
kaykyramos  updated a dataset 1 day ago
orion-research/Depth-Pretrain
kaykyramos  updated a model 1 day ago
orion-research/QvQ-1B-Preview
View all activity

Our models are used custom training libraries and our Mini GPU Cluster for training.

Model Capabilities Size Context Length License
Aura-v2 (General Intelligence) Text, Vision (Image, Video), Audio, Speech, Memory, API Handler and Self Improvement 10B 262.144 (256K) Private
Aura (General Intelligence) Text, Vision (Image, Video), Audio, Speech, Memory, API Handler and Self Improvement 40B 262.144 (256K) Private
Aura-T3 (Llama 3 based) Text, (For translations en => pt_BR) 8B 8192 Apache
AuraVision Text, Vision 8B 8192 Apache

We Are Green

We emit ZER0 CO2: Orion Research has it's own Solar Usine based on Conceição do Coité - BA - Brazil

Contact

For additional questions, contact [email protected].