---
title: README
emoji: 🏢
colorFrom: blue
colorTo: green
sdk: static
pinned: true
tags:
- fine-tuning
- inference
- function calling
- quantization
---
*last updated Dec 6th 2024*
## About
[Trelis Research](https://Trelis.com) provides:
- Advanced LLM fine-tuning scripts.
- Advanced LLM inference guides.
- Advanced vision fine-tuning scripts.
- Advanced voice/transcription fine-tuning scripts.
- One click LLM API templates
- Function-calling models.

## ADVANCED Fine-tuning Scripts

[Get access here](https://trelis.com/advanced-fine-tuning-scripts/)

- retrieval (bm25, similarity, re-rankers)
- wikipedia fine-tuning and dataset creation
- ReFT fine-tuning
- multi-gpu fine-tuning
- orpo fine-tuning
- memorization fine-tuning
- mamba-fine-tune
- DPO fine-tuning
- chat-fine-tuning
- function-calling fine-tuning
- long-context fine-tuning
- quantization
- supervised-fine-tuning
- unsupervised-fine-tuning

## ADVANCED Inference

[Get access here](https://trelis.com/enterprise-server-api-and-inference-guide/)

- Server setup, API setup and inference guide for open source models
- Inference for function calling
- Monte Carlo Inference Methods
- Private Data Redaction
- Structured Data Extraction with LLMs
- Verified RAG citations

## ADVANCED Vision Fine-tuning

[Get access here](https://trelis.com/advanced-vision/)

- Dataset Preparation
- Fine-tuning Llava, IDEFICS2

## ADVANCED Transcription and Voice Cloning

[Get access here](https://trelis.com/advanced-transcription/)

- Dataset Generation
- Fine-tuning Whisper speech-to-text on custom datasets
- Voice Cloning Fine-tuning / Text-to-Speech

## One-click LLM API/Server Templates
- Check out the full list [here](https://github.com/TrelisResearch/one-click-llms)

## Function-calling Models and Datasets

[Get access here](https://trelis.com/function-calling/)

- Fine-tuned models for function calling - from 1.3B to 70B in size, incl. Mixtral, Yi, Deepseek, Llama and more. [Collection here](https://huggingface.co/collections/Trelis/function-calling-v3-657199ecbe378693925c7915)
- Dataset to fine-tune models for function calling. [Access here](https://huggingface.co/datasets/Trelis/function_calling_v3)
- Scripts to fine-tune models for function calling and structured responses.