Hugging Face's logo

Spaces:
Dovakiins
/
qwerrwe
Build error

App Files Community
qwerrwe / src /axolotl /prompters.py

Commit History

Phi-3 conversation format, example training script and perplexity metric (#1582)
cf64284
unverified

roborovski winglian commited on

feat: Add LLaMA-3 instruct prompt strategies for fine-tuning (#1553)
50421c8
unverified

Ram Ram winglian commited on

improve tool handling roles (#1587)
cb78a36
unverified

winglian commited on

Feat: Add sharegpt multirole (#1137)
40a88e8
unverified

Nanobit commited on

Add Glaive conversation format support (#1365)
b7d8a7d
unverified

Brian Fitzgerald winglian commited on

Standardize system prompt format for AlpacaPrompter (#1190) [skip ci]
af02430
unverified

Oleh Kuznetsov commited on

fix: remove excessive newlines in system prompt(s) for alpaca (#936)
450e04d
unverified

kallewoof commited on

various bugfixes (#856)
1470650
unverified

winglian commited on

cleanup the old multipack dataloader (#841)
1a6309c
unverified

winglian commited on

Create preprocess CLI (#785)
e50ab07
unverified

casperhansen commited on

misc sharegpt fixes (#723)
f30afe4
unverified

winglian commited on

use fastchat conversations template (#578)
e7d3e2d
unverified

winglian commited on

split completion text to sequence_len (#616)
97d3776
unverified

winglian commited on

Prompters: ShareGPT: Allow for custom system prompts
995557b

kingbri commited on

support user defined prompters, pretokenized datasets in config, local parquet, local arrow files (#348)
d2e7f27
unverified

winglian commited on

Error msg for sharegpt if conv has less than 2 msg (#379)
63fdb5a
unverified

flotos commited on

Attention mask and position id fixes for packing (#285)
2bb0b78
unverified

winglian commited on

Fix(message): Improve error message for bad format (#365)
e37d935
unverified

Nanobit commited on

Fixed pre-commit problems, fixed small bug in logging_config to handle LOG_LEVEL env var
b1f4f7a

theobjectivedad commited on

add tests and supoort for loader for sys prompt data
3a38271

winglian commited on

initial wip to get sys prompt from dataset
8d20e0a

winglian commited on

add typehints
c7dee56

winglian commited on

add new sharegpt, refactor prompt so it can be customized later, add exception if no data is processed
aac4b76

winglian commited on

Fix sharegpt prompt
25eeeeb

Nanobit commited on

Apply isort then black
37293dc

Nanobit commited on

Fix mypy typing
e9650d3

Nanobit commited on

Remove fixme disable
69722ae

Nanobit commited on

Remove disable too many arg
5658717

Nanobit commited on

Lint prompters.py
cb4f0e9

Nanobit commited on

Fix: Remove base class inherit for CompletionPrompter
9ac1884
unverified

Nanobit commited on

Update src/axolotl/prompters.py
0048202
unverified

winglian Nanobit commited on

fixes w/ example for super basic lora starter
a5d739b

winglian commited on

apply black formatting
ce34d64

winglian commited on

more qlora support
e8aacfb

winglian commited on

optionally be able to specify alpaca or chat style prompts
1d5ab84

winglian commited on

concise multiple choice and tldr summarize
1365073

winglian commited on

add alpaca multiple choice instruct dataset support
b46bc02

winglian commited on

fix prompters, especially the sharegpt prompter
5e37144

winglian commited on

black formatting
2bc1a5b

winglian commited on

Rename variable to use same convention
174b74d

Nanobit commited on

Add CompletionPrompt type
cf68153

Nanobit commited on

Jeopardy bot! (#17)
a12fb0a
unverified

winglian commited on

fix sharegpt tokenization, refactor tokenization debugging
5159d00

winglian commited on

fix sharegpt handling from hf, don't worry about loading llama if using earlier transformers release
8d43785

winglian commited on

WIP large refactor to make finetune script a little more manageable (#3)
6045345
unverified

winglian commited on

add support for alpaca reflect training (#2)
81de0ef
unverified

winglian commited on

black formatting
a6028d3

winglian commited on

make it work with pythia in the cloud
8d959a7

winglian commited on

WIP for axolotl trainer
ce24f5e

winglian commited on