aws-neuron
/

optimum-neuron-cache

Model card Files Files and versions Community

optimum-neuron-cache / inference-cache-config

Commit History

Rename inference-cache-config/qwen-2.5-large.json to inference-cache-config/qwen2.5-large.json

2aa52ac
verified

dacorvo HF staff commited on 29 days ago

Create qwen-2.5-large.json

a8df9db
verified

dacorvo HF staff commited on 29 days ago

Rename inference-cache-config/qwen2.5 to inference-cache-config/qwen2.5.json

b9f1fde
verified

dacorvo HF staff commited on 29 days ago

Add qwen2.5 config for models up to 14B params

4e25bb0
verified

dacorvo HF staff commited on 29 days ago

Remove obsolete mistral variants

e60c569
verified

dacorvo HF staff commited on Sep 30, 2024

Remove obsolete llama variants

eee32f0
verified

dacorvo HF staff commited on Sep 30, 2024

Rename inference-cache-config/Llama3.1-70b.json to inference-cache-config/llama3.1-70b.json

563ba38
verified

dacorvo HF staff commited on Sep 27, 2024

Update inference-cache-config/Llama3.1-70b.json

7b0370b
verified

dacorvo HF staff commited on Sep 27, 2024

Update inference-cache-config/mistral.json

8ea3b57
verified

dacorvo HF staff commited on Sep 27, 2024

Update inference-cache-config/llama.json

d05f579
verified

dacorvo HF staff commited on Sep 26, 2024

Rename inference-cache-config/Llama3.1-70B.json to inference-cache-config/Llama3.1-70b.json

a92cfe3
verified

dacorvo HF staff commited on Sep 26, 2024

Update inference-cache-config/mixtral.json

7342c16
verified

dacorvo HF staff commited on Sep 26, 2024

Rename inference-cache-config/Llama-3.1-70B.json to inference-cache-config/Llama3.1-70B.json

b41e94c
verified

dacorvo HF staff commited on Sep 26, 2024

Create Llama-3.1-70B.json

b1279f9
verified

dacorvo HF staff commited on Sep 26, 2024

Delete inference-cache-config/llama3-8b.json

5b0b2de
verified

dacorvo HF staff commited on Sep 26, 2024

Update inference-cache-config/llama.json

0548cd2
verified

dacorvo HF staff commited on Sep 26, 2024

Delete inference-cache-config/llama2-7b-13b.json

219c5fd
verified

dacorvo HF staff commited on Sep 26, 2024

Update inference-cache-config/llama.json

afb9fe6
verified

dacorvo HF staff commited on Sep 26, 2024

Rename inference-cache-config/llama-3.1-8B.json to inference-cache-config/llama.json

14844a0
verified

dacorvo HF staff commited on Sep 26, 2024

Update inference-cache-config/mistral.json

6c4c814
verified

dacorvo HF staff commited on Sep 26, 2024

Create llama-3.1-8B.json

320841a
verified

dacorvo HF staff commited on Sep 26, 2024

Update inference-cache-config/llama3-8b.json

de9e259
verified

dacorvo HF staff commited on Sep 26, 2024

Update inference-cache-config/llama3-70b.json

5694f75
verified

dacorvo HF staff commited on Sep 26, 2024

Update inference-cache-config/stable-diffusion.json

5272eb2
verified

Jingya HF staff commited on Sep 24, 2024

Temporarily remove SD 1.5 from Runway

a74d412
verified

Jingya HF staff commited on Sep 2, 2024

Update inference-cache-config/llama-variants.json

e7179a3
verified

dacorvo HF staff commited on Jun 27, 2024

Rename inference-cache-config/llama2.json to inference-cache-config/llama2-7b-13b.json

be28bda
verified

dacorvo HF staff commited on Jun 27, 2024

Create llama2-70b.json

6fe6ee4
verified

dacorvo HF staff commited on Jun 27, 2024

Rename inference-cache-config/llama3.json to inference-cache-config/llama3-8b.json

06bc70d
verified

dacorvo HF staff commited on Jun 27, 2024

Create llama3-70b.json

2695ea9
verified

dacorvo HF staff commited on Jun 27, 2024

Create mixtral.json

57652e6
verified

dacorvo HF staff commited on Jun 6, 2024

Add more batch_size for mistral on smaller instances

545cd4d
verified

dacorvo HF staff commited on May 31, 2024

Update Mistral cached configurations

ee458f5
verified

dacorvo HF staff commited on May 31, 2024

Use princeton-nlp/Sheared-LLaMA-1.3B as a test model

695b341
verified

dacorvo HF staff commited on May 30, 2024

Remove llama2 7B config for 24 cores

17e7257
verified

dacorvo HF staff commited on May 15, 2024

Update inference-cache-config/llama3.json

5d8c4f2
verified

dacorvo HF staff commited on May 13, 2024

Update inference-cache-config/llama3.json

f5aae68
verified

dacorvo HF staff commited on Apr 20, 2024

Create llama3.json

f93cadb
verified

dacorvo HF staff commited on Apr 19, 2024

Rename inference-cache-config/llama.json to inference-cache-config/llama2.json

f06a55a
verified

dacorvo HF staff commited on Apr 19, 2024

Add more gpt2 configurations

3fbf810
verified

dacorvo HF staff commited on Apr 9, 2024

Add more llama config

2d87237
verified

dacorvo HF staff commited on Apr 9, 2024

Add Mistral-v2

20e585f
verified

dacorvo HF staff commited on Apr 9, 2024

Create stable-diffusion.json (#43)

32561fe
verified

philschmid HF staff

Jingya HF staff commited on Apr 4, 2024

Remove SalesForce embedding model

1cd13f9
verified

dacorvo HF staff commited on Mar 25, 2024

Add Zephyr to mistral variants

9164704
verified

dacorvo HF staff commited on Mar 21, 2024

Remove variants from main mistral config

ef07aca
verified

dacorvo HF staff commited on Mar 21, 2024

Add mistral most popular variants

d3983e8
verified

dacorvo HF staff commited on Mar 21, 2024

Add most popular llama variants

594abb2
verified

dacorvo HF staff commited on Mar 21, 2024

Added teknium/OpenHermes-2.5-Mistral-7B

1518247
verified

dacorvo HF staff commited on Mar 8, 2024

Added Llama-70b batch_size 4 to inference cache

593822e
verified

dacorvo HF staff commited on Mar 8, 2024