Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

pankajroark
/
llama-fp16-engine

Model card Files Files and versions
xet
Community
llama-fp16-engine
Ctrl+K
Ctrl+K
  • 1 contributor
History: 6 commits
pankajroark's picture
pankajroark
update no-quant engine
bd472e5 almost 2 years ago
  • 7b-no-quant-tp1
    update no-quant engine almost 2 years ago
  • 7b-sq-int8kv-tp1
    sq version almost 2 years ago
  • 7b-sq-int8kv-tp8
    tp8 checkpoint almost 2 years ago
  • .gitattributes
    1.56 kB
    checkpoint almost 2 years ago
  • .gitignore
    5 Bytes
    checkpoint almost 2 years ago