Nexusflow/Athene-RM 8B/70B
#394
by
Muzel
- opened
Athene 70B was/is one of my favourite models, now updated:
https://huggingface.co/Nexusflow/Athene-RM-8B
https://huggingface.co/Nexusflow/Athene-RM-70B
Many thanks in advance!
Sure, it's queued. You can watch its progress http://hf.tst.eu/status.html
mradermacher
changed discussion status to
closed
Unfortunaytely, the architecture (CustomAutoModelForSequenceClassification) is not supported by llama.cpp. At least the 8b failed already, and i suspect the 70b has the same architecture.
What a shame, but thank you for trying!