any plans for mixtral 128k?

#17

by sirus - opened Feb 21, 2024

Feb 21, 2024

Are there any plans to do this for mixtral? also with llama-cpp would 512GB of ram work for cpu inference or would I have to spend another $800 to move up to 1TB?

Thanks

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Your need to confirm your account before you can post a new comment.

· Sign up or log in to comment