Update README.md
Browse files
README.md
CHANGED
@@ -74,9 +74,10 @@ Note: BF16 is currently only supported on CPU.
|
|
74 |
## Hardware Choices (LLaMA3 70B Specific)
|
75 |
|
76 |
Any Macbook with 32GB should be able to run
|
77 |
-
Meta-Llama-3-70B-Instruct.Q2\_K.llamafile reasonably well
|
78 |
-
lowliest of quantization levels, llama3
|
79 |
-
math riddles, but you should expect more
|
|
|
80 |
|
81 |
If you want to run Q4\_0 you'll probably be able to squeeze it on a
|
82 |
$3,999.00 Macbook Pro M3 Max w/ 48GB of RAM.
|
|
|
74 |
## Hardware Choices (LLaMA3 70B Specific)
|
75 |
|
76 |
Any Macbook with 32GB should be able to run
|
77 |
+
Meta-Llama-3-70B-Instruct.Q2\_K.llamafile reasonably well, if you close
|
78 |
+
all your browser tabs. At this lowliest of quantization levels, llama3
|
79 |
+
is still smart enough to solve math riddles, but you should expect more
|
80 |
+
hallucinations than usual.
|
81 |
|
82 |
If you want to run Q4\_0 you'll probably be able to squeeze it on a
|
83 |
$3,999.00 Macbook Pro M3 Max w/ 48GB of RAM.
|