Update README.md
Browse files
README.md
CHANGED
@@ -73,11 +73,11 @@ Note: BF16 is currently only supported on CPU.
|
|
73 |
|
74 |
## Hardware Choices (LLaMA3 70B Specific)
|
75 |
|
76 |
-
Any Macbook with a Metal GPU and 32GB should in theory be able to
|
77 |
-
Meta-Llama-3-70B-Instruct.Q2\_K.llamafile reasonably well, provided
|
78 |
-
close all your browser tabs. At this lowliest of quantization
|
79 |
-
llama3 is still smart enough to solve math riddles, but you
|
80 |
-
expect more hallucinations than usual.
|
81 |
|
82 |
If you want to run Q4\_0 you'll probably be able to squeeze it on a
|
83 |
$3,999.00 Macbook Pro M3 Max w/ 48GB of RAM.
|
|
|
73 |
|
74 |
## Hardware Choices (LLaMA3 70B Specific)
|
75 |
|
76 |
+
Any Macbook with a Metal GPU and 32GB of RAM should in theory be able to
|
77 |
+
run Meta-Llama-3-70B-Instruct.Q2\_K.llamafile reasonably well, provided
|
78 |
+
you close all your browser tabs. At this lowliest of quantization
|
79 |
+
levels, llama3 is still smart enough to solve math riddles, but you
|
80 |
+
should expect more hallucinations than usual.
|
81 |
|
82 |
If you want to run Q4\_0 you'll probably be able to squeeze it on a
|
83 |
$3,999.00 Macbook Pro M3 Max w/ 48GB of RAM.
|