Update README.md
Browse files
README.md
CHANGED
@@ -73,11 +73,11 @@ Note: BF16 is currently only supported on CPU.
|
|
73 |
|
74 |
## Hardware Choices (LLaMA3 70B Specific)
|
75 |
|
76 |
-
Any
|
77 |
-
Meta-Llama-3-70B-Instruct.Q2\_K.llamafile reasonably well,
|
78 |
-
all your browser tabs. At this lowliest of quantization levels,
|
79 |
-
is still smart enough to solve math riddles, but you should
|
80 |
-
hallucinations than usual.
|
81 |
|
82 |
If you want to run Q4\_0 you'll probably be able to squeeze it on a
|
83 |
$3,999.00 Macbook Pro M3 Max w/ 48GB of RAM.
|
|
|
73 |
|
74 |
## Hardware Choices (LLaMA3 70B Specific)
|
75 |
|
76 |
+
Any Macbook with a Metal GPU and 32GB should in theory be able to run
|
77 |
+
Meta-Llama-3-70B-Instruct.Q2\_K.llamafile reasonably well, provided you
|
78 |
+
close all your browser tabs. At this lowliest of quantization levels,
|
79 |
+
llama3 is still smart enough to solve math riddles, but you should
|
80 |
+
expect more hallucinations than usual.
|
81 |
|
82 |
If you want to run Q4\_0 you'll probably be able to squeeze it on a
|
83 |
$3,999.00 Macbook Pro M3 Max w/ 48GB of RAM.
|