Update README.md
Browse files
README.md
CHANGED
|
@@ -57,7 +57,7 @@ MiniCPM 4 is an extremely efficient edge-side large model that has undergone eff
|
|
| 57 |
- ArkInfer -- Cross-platform Deployment System: Supports efficient deployment across multiple backend environments, providing flexible cross-platform adaptation capabilities
|
| 58 |
|
| 59 |
|
| 60 |
-
## How to Run
|
| 61 |
|
| 62 |
Here is a guide on how to run the `MiniCPM4-0.5B-mlx` model from the command line using `mlx-lm`. You can use mlx-lm to interact with the `MiniCPM4-0.5B-mlx` model directly from your command line. This is a powerful tool that allows you to quickly test and use LLMs in the MLX format.
|
| 63 |
|
|
@@ -75,6 +75,8 @@ mlx_lm.generate --model openbmb/MiniCPM4-0.5B-mlx --prompt "hello, pls tell me w
|
|
| 75 |
- `--temp`: Controls the randomness of the output. Higher temperature values (like 0.8) will produce more diverse and creative outputs, while lower values (like 0.2) will make the output more deterministic and focused. The default value is usually 0.6.
|
| 76 |
- `--seed`: Sets a random seed to ensure reproducible results.
|
| 77 |
|
|
|
|
|
|
|
| 78 |
### Example with Parameters
|
| 79 |
|
| 80 |
The following command will use a higher temperature value and limit the output length:
|
|
|
|
| 57 |
- ArkInfer -- Cross-platform Deployment System: Supports efficient deployment across multiple backend environments, providing flexible cross-platform adaptation capabilities
|
| 58 |
|
| 59 |
|
| 60 |
+
## How to Run MiniCPM4-0.5B-mlx
|
| 61 |
|
| 62 |
Here is a guide on how to run the `MiniCPM4-0.5B-mlx` model from the command line using `mlx-lm`. You can use mlx-lm to interact with the `MiniCPM4-0.5B-mlx` model directly from your command line. This is a powerful tool that allows you to quickly test and use LLMs in the MLX format.
|
| 63 |
|
|
|
|
| 75 |
- `--temp`: Controls the randomness of the output. Higher temperature values (like 0.8) will produce more diverse and creative outputs, while lower values (like 0.2) will make the output more deterministic and focused. The default value is usually 0.6.
|
| 76 |
- `--seed`: Sets a random seed to ensure reproducible results.
|
| 77 |
|
| 78 |
+
Notably, MiniCPM4-0.5B should be prompted with `bos_token`.
|
| 79 |
+
|
| 80 |
### Example with Parameters
|
| 81 |
|
| 82 |
The following command will use a higher temperature value and limit the output length:
|