CycloneDX/cdx1-mlx

PREVIEW RELEASE

Testing with LM Studio

Use LM Studio to download and test this model. Search for CycloneDX/cdx1-mlx (Full version) or CycloneDX/cdx1-mlx-8bit (Recommended).

Use the below configurations:

System Prompt: `You are a helpful assistant to the user.` Use Prompt [Template](https://lmstudio.ai/docs/advanced/prompt-template).
Temperature: 0.05
Max tokens: 8192 or 16000
Context length: 16000

Testing with mlx

Install miniconda or Python 3.11

conda create --name cdx1-mlx python=3.11
conda activate cdx1-mlx
pip install mlx

LLM Inference from the CLI.

mlx_lm.generate --model CycloneDX/cdx1-mlx --system-prompt "You are a helpful assistant to the user." --prompt "tell me about cdxgen" --temp 0.05

Use the 8 bit version for better speed and performance.

mlx_lm.generate --model CycloneDX/cdx1-mlx-8bit --system-prompt "You are a helpful assistant to the user." --prompt "tell me about cdxgen" --temp 0.05