metadata
license: apache-2.0
datasets:
- CycloneDX/cdx-docs
language:
- en
base_model:
- unsloth/phi-4
library_name: mlx
tags:
- cyclonedx
- cdxgen
- sbom
- security
- purl
- obom
- ml-bom
- cbom
PREVIEW RELEASE
Testing with LM Studio
Use LM Studio to download and test this model. Search for CycloneDX/cdx1-mlx (Full version) or CycloneDX/cdx1-mlx-8bit (Recommended).
Use the below configurations:
System Prompt: `You are a helpful assistant to the user.` Use Prompt [Template](https://lmstudio.ai/docs/advanced/prompt-template).
Temperature: 0.05
Max tokens: 8192 or 16000
Context length: 16000
Testing with mlx
Install miniconda or Python 3.11
conda create --name cdx1-mlx python=3.11
conda activate cdx1-mlx
pip install mlx
LLM Inference from the CLI.
mlx_lm.generate --model CycloneDX/cdx1-mlx --system-prompt "You are a helpful assistant to the user." --prompt "tell me about cdxgen" --temp 0.05
Use the 8 bit version for better speed and performance.
mlx_lm.generate --model CycloneDX/cdx1-mlx-8bit --system-prompt "You are a helpful assistant to the user." --prompt "tell me about cdxgen" --temp 0.05