README.md

---
pipeline_tag: text-generation
license: apache-2.0
---

This model was exported from [ibm-granite/granite-3b-code-instruct-128k] using Optimum with the basic optimization by ONNX Runtime.

The repository owner maintains this model for use with [Transformers.js] and DirectML. The required external data format support was implemented in 3.4.0.

[ibm-granite/granite-3b-code-instruct-128k]: https://huggingface.co/ibm-granite/granite-3b-code-instruct-128k
[Transformers.js]: https://huggingface.co/docs/transformers.js/index

# Trial

This model is currently being tested as follows:

```js
import  { pipeline } from "@huggingface/transformers"

const generator = await pipeline(
  "text-generation",
  "kazssym/granite-3b-code-instruct-128k-onnx",
  {
    device: "dml",
    use_external_data_format: true,
    session_options: {
    },
  },
)
```