Spaces:
Running
Running
| title: Phi-3.5 WebGPU | |
| emoji: ⚡ | |
| colorFrom: yellow | |
| colorTo: red | |
| sdk: static | |
| pinned: false | |
| license: apache-2.0 | |
| models: | |
| - onnx-community/Phi-3.5-mini-instruct-onnx-web | |
| short_description: A powerful AI chatbot that runs locally in your browser | |
| thumbnail: https://huggingface.co/spaces/webml-community/phi-3.5-webgpu/resolve/main/banner.png | |
| # Phi-3.5 WebGPU | |
| A simple React + Vite application for running [Phi-3.5-mini-instruct](https://huggingface.co/onnx-community/Phi-3.5-mini-instruct-onnx-web), a powerful small language model, locally in the browser using Transformers.js and WebGPU-acceleration. | |
| ## Getting Started | |
| Follow the steps below to set up and run the application. | |
| ### 1. Clone the Repository | |
| Clone the examples repository from GitHub: | |
| ```sh | |
| git clone https://github.com/huggingface/transformers.js-examples.git | |
| ``` | |
| ### 2. Navigate to the Project Directory | |
| Change your working directory to the `smollm-webgpu` folder: | |
| ```sh | |
| cd transformers.js-examples/smollm-webgpu | |
| ``` | |
| ### 3. Install Dependencies | |
| Install the necessary dependencies using npm: | |
| ```sh | |
| npm i | |
| ``` | |
| ### 4. Run the Development Server | |
| Start the development server: | |
| ```sh | |
| npm run dev | |
| ``` | |
| The application should now be running locally. Open your browser and go to `http://localhost:5173` to see it in action. | |