| ```python | |
| # Modello Italia inference script and model | |
| # Copyright 2024 iGenius | |
| # | |
| # Licensed under the MIT License (see LICENSE-MIT). | |
| # This code also contains code from the original project licensed under the Apache License 2.0 (see LICENSE-APACHE). | |
| # This script contains modifications of the original code from Lightning AI. | |
| ``` | |
| ### Instructions | |
| 1. First, move the model and the tokenizer from `/modello_italia_9b` to the current directory, or ensure that the path is correctly specified. | |
| 2. Install dependencies by running the following command in the terminal: | |
| ```terminal | |
| pip install -r requirements.txt | |
| ``` | |
| 3. To run the generation, use the following command: | |
| ```terminal | |
| python generate.py --checkpoint_dir <model_path> --max_new_tokens 500 --temperature 0.2 --prompt "Ciao, chi sei?" | |
| ``` |