File size: 442 Bytes
ff0c8b1
a9043a9
ff0c8b1
 
 
 
 
 
 
 
a9043a9
7fbecab
a9043a9
 
ff0c8b1
 
 
0a1e9ce
35b0fc6
0a1e9ce
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
---
license: apache-2.0
language:
- de
- fr
- en
- ro
base_model:
- google/flan-t5-xxl
---
Original Model: https://huggingface.co/google/flan-t5-xxl/

Original Readme: https://huggingface.co/google/flan-t5-xxl/blob/main/README.md

Disclaimer: I don't claim any rights on this modell. All rights go to google.

How to use:
./llama-cli -m /path/to/file.gguf --prompt "your prompt"  --n-gpu-layers nn

nn --> numbers of layers to offload to gpu