|
--- |
|
library_name: transformers |
|
pipeline_tag: text-generation |
|
language: |
|
- ar |
|
--- |
|
|
|
# 1p46G-gemma-fp-dedup-rehydr-ar-350BT-seed-6/transformers/134000 |
|
|
|
Tokenizer: `google/gemma-7b` |
|
|
|
```python |
|
from transformers import AutoTokenizer, AutoModelForCausalLM |
|
# Initialize model and tokenizer |
|
TEST_PROMPT = "الزرادشتية هي ديانة انتشرت في بلاد" |
|
save_path = "nouamanetazi/hf-ar-134000" |
|
tokenizer = AutoTokenizer.from_pretrained(save_path) |
|
input_ids = tokenizer(TEST_PROMPT, return_tensors="pt")["input_ids"].cuda() # google/gemma-7b |
|
print("Input prompt:", tokenizer.batch_decode(input_ids)[0]) |
|
|
|
model = AutoModelForCausalLM.from_pretrained(save_path, device="cuda", dtype=torch.bfloat16) |
|
outputs = model.generate(input_ids, max_new_tokens=100) |
|
print("Generated text:", tokenizer.batch_decode(outputs)[0]) |
|
``` |
|
|
