metadata

inference: true
tags:
  - text-generation-inference
  - SFNR-LLM
  - sofanor
model-index:
  - name: sofanor-7b
    results: []
license: mit
language:
  - en
  - ru
  - fr
metrics:
  - accuracy
pipeline_tag: text-generation

SFNR LLM

Model Description

Developed by: Sofanor AI
Funded by: OpenSkyML
Model type: text-generation
Language(s): English, Russian, French
License: Mit

Model Sources

Repository: on HF.co
Demo: on HF.co

How to Get Started with the Model

Use the code below to get started with the model.

Run install module command:
```
pip install requests
```

Paste this code:

import requests

HF_READ_TOKEN = "hf_token" # Use yor read-token, it is free

API_URL = "https://api-inference.huggingface.co/models/sofanorai/sofanor-7b"
headers = {"Authorization": f"Bearer {HF_READ_TOKEN}"}

def query(payload):
  response = requests.post(API_URL, headers=headers, json=payload)
  return response.json()
 
output = query({
"inputs": "Can you please let us know more details about your ",
})

Run with Python:
```
python your_file.py
```

Environmental Impact

Carbon emissions can be estimated using the Machine Learning Impact calculator presented in Lacoste et al. (2019).

Hardware Type: GPU
Compute Region: USA