Hareshirfan commited on
Commit
0d277bc
·
verified ·
1 Parent(s): 7234408

Delete README.md

Browse files

Make a cartoon videos

Files changed (1) hide show
  1. README.md +0 -57
README.md DELETED
@@ -1,57 +0,0 @@
1
- ---
2
- '[object Object]': null
3
- license: llama3.1
4
- language:
5
- - de
6
- base_model:
7
- - spacy/de_core_news_lg
8
- - meta-llama/Llama-3.1-8B-Instruct
9
- ---
10
-
11
- ### Model Description
12
-
13
- This is a spaCy model fine-tuned to extract names of cities and municipalities from German news articles. It was trained on 50,000 LLM-annotated [(LLAMA 3.1 8B-Instruct)](https://huggingface.co/meta-llama/Llama-3.1-8B-Instruct) German news articles from the CommonCrawl news dataset.
14
- This is still work in progress. Please report any bugs in the community tab.
15
- - **Developed by:** Lukas Kriesch
16
- - **Model type:** Named Entity Recognition (NER)
17
- - **Language(s) (NLP):** German
18
- - **License:** Llama 3.1 Community License Agreement
19
- - **Finetuned from model :** [spacy/de_core_news_lg](https://huggingface.co/spacy/de_core_news_lg)
20
-
21
- ## Uses
22
-
23
- ### Direct Use
24
- This model can be directly used to extract city and municipality names from any German-language text source, particularly news articles. Researchers and developers working in geospatial analysis or regional studies may find this useful for location-based analyses.
25
-
26
- ### Downstream Use
27
-
28
- Fine-tuned applications might involve integration into larger workflows for geospatial data processing, population studies, regional analysis, or sentiment analysis in the context of location data.
29
-
30
- ### Out-of-Scope Use
31
- The model should not be used to infer broader geographical trends or to analyze texts unrelated to city or municipal locations in Germany. Additionally, it may not perform well on non-news domains or texts that lack clear references to cities or municipalities.
32
-
33
- ## Bias, Risks, and Limitations
34
-
35
- The model is trained specifically on German news articles and may not generalize well to other domains such as social media, legal texts, or scientific literature. Additionally, there may be biases in the training data, particularly if certain regions are underrepresented in the dataset. Users should be cautious about the model's performance across different subpopulations of city or location mentions (e.g., historical names or rare municipalities).
36
-
37
- ## How to Get Started with the Model
38
- Install SpaCy: https://spacy.io/usage
39
- Install pretrained vectors: https://spacy.io/models/de#de_core_news_lg
40
-
41
- Download https://huggingface.co/LKriesch/LLAMA_fast_geotag/tree/main/spacy_lg_geo
42
- ```
43
- import spacy
44
- nlp=spacy.load("path_to_model")
45
- text="Das Olympiastadion steht in Berlin."
46
- doc=nlp(text)
47
- for ent in doc.ents:
48
- print(f"Entity: {ent.text}, Label: {ent.label_}")
49
- ```
50
- #### Training Hyperparameters
51
- Batch size: 64
52
-
53
- Epochs: Up to 100, with early stopping (patience of 3 epochs)
54
-
55
- Optimizer: Default spaCy optimizer for NER fine-tuning
56
-
57
- Training regime: Mixed precision (fp16)