uploaded readme

README.md

@@ -0,0 +1,80 @@
+Quantization made by Richard Erkhov.
+
+[Github](https://github.com/RichardErkhov)
+
+[Discord](https://discord.gg/pvy7H8DZMG)
+
+[Request more models](https://github.com/RichardErkhov/quant_request)
+
+
+Meta-Llama-3.1-8B-Instruct-Summarizer - GGUF
+- Model creator: https://huggingface.co/raaec/
+- Original model: https://huggingface.co/raaec/Meta-Llama-3.1-8B-Instruct-Summarizer/
+
+
+| Name | Quant method | Size |
+| ---- | ---- | ---- |
+| [Meta-Llama-3.1-8B-Instruct-Summarizer.Q2_K.gguf](https://huggingface.co/RichardErkhov/raaec_-_Meta-Llama-3.1-8B-Instruct-Summarizer-gguf/blob/main/Meta-Llama-3.1-8B-Instruct-Summarizer.Q2_K.gguf) | Q2_K | 2.96GB |
+| [Meta-Llama-3.1-8B-Instruct-Summarizer.IQ3_XS.gguf](https://huggingface.co/RichardErkhov/raaec_-_Meta-Llama-3.1-8B-Instruct-Summarizer-gguf/blob/main/Meta-Llama-3.1-8B-Instruct-Summarizer.IQ3_XS.gguf) | IQ3_XS | 3.28GB |
+| [Meta-Llama-3.1-8B-Instruct-Summarizer.IQ3_S.gguf](https://huggingface.co/RichardErkhov/raaec_-_Meta-Llama-3.1-8B-Instruct-Summarizer-gguf/blob/main/Meta-Llama-3.1-8B-Instruct-Summarizer.IQ3_S.gguf) | IQ3_S | 3.43GB |
+| [Meta-Llama-3.1-8B-Instruct-Summarizer.Q3_K_S.gguf](https://huggingface.co/RichardErkhov/raaec_-_Meta-Llama-3.1-8B-Instruct-Summarizer-gguf/blob/main/Meta-Llama-3.1-8B-Instruct-Summarizer.Q3_K_S.gguf) | Q3_K_S | 3.41GB |
+| [Meta-Llama-3.1-8B-Instruct-Summarizer.IQ3_M.gguf](https://huggingface.co/RichardErkhov/raaec_-_Meta-Llama-3.1-8B-Instruct-Summarizer-gguf/blob/main/Meta-Llama-3.1-8B-Instruct-Summarizer.IQ3_M.gguf) | IQ3_M | 3.52GB |
+| [Meta-Llama-3.1-8B-Instruct-Summarizer.Q3_K.gguf](https://huggingface.co/RichardErkhov/raaec_-_Meta-Llama-3.1-8B-Instruct-Summarizer-gguf/blob/main/Meta-Llama-3.1-8B-Instruct-Summarizer.Q3_K.gguf) | Q3_K | 3.74GB |
+| [Meta-Llama-3.1-8B-Instruct-Summarizer.Q3_K_M.gguf](https://huggingface.co/RichardErkhov/raaec_-_Meta-Llama-3.1-8B-Instruct-Summarizer-gguf/blob/main/Meta-Llama-3.1-8B-Instruct-Summarizer.Q3_K_M.gguf) | Q3_K_M | 3.74GB |
+| [Meta-Llama-3.1-8B-Instruct-Summarizer.Q3_K_L.gguf](https://huggingface.co/RichardErkhov/raaec_-_Meta-Llama-3.1-8B-Instruct-Summarizer-gguf/blob/main/Meta-Llama-3.1-8B-Instruct-Summarizer.Q3_K_L.gguf) | Q3_K_L | 4.03GB |
+| [Meta-Llama-3.1-8B-Instruct-Summarizer.IQ4_XS.gguf](https://huggingface.co/RichardErkhov/raaec_-_Meta-Llama-3.1-8B-Instruct-Summarizer-gguf/blob/main/Meta-Llama-3.1-8B-Instruct-Summarizer.IQ4_XS.gguf) | IQ4_XS | 4.18GB |
+| [Meta-Llama-3.1-8B-Instruct-Summarizer.Q4_0.gguf](https://huggingface.co/RichardErkhov/raaec_-_Meta-Llama-3.1-8B-Instruct-Summarizer-gguf/blob/main/Meta-Llama-3.1-8B-Instruct-Summarizer.Q4_0.gguf) | Q4_0 | 4.34GB |
+| [Meta-Llama-3.1-8B-Instruct-Summarizer.IQ4_NL.gguf](https://huggingface.co/RichardErkhov/raaec_-_Meta-Llama-3.1-8B-Instruct-Summarizer-gguf/blob/main/Meta-Llama-3.1-8B-Instruct-Summarizer.IQ4_NL.gguf) | IQ4_NL | 4.38GB |
+| [Meta-Llama-3.1-8B-Instruct-Summarizer.Q4_K_S.gguf](https://huggingface.co/RichardErkhov/raaec_-_Meta-Llama-3.1-8B-Instruct-Summarizer-gguf/blob/main/Meta-Llama-3.1-8B-Instruct-Summarizer.Q4_K_S.gguf) | Q4_K_S | 4.37GB |
+| [Meta-Llama-3.1-8B-Instruct-Summarizer.Q4_K.gguf](https://huggingface.co/RichardErkhov/raaec_-_Meta-Llama-3.1-8B-Instruct-Summarizer-gguf/blob/main/Meta-Llama-3.1-8B-Instruct-Summarizer.Q4_K.gguf) | Q4_K | 4.58GB |
+| [Meta-Llama-3.1-8B-Instruct-Summarizer.Q4_K_M.gguf](https://huggingface.co/RichardErkhov/raaec_-_Meta-Llama-3.1-8B-Instruct-Summarizer-gguf/blob/main/Meta-Llama-3.1-8B-Instruct-Summarizer.Q4_K_M.gguf) | Q4_K_M | 4.58GB |
+| [Meta-Llama-3.1-8B-Instruct-Summarizer.Q4_1.gguf](https://huggingface.co/RichardErkhov/raaec_-_Meta-Llama-3.1-8B-Instruct-Summarizer-gguf/blob/main/Meta-Llama-3.1-8B-Instruct-Summarizer.Q4_1.gguf) | Q4_1 | 4.78GB |
+| [Meta-Llama-3.1-8B-Instruct-Summarizer.Q5_0.gguf](https://huggingface.co/RichardErkhov/raaec_-_Meta-Llama-3.1-8B-Instruct-Summarizer-gguf/blob/main/Meta-Llama-3.1-8B-Instruct-Summarizer.Q5_0.gguf) | Q5_0 | 5.21GB |
+| [Meta-Llama-3.1-8B-Instruct-Summarizer.Q5_K_S.gguf](https://huggingface.co/RichardErkhov/raaec_-_Meta-Llama-3.1-8B-Instruct-Summarizer-gguf/blob/main/Meta-Llama-3.1-8B-Instruct-Summarizer.Q5_K_S.gguf) | Q5_K_S | 5.21GB |
+| [Meta-Llama-3.1-8B-Instruct-Summarizer.Q5_K.gguf](https://huggingface.co/RichardErkhov/raaec_-_Meta-Llama-3.1-8B-Instruct-Summarizer-gguf/blob/main/Meta-Llama-3.1-8B-Instruct-Summarizer.Q5_K.gguf) | Q5_K | 5.34GB |
+| [Meta-Llama-3.1-8B-Instruct-Summarizer.Q5_K_M.gguf](https://huggingface.co/RichardErkhov/raaec_-_Meta-Llama-3.1-8B-Instruct-Summarizer-gguf/blob/main/Meta-Llama-3.1-8B-Instruct-Summarizer.Q5_K_M.gguf) | Q5_K_M | 5.34GB |
+| [Meta-Llama-3.1-8B-Instruct-Summarizer.Q5_1.gguf](https://huggingface.co/RichardErkhov/raaec_-_Meta-Llama-3.1-8B-Instruct-Summarizer-gguf/blob/main/Meta-Llama-3.1-8B-Instruct-Summarizer.Q5_1.gguf) | Q5_1 | 5.65GB |
+| [Meta-Llama-3.1-8B-Instruct-Summarizer.Q6_K.gguf](https://huggingface.co/RichardErkhov/raaec_-_Meta-Llama-3.1-8B-Instruct-Summarizer-gguf/blob/main/Meta-Llama-3.1-8B-Instruct-Summarizer.Q6_K.gguf) | Q6_K | 6.14GB |
+| [Meta-Llama-3.1-8B-Instruct-Summarizer.Q8_0.gguf](https://huggingface.co/RichardErkhov/raaec_-_Meta-Llama-3.1-8B-Instruct-Summarizer-gguf/blob/main/Meta-Llama-3.1-8B-Instruct-Summarizer.Q8_0.gguf) | Q8_0 | 7.95GB |
+
+
+
+
+Original model description:
+---
+license: apache-2.0
+pipeline_tag: summarization
+widget:
+  - text: >-
+      Hugging Face: Revolutionizing Natural Language Processing Introduction In
+      the rapidly evolving field of Natural Language Processing (NLP), Hugging
+      Face has emerged as a prominent and innovative force. This article will
+      explore the story and significance of Hugging Face, a company that has
+      made remarkable contributions to NLP and AI as a whole. From its inception
+      to its role in democratizing AI, Hugging Face has left an indelible mark
+      on the industry.  The Birth of Hugging Face Hugging Face was founded in
+      2016 by Clément Delangue, Julien Chaumond, and Thomas Wolf. The name
+      Hugging Face was chosen to reflect the company's mission of making AI
+      models more accessible and friendly to humans, much like a comforting hug.
+      Initially, they began as a chatbot company but later shifted their focus
+      to NLP, driven by their belief in the transformative potential of this
+      technology. Transformative Innovations Hugging Face is best known for its
+      open-source contributions, particularly the Transformers library. This
+      library has become the de facto standard for NLP and enables researchers,
+      developers, and organizations to easily access and utilize
+      state-of-the-art pre-trained language models, such as BERT, GPT-3, and
+      more. These models have countless applications, from chatbots and virtual
+      assistants to language translation and sentiment analysis. 
+example_title: Summarization Example 1
+---
+
+## Model Information
+
+This is a fine-tuned version of Llama 3.1 trained in English, Spanish, and Chinese for text summarization.
+
+The Meta Llama 3.1 collection of multilingual large language models (LLMs) is a collection of pretrained and instruction tuned generative models in 8B, 70B and 405B sizes (text in/text out). The Llama 3.1 instruction tuned text only models (8B, 70B, 405B) are optimized for multilingual dialogue use cases and outperform many of the available open source and closed chat models on common industry benchmarks.
+
+**Model developer**: Meta
+
+**Model Architecture:** Llama 3.1 is an auto-regressive language model that uses an optimized transformer architecture. The tuned versions use supervised fine-tuning (SFT) and reinforcement learning with human feedback (RLHF) to align with human preferences for helpfulness and safety.
+