Create README.md

README.md

@@ -0,0 +1,41 @@
+---
+license: mit
+datasets:
+- arxiv_dataset
+language:
+- en
+pipeline_tag: text-generation
+tags:
+- astronomy
+- science
+- LLM
+---
+
+# AstroLLaMA.gguf
+
+[AstroLLaMA](https://huggingface.co/universeTBD/astrollama) in GPT-Generated Unified Format.
+
+![](https://huggingface.co/universeTBD/astrollama/resolve/main/images/astrollama-logo.png)
+
+## What's GPT-Generated Unified Format?
+
+GGUF is file format used for storing models for inference, particularly in the context of language models like GPT. GGUF models **could be run on CPUs**, which made them accessible to a wider range of users.
+
+More detailed description can be found [here](https://medium.com/@phillipgimmi/what-is-gguf-and-ggml-e364834d241c).
+
+## How to play with AstroLLaMA on your laptop?
+
+1. Install [ollama](https://github.com/jmorganca/ollama);
+2. Download `astrollama.gguf` to your PC;
+3. Create a file named Modelfile, and add a FROM instruction with the local filepath to AstroLLaMA, e.g.,
+```
+FROM ./astrollama.gguf
+```
+4. Create the model in Ollama
+```
+ollama create astrollama -f path_to_modelfile
+```
+5. Run AstroLLaMA locally
+```
+ollama run astrollama
+```