--- license: apache-2.0 tags: - generated_from_trainer base_model: mistralai/Mistral-7B-Instruct-v0.1 model-index: - name: fiveflow/ATOMM-v0.18 results: [] language: - ko --- How to use ```Python from transformers import AutoModelForCausalLM, AutoTokenizer, TextGenerationPipeline model_path = 'fiveflow/ATOMM' tokenizer = AutoTokenizer.from_pretrained(model_path) model = AutoModelForCausalLM.from_pretrained(model_path, device_map="auto", # load_in_4bit=True, low_cpu_mem_usage=True) pipe = TextGenerationPipeline(model = model, tokenizer = tokenizer) ```