add 70B single turn inference script

README.md

@@ -32,6 +32,16 @@ torchrun --nproc-per-node=1 demos/single_turn_mm.py \
 # --llama_type : Choose from [llama, llama_adapter, llama_peft, llama_qformerv2, llama_qformerv2_peft]
 ```
 
+For the checkpoints located in the `finetune/sg/` directory, use the following commands:
+```bash
+# 70B single turn platypus
+torchrun --nproc-per-node=1 --master-port 29500 demos/single_turn.py \
+--llama_config <path-to-Llama-2-70b/params.json> \
+--tokenizer_path <path-to-tokenizer.model> \
+--pretrained_path <path-to-Llama-2-70b> <path-to-platypus_normBias_QF_70B/epoch3> \
+--quant --llama_type llama_peft
+```
+
 Make sure to replace placeholders like `<path-to-params.json>`, `<path-to-tokenizer.model>`, and `<stage1-of-lamaQformerv2_13b>` with the actual paths.
 
 Follow these steps to successfully run the checkpoints using the provided commands and flags. For more details, refer to the documentation in the LLaMA2-Accessory repository.