diff --git "a/logs/l40-1gpu-fine-tuned.txt" "b/logs/l40-1gpu-fine-tuned.txt" --- "a/logs/l40-1gpu-fine-tuned.txt" +++ "b/logs/l40-1gpu-fine-tuned.txt" @@ -272,3 +272,101 @@ Qwen/Qwen2-7B-Instruct/epochs-06 metrics: {'meteor': 0.43615299592712675, 'bleu_ Current Directory: /common/home/users/d/dh.huang.2023/code/rapget-translation Evaluating shenzhi-wang/Mistral-7B-v0.3-Chinese-Chat +Using the latest cached version of the module from /common/scratch/users/d/dh.huang.2023/transformers/modules/evaluate_modules/metrics/evaluate-metric--meteor/ea1b63f27faab173b022be2d3cc3df2fc44a894247f833943ea98c8a7caeb1e8 (last modified on Wed Jun 19 06:03:37 2024) since it couldn't be found locally at evaluate-metric--meteor, or remotely on the Hugging Face Hub. +[nltk_data] Error loading wordnet: +[nltk_data] Error loading punkt: +[nltk_data] Error loading omw-1.4: +Using the latest cached version of the module from /common/scratch/users/d/dh.huang.2023/transformers/modules/evaluate_modules/metrics/evaluate-metric--bleu/9e0985c1200e367cce45605ce0ecb5ede079894e0f24f54613fca08eeb8aff76 (last modified on Wed May 8 07:48:30 2024) since it couldn't be found locally at evaluate-metric--bleu, or remotely on the Hugging Face Hub. +Using the latest cached version of the module from /common/scratch/users/d/dh.huang.2023/transformers/modules/evaluate_modules/metrics/evaluate-metric--rouge/b01e0accf3bd6dd24839b769a5fda24e14995071570870922c71970b3a6ed886 (last modified on Wed May 8 07:48:31 2024) since it couldn't be found locally at evaluate-metric--rouge, or remotely on the Hugging Face Hub. +Using the latest cached version of the module from /common/scratch/users/d/dh.huang.2023/transformers/modules/evaluate_modules/metrics/evaluate-metric--meteor/ea1b63f27faab173b022be2d3cc3df2fc44a894247f833943ea98c8a7caeb1e8 (last modified on Wed Jun 19 06:03:37 2024) since it couldn't be found locally at evaluate-metric--meteor, or remotely on the Hugging Face Hub. +[nltk_data] Error loading wordnet: +[nltk_data] Error loading punkt: +[nltk_data] Error loading omw-1.4: +Using the latest cached version of the module from /common/scratch/users/d/dh.huang.2023/transformers/modules/evaluate_modules/metrics/evaluate-metric--accuracy/f887c0aab52c2d38e1f8a215681126379eca617f96c447638f751434e8e65b14 (last modified on Wed Jun 19 06:03:39 2024) since it couldn't be found locally at evaluate-metric--accuracy, or remotely on the Hugging Face Hub. +loading env vars from: /common/home/users/d/dh.huang.2023/common2/code/rapget-translation/.env +workding dir: /common/home/users/d/dh.huang.2023/common2/code/rapget-translation +adding /common/home/users/d/dh.huang.2023/common2/code/rapget-translation to sys.path +loading: /common/home/users/d/dh.huang.2023/common2/code/rapget-translation/eval_modules/calc_repetitions.py +loading /common/home/users/d/dh.huang.2023/common2/code/rapget-translation/llm_toolkit/translation_utils.py +shenzhi-wang/Mistral-7B-v0.3-Chinese-Chat llama-factory/saves/Mistral-7B-v0.3-Chinese-Chat False 1 results/mac-results_fine_tuned.csv +CUDA is available, we have found 1 GPU(s) +NVIDIA L40 +CUDA version: 12.1 +Evaluating model: shenzhi-wang/Mistral-7B-v0.3-Chinese-Chat on cuda +(0) GPU = NVIDIA L40. Max memory = 44.309 GB. +0.0 GB of memory reserved. +loading model: shenzhi-wang/Mistral-7B-v0.3-Chinese-Chat with adapter: None + Loading checkpoint shards: 0%| | 0/3 [00:00You are a helpful assistant that translates Chinese to English. [INST] You will be given a Chinese sentence to translate. If it is an incomplete sentence, or if you are unsure about the meaning, simply copy the input text as your output. Do not output any additional sentence such as explanation or reasoning. + +Chinese: 老耿端起枪,眯缝起一只三角眼,一搂扳机响了枪,冰雹般的金麻雀劈哩啪啦往下落,铁砂子在柳枝间飞迸着,嚓嚓有声。 +English: [/INST]Old Geng picked up his shotgun, squinted, and pulled the trigger. Two sparrows crashed to the ground like hailstones as shotgun pellets tore noisily through the branches. +-------------------------------------------------- +prompt: You are a helpful assistant that translates Chinese to English. [INST] You will be given a Chinese sentence to translate. If it is an incomplete sentence, or if you are unsure about the meaning, simply copy the input text as your output. Do not output any additional sentence such as explanation or reasoning. + +Chinese: 老耿端起枪,眯缝起一只三角眼,一搂扳机响了枪,冰雹般的金麻雀劈哩啪啦往下落,铁砂子在柳枝间飞迸着,嚓嚓有声。 +English: [/INST] +(1) GPU = NVIDIA L40. Max memory = 44.309 GB. +13.627 GB of memory reserved. +found 6 checkpoints: ['checkpoint-35', 'checkpoint-70', 'checkpoint-105', 'checkpoint-140', 'checkpoint-175', 'checkpoint-210'] +Running from epoch 1 to 6 +Epoch 1 +loading adapter: llama-factory/saves/Mistral-7B-v0.3-Chinese-Chat/checkpoint-35 + 0%| | 0/1133 [00:00