diff --git "a/logs/l40-4gpu-8.txt" "b/logs/l40-4gpu-8.txt" --- "a/logs/l40-4gpu-8.txt" +++ "b/logs/l40-4gpu-8.txt" @@ -1,7 +1,7 @@ Submitting job: /common/home/users/d/dh.huang.2023/code/rapget-translation/scripts/eval-4gpu.sh Current Directory: /common/home/users/d/dh.huang.2023/code/rapget-translation -Thu Aug 22 22:50:56 2024 +Fri Aug 23 12:12:06 2024 +-----------------------------------------------------------------------------------------+ | NVIDIA-SMI 550.90.07 Driver Version: 550.90.07 CUDA Version: 12.4 | |-----------------------------------------+------------------------+----------------------+ @@ -10,19 +10,19 @@ Thu Aug 22 22:50:56 2024 | | | MIG M. | |=========================================+========================+======================| | 0 NVIDIA L40 On | 00000000:01:00.0 Off | 0 | -| N/A 39C P0 64W / 300W | 1MiB / 46068MiB | 0% Default | +| N/A 42C P8 37W / 300W | 1MiB / 46068MiB | 0% Default | | | | N/A | +-----------------------------------------+------------------------+----------------------+ | 1 NVIDIA L40 On | 00000000:41:00.0 Off | 0 | -| N/A 33C P8 34W / 300W | 1MiB / 46068MiB | 0% Default | +| N/A 43C P8 37W / 300W | 1MiB / 46068MiB | 0% Default | | | | N/A | +-----------------------------------------+------------------------+----------------------+ | 2 NVIDIA L40 On | 00000000:81:00.0 Off | 0 | -| N/A 34C P8 34W / 300W | 1MiB / 46068MiB | 0% Default | +| N/A 43C P8 37W / 300W | 1MiB / 46068MiB | 0% Default | | | | N/A | +-----------------------------------------+------------------------+----------------------+ | 3 NVIDIA L40 On | 00000000:C1:00.0 Off | 0 | -| N/A 34C P8 35W / 300W | 1MiB / 46068MiB | 0% Default | +| N/A 46C P8 39W / 300W | 1MiB / 46068MiB | 0% Default | | | | N/A | +-----------------------------------------+------------------------+----------------------+ @@ -65,7 +65,7 @@ CPU family: 25 Model: 1 Model name: AMD EPYC 7763 64-Core Processor Stepping: 1 -CPU MHz: 2450.000 +CPU MHz: 2829.325 CPU max MHz: 3529.0520 CPU min MHz: 1500.0000 BogoMIPS: 4890.34 @@ -109,7 +109,7 @@ shenzhi-wang/Llama3.1-70B-Chinese-Chat llama-factory/saves/Llama3.1-70B-Chinese- (0) GPU = NVIDIA L40. Max memory = 44.309 GB. 0.0 GB of memory reserved. loading model: shenzhi-wang/Llama3.1-70B-Chinese-Chat with adapter: llama-factory/saves/Llama3.1-70B-Chinese-Chat/checkpoint-210 - Loading checkpoint shards: 0%| | 0/30 [00:00<|start_header_id|>assistant<|end_header_id|> Evaluating model: shenzhi-wang/Llama3.1-70B-Chinese-Chat/checkpoint-210 on cuda *** Evaluating with repetition_penalty: 1.0 - 0%| | 0/1133 [00:00system +You are a helpful assistant that translates Chinese to English.<|im_end|> +<|im_start|>user +You will be given a Chinese sentence to translate. If it is an incomplete sentence, or if you are unsure about the meaning, simply copy the input text as your output. Do not output any additional sentence such as explanation or reasoning. + +Chinese: 老耿端起枪,眯缝起一只三角眼,一搂扳机响了枪,冰雹般的金麻雀劈哩啪啦往下落,铁砂子在柳枝间飞迸着,嚓嚓有声。 +English:<|im_end|> +<|im_start|>assistant +Old Geng picked up his shotgun, squinted, and pulled the trigger. Two sparrows crashed to the ground like hailstones as shotgun pellets tore noisily through the branches.<|im_end|> +-------------------------------------------------- +prompt: <|im_start|>system +You are a helpful assistant that translates Chinese to English.<|im_end|> +<|im_start|>user +You will be given a Chinese sentence to translate. If it is an incomplete sentence, or if you are unsure about the meaning, simply copy the input text as your output. Do not output any additional sentence such as explanation or reasoning. + +Chinese: 老耿端起枪,眯缝起一只三角眼,一搂扳机响了枪,冰雹般的金麻雀劈哩啪啦往下落,铁砂子在柳枝间飞迸着,嚓嚓有声。 +English:<|im_end|> +<|im_start|>assistant + +-------------------------------------------------- +chinese: 对我一刻也不能放松。 +-------------------------------------------------- +english: People shouldn't let up on me for a minute. +-------------------------------------------------- +text: <|im_start|>system +You are a helpful assistant that translates Chinese to English.<|im_end|> +<|im_start|>user +You will be given a Chinese sentence to translate. If it is an incomplete sentence, or if you are unsure about the meaning, simply copy the input text as your output. Do not output any additional sentence such as explanation or reasoning. + +Chinese: 对我一刻也不能放松。 +English:<|im_end|> +<|im_start|>assistant +People shouldn't let up on me for a minute.<|im_end|> +-------------------------------------------------- +prompt: <|im_start|>system +You are a helpful assistant that translates Chinese to English.<|im_end|> +<|im_start|>user +You will be given a Chinese sentence to translate. If it is an incomplete sentence, or if you are unsure about the meaning, simply copy the input text as your output. Do not output any additional sentence such as explanation or reasoning. + +Chinese: 对我一刻也不能放松。 +English:<|im_end|> +<|im_start|>assistant + +Evaluating model: Qwen/Qwen2-72B-Instruct/checkpoint-560 on cuda +*** Evaluating with repetition_penalty: 1.0 + 0%| | 0/1133 [00:00