add logs.

log/log-decode-epoch-39-avg-15-beam-4-2022-03-01-10-30-58

@@ -0,0 +1,233 @@
+2022-03-01 10:30:58,402 INFO [decode.py:416] Decoding started
+2022-03-01 10:30:58,402 INFO [decode.py:422] Device: cuda:0
+2022-03-01 10:30:58,407 INFO [decode.py:431] {'feature_dim': 80, 'encoder_out_dim': 512, 'subsampling_factor': 4, 'attention_dim': 512, 'nhead': 8, 'dim_feedforward': 2048, 'num_encoder_layers': 12, 'vgg_frontend': False, 'env_info': {'k2-version': '1.13', 'k2-build-type': 'Release', 'k2-with-cuda': True, 'k2-git-sha1': 'f4fefe4882bc0ae59af951da3f47335d5495ef71', 'k2-git-date': 'Thu Feb 10 15:16:02 2022', 'lhotse-version': '1.0.0.dev+missing.version.file', 'torch-cuda-available': True, 'torch-cuda-version': '10.2', 'python-version': '3.8', 'icefall-git-branch': 'multiple-datasets', 'icefall-git-sha1': 'aadd7ca-clean', 'icefall-git-date': 'Mon Feb 21 15:11:46 2022', 'icefall-path': '/ceph-fj/fangjun/open-source-2/icefall-multi-datasets', 'k2-path': '/ceph-fj/fangjun/open-source-2/k2-multi-datasets/k2/python/k2/__init__.py', 'lhotse-path': '/ceph-fj/fangjun/open-source-2/lhotse-multi-datasets/lhotse/__init__.py', 'hostname': 'de-74279-k2-dev-8-0218134109-68b6994b68-l4qrs', 'IP address': '10.177.63.208'}, 'epoch': 39, 'avg': 15, 'exp_dir': PosixPath('transducer_stateless_multi_datasets/exp-full-2'), 'bpe_model': './data/lang_bpe_500/bpe.model', 'decoding_method': 'modified_beam_search', 'beam_size': 4, 'context_size': 2, 'max_sym_per_frame': 3, 'max_duration': 100, 'bucketing_sampler': True, 'num_buckets': 30, 'shuffle': True, 'return_cuts': True, 'num_workers': 2, 'enable_spec_aug': True, 'spec_aug_time_warp_factor': 80, 'enable_musan': True, 'manifest_dir': PosixPath('data/fbank'), 'on_the_fly_feats': False, 'res_dir': PosixPath('transducer_stateless_multi_datasets/exp-full-2/modified_beam_search'), 'suffix': 'epoch-39-avg-15-beam-4', 'blank_id': 0, 'vocab_size': 500}
+2022-03-01 10:30:58,407 INFO [decode.py:433] About to create model
+2022-03-01 10:30:58,889 INFO [decode.py:444] averaging ['transducer_stateless_multi_datasets/exp-full-2/epoch-25.pt', 'transducer_stateless_multi_datasets/exp-full-2/epoch-26.pt', 'transducer_stateless_multi_datasets/exp-full-2/epoch-27.pt', 'transducer_stateless_multi_datasets/exp-full-2/epoch-28.pt', 'transducer_stateless_multi_datasets/exp-full-2/epoch-29.pt', 'transducer_stateless_multi_datasets/exp-full-2/epoch-30.pt', 'transducer_stateless_multi_datasets/exp-full-2/epoch-31.pt', 'transducer_stateless_multi_datasets/exp-full-2/epoch-32.pt', 'transducer_stateless_multi_datasets/exp-full-2/epoch-33.pt', 'transducer_stateless_multi_datasets/exp-full-2/epoch-34.pt', 'transducer_stateless_multi_datasets/exp-full-2/epoch-35.pt', 'transducer_stateless_multi_datasets/exp-full-2/epoch-36.pt', 'transducer_stateless_multi_datasets/exp-full-2/epoch-37.pt', 'transducer_stateless_multi_datasets/exp-full-2/epoch-38.pt', 'transducer_stateless_multi_datasets/exp-full-2/epoch-39.pt']
+2022-03-01 10:31:16,354 INFO [decode.py:455] Number of model parameters: 84007924
+2022-03-01 10:31:16,355 INFO [librispeech.py:58] About to get test-clean cuts from data/fbank/cuts_test-clean.json.gz
+2022-03-01 10:31:16,481 INFO [librispeech.py:63] About to get test-other cuts from data/fbank/cuts_test-other.json.gz
+2022-03-01 10:31:18,966 INFO [decode.py:341] batch 0/?, cuts processed until now is 20
+2022-03-01 10:31:23,046 INFO [decode.py:341] batch 2/?, cuts processed until now is 64
+2022-03-01 10:31:26,966 INFO [decode.py:341] batch 4/?, cuts processed until now is 81
+2022-03-01 10:31:31,130 INFO [decode.py:341] batch 6/?, cuts processed until now is 121
+2022-03-01 10:31:34,899 INFO [decode.py:341] batch 8/?, cuts processed until now is 133
+2022-03-01 10:31:38,833 INFO [decode.py:341] batch 10/?, cuts processed until now is 168
+2022-03-01 10:31:42,513 INFO [decode.py:341] batch 12/?, cuts processed until now is 202
+2022-03-01 10:31:46,894 INFO [decode.py:341] batch 14/?, cuts processed until now is 217
+2022-03-01 10:31:51,033 INFO [decode.py:341] batch 16/?, cuts processed until now is 241
+2022-03-01 10:31:55,051 INFO [decode.py:341] batch 18/?, cuts processed until now is 267
+2022-03-01 10:31:59,404 INFO [decode.py:341] batch 20/?, cuts processed until now is 281
+2022-03-01 10:32:03,448 INFO [decode.py:341] batch 22/?, cuts processed until now is 325
+2022-03-01 10:32:07,574 INFO [decode.py:341] batch 24/?, cuts processed until now is 349
+2022-03-01 10:32:11,742 INFO [decode.py:341] batch 26/?, cuts processed until now is 366
+2022-03-01 10:32:15,772 INFO [decode.py:341] batch 28/?, cuts processed until now is 389
+2022-03-01 10:32:19,860 INFO [decode.py:341] batch 30/?, cuts processed until now is 410
+2022-03-01 10:32:23,825 INFO [decode.py:341] batch 32/?, cuts processed until now is 442
+2022-03-01 10:32:28,007 INFO [decode.py:341] batch 34/?, cuts processed until now is 474
+2022-03-01 10:32:32,068 INFO [decode.py:341] batch 36/?, cuts processed until now is 498
+2022-03-01 10:32:36,111 INFO [decode.py:341] batch 38/?, cuts processed until now is 514
+2022-03-01 10:32:40,274 INFO [decode.py:341] batch 40/?, cuts processed until now is 524
+2022-03-01 10:32:44,325 INFO [decode.py:341] batch 42/?, cuts processed until now is 564
+2022-03-01 10:32:48,428 INFO [decode.py:341] batch 44/?, cuts processed until now is 621
+2022-03-01 10:32:52,441 INFO [decode.py:341] batch 46/?, cuts processed until now is 633
+2022-03-01 10:32:56,327 INFO [decode.py:341] batch 48/?, cuts processed until now is 648
+2022-03-01 10:33:00,420 INFO [decode.py:341] batch 50/?, cuts processed until now is 662
+2022-03-01 10:33:04,355 INFO [decode.py:341] batch 52/?, cuts processed until now is 680
+2022-03-01 10:33:08,147 INFO [decode.py:341] batch 54/?, cuts processed until now is 708
+2022-03-01 10:33:11,916 INFO [decode.py:341] batch 56/?, cuts processed until now is 736
+2022-03-01 10:33:15,935 INFO [decode.py:341] batch 58/?, cuts processed until now is 752
+2022-03-01 10:33:19,974 INFO [decode.py:341] batch 60/?, cuts processed until now is 819
+2022-03-01 10:33:24,013 INFO [decode.py:341] batch 62/?, cuts processed until now is 843
+2022-03-01 10:33:28,038 INFO [decode.py:341] batch 64/?, cuts processed until now is 850
+2022-03-01 10:33:32,103 INFO [decode.py:341] batch 66/?, cuts processed until now is 880
+2022-03-01 10:33:36,072 INFO [decode.py:341] batch 68/?, cuts processed until now is 932
+2022-03-01 10:33:40,324 INFO [decode.py:341] batch 70/?, cuts processed until now is 957
+2022-03-01 10:33:44,303 INFO [decode.py:341] batch 72/?, cuts processed until now is 996
+2022-03-01 10:33:48,397 INFO [decode.py:341] batch 74/?, cuts processed until now is 1064
+2022-03-01 10:33:52,529 INFO [decode.py:341] batch 76/?, cuts processed until now is 1077
+2022-03-01 10:33:56,660 INFO [decode.py:341] batch 78/?, cuts processed until now is 1114
+2022-03-01 10:34:00,737 INFO [decode.py:341] batch 80/?, cuts processed until now is 1141
+2022-03-01 10:34:04,665 INFO [decode.py:341] batch 82/?, cuts processed until now is 1172
+2022-03-01 10:34:08,752 INFO [decode.py:341] batch 84/?, cuts processed until now is 1180
+2022-03-01 10:34:12,731 INFO [decode.py:341] batch 86/?, cuts processed until now is 1199
+2022-03-01 10:34:16,653 INFO [decode.py:341] batch 88/?, cuts processed until now is 1228
+2022-03-01 10:34:20,763 INFO [decode.py:341] batch 90/?, cuts processed until now is 1245
+2022-03-01 10:34:24,729 INFO [decode.py:341] batch 92/?, cuts processed until now is 1267
+2022-03-01 10:34:28,805 INFO [decode.py:341] batch 94/?, cuts processed until now is 1333
+2022-03-01 10:34:32,786 INFO [decode.py:341] batch 96/?, cuts processed until now is 1363
+2022-03-01 10:34:35,013 INFO [decode.py:341] batch 98/?, cuts processed until now is 1378
+2022-03-01 10:34:39,127 INFO [decode.py:341] batch 100/?, cuts processed until now is 1406
+2022-03-01 10:34:43,117 INFO [decode.py:341] batch 102/?, cuts processed until now is 1420
+2022-03-01 10:34:47,056 INFO [decode.py:341] batch 104/?, cuts processed until now is 1445
+2022-03-01 10:34:51,207 INFO [decode.py:341] batch 106/?, cuts processed until now is 1468
+2022-03-01 10:34:55,354 INFO [decode.py:341] batch 108/?, cuts processed until now is 1494
+2022-03-01 10:34:59,385 INFO [decode.py:341] batch 110/?, cuts processed until now is 1547
+2022-03-01 10:35:03,582 INFO [decode.py:341] batch 112/?, cuts processed until now is 1582
+2022-03-01 10:35:07,670 INFO [decode.py:341] batch 114/?, cuts processed until now is 1615
+2022-03-01 10:35:11,952 INFO [decode.py:341] batch 116/?, cuts processed until now is 1636
+2022-03-01 10:35:15,864 INFO [decode.py:341] batch 118/?, cuts processed until now is 1655
+2022-03-01 10:35:19,982 INFO [decode.py:341] batch 120/?, cuts processed until now is 1696
+2022-03-01 10:35:24,016 INFO [decode.py:341] batch 122/?, cuts processed until now is 1722
+2022-03-01 10:35:28,040 INFO [decode.py:341] batch 124/?, cuts processed until now is 1734
+2022-03-01 10:35:32,133 INFO [decode.py:341] batch 126/?, cuts processed until now is 1755
+2022-03-01 10:35:36,201 INFO [decode.py:341] batch 128/?, cuts processed until now is 1781
+2022-03-01 10:35:40,213 INFO [decode.py:341] batch 130/?, cuts processed until now is 1844
+2022-03-01 10:35:44,241 INFO [decode.py:341] batch 132/?, cuts processed until now is 1886
+2022-03-01 10:35:48,133 INFO [decode.py:341] batch 134/?, cuts processed until now is 1903
+2022-03-01 10:35:52,064 INFO [decode.py:341] batch 136/?, cuts processed until now is 1932
+2022-03-01 10:35:56,284 INFO [decode.py:341] batch 138/?, cuts processed until now is 1951
+2022-03-01 10:35:59,985 INFO [decode.py:341] batch 140/?, cuts processed until now is 1959
+2022-03-01 10:36:03,132 INFO [decode.py:341] batch 142/?, cuts processed until now is 2007
+2022-03-01 10:36:06,168 INFO [decode.py:341] batch 144/?, cuts processed until now is 2035
+2022-03-01 10:36:09,322 INFO [decode.py:341] batch 146/?, cuts processed until now is 2083
+2022-03-01 10:36:12,143 INFO [decode.py:341] batch 148/?, cuts processed until now is 2130
+2022-03-01 10:36:15,335 INFO [decode.py:341] batch 150/?, cuts processed until now is 2139
+2022-03-01 10:36:18,559 INFO [decode.py:341] batch 152/?, cuts processed until now is 2171
+2022-03-01 10:36:21,883 INFO [decode.py:341] batch 154/?, cuts processed until now is 2192
+2022-03-01 10:36:25,302 INFO [decode.py:341] batch 156/?, cuts processed until now is 2208
+2022-03-01 10:36:28,591 INFO [decode.py:341] batch 158/?, cuts processed until now is 2230
+2022-03-01 10:36:31,877 INFO [decode.py:341] batch 160/?, cuts processed until now is 2258
+2022-03-01 10:36:35,180 INFO [decode.py:341] batch 162/?, cuts processed until now is 2274
+2022-03-01 10:36:38,523 INFO [decode.py:341] batch 164/?, cuts processed until now is 2296
+2022-03-01 10:36:41,747 INFO [decode.py:341] batch 166/?, cuts processed until now is 2327
+2022-03-01 10:36:44,924 INFO [decode.py:341] batch 168/?, cuts processed until now is 2351
+2022-03-01 10:36:48,361 INFO [decode.py:341] batch 170/?, cuts processed until now is 2364
+2022-03-01 10:36:52,460 INFO [decode.py:341] batch 172/?, cuts processed until now is 2374
+2022-03-01 10:36:56,588 INFO [decode.py:341] batch 174/?, cuts processed until now is 2399
+2022-03-01 10:37:00,787 INFO [decode.py:341] batch 176/?, cuts processed until now is 2418
+2022-03-01 10:37:03,353 INFO [decode.py:341] batch 178/?, cuts processed until now is 2427
+2022-03-01 10:37:07,355 INFO [decode.py:341] batch 180/?, cuts processed until now is 2440
+2022-03-01 10:37:11,372 INFO [decode.py:341] batch 182/?, cuts processed until now is 2456
+2022-03-01 10:37:15,295 INFO [decode.py:341] batch 184/?, cuts processed until now is 2466
+2022-03-01 10:37:19,123 INFO [decode.py:341] batch 186/?, cuts processed until now is 2479
+2022-03-01 10:37:21,633 INFO [decode.py:341] batch 188/?, cuts processed until now is 2492
+2022-03-01 10:37:24,524 INFO [decode.py:341] batch 190/?, cuts processed until now is 2502
+2022-03-01 10:37:28,841 INFO [decode.py:341] batch 192/?, cuts processed until now is 2520
+2022-03-01 10:37:31,223 INFO [decode.py:341] batch 194/?, cuts processed until now is 2527
+2022-03-01 10:37:35,682 INFO [decode.py:341] batch 196/?, cuts processed until now is 2539
+2022-03-01 10:37:40,063 INFO [decode.py:341] batch 198/?, cuts processed until now is 2551
+2022-03-01 10:37:44,533 INFO [decode.py:341] batch 200/?, cuts processed until now is 2563
+2022-03-01 10:37:48,672 INFO [decode.py:341] batch 202/?, cuts processed until now is 2575
+2022-03-01 10:37:52,758 INFO [decode.py:341] batch 204/?, cuts processed until now is 2587
+2022-03-01 10:37:56,881 INFO [decode.py:341] batch 206/?, cuts processed until now is 2599
+2022-03-01 10:38:00,927 INFO [decode.py:341] batch 208/?, cuts processed until now is 2611
+2022-03-01 10:38:03,850 INFO [decode.py:341] batch 210/?, cuts processed until now is 2620
+2022-03-01 10:38:04,007 INFO [decode.py:358] The transcripts are stored in transducer_stateless_multi_datasets/exp-full-2/modified_beam_search/recogs-test-clean-beam_4-epoch-39-avg-15-beam-4.txt
+2022-03-01 10:38:04,080 INFO [utils.py:404] [test-clean-beam_4] %WER 2.61% [1372 / 52576, 160 ins, 104 del, 1108 sub ]
+2022-03-01 10:38:04,293 INFO [decode.py:371] Wrote detailed error stats to transducer_stateless_multi_datasets/exp-full-2/modified_beam_search/errs-test-clean-beam_4-epoch-39-avg-15-beam-4.txt
+2022-03-01 10:38:04,294 INFO [decode.py:388] 
+For test-clean, WER of different settings are:
+beam_4	2.61	best for test-clean
+
+2022-03-01 10:38:06,609 INFO [decode.py:341] batch 0/?, cuts processed until now is 23
+2022-03-01 10:38:10,834 INFO [decode.py:341] batch 2/?, cuts processed until now is 71
+2022-03-01 10:38:15,150 INFO [decode.py:341] batch 4/?, cuts processed until now is 92
+2022-03-01 10:38:19,216 INFO [decode.py:341] batch 6/?, cuts processed until now is 134
+2022-03-01 10:38:23,580 INFO [decode.py:341] batch 8/?, cuts processed until now is 150
+2022-03-01 10:38:27,679 INFO [decode.py:341] batch 10/?, cuts processed until now is 190
+2022-03-01 10:38:31,519 INFO [decode.py:341] batch 12/?, cuts processed until now is 225
+2022-03-01 10:38:35,430 INFO [decode.py:341] batch 14/?, cuts processed until now is 240
+2022-03-01 10:38:39,721 INFO [decode.py:341] batch 16/?, cuts processed until now is 266
+2022-03-01 10:38:59,138 INFO [decode.py:341] batch 18/?, cuts processed until now is 296
+2022-03-01 10:39:18,066 INFO [decode.py:341] batch 20/?, cuts processed until now is 312
+2022-03-01 10:39:38,933 INFO [decode.py:341] batch 22/?, cuts processed until now is 360
+2022-03-01 10:39:58,755 INFO [decode.py:341] batch 24/?, cuts processed until now is 387
+2022-03-01 10:40:16,460 INFO [decode.py:341] batch 26/?, cuts processed until now is 406
+2022-03-01 10:40:36,718 INFO [decode.py:341] batch 28/?, cuts processed until now is 433
+2022-03-01 10:40:47,569 INFO [decode.py:341] batch 30/?, cuts processed until now is 457
+2022-03-01 10:40:51,685 INFO [decode.py:341] batch 32/?, cuts processed until now is 494
+2022-03-01 10:40:55,735 INFO [decode.py:341] batch 34/?, cuts processed until now is 540
+2022-03-01 10:40:59,862 INFO [decode.py:341] batch 36/?, cuts processed until now is 568
+2022-03-01 10:41:03,943 INFO [decode.py:341] batch 38/?, cuts processed until now is 587
+2022-03-01 10:41:08,166 INFO [decode.py:341] batch 40/?, cuts processed until now is 598
+2022-03-01 10:41:12,188 INFO [decode.py:341] batch 42/?, cuts processed until now is 640
+2022-03-01 10:41:16,248 INFO [decode.py:341] batch 44/?, cuts processed until now is 700
+2022-03-01 10:41:20,638 INFO [decode.py:341] batch 46/?, cuts processed until now is 715
+2022-03-01 10:41:24,924 INFO [decode.py:341] batch 48/?, cuts processed until now is 733
+2022-03-01 10:41:28,714 INFO [decode.py:341] batch 50/?, cuts processed until now is 749
+2022-03-01 10:41:32,789 INFO [decode.py:341] batch 52/?, cuts processed until now is 769
+2022-03-01 10:41:37,096 INFO [decode.py:341] batch 54/?, cuts processed until now is 801
+2022-03-01 10:41:41,319 INFO [decode.py:341] batch 56/?, cuts processed until now is 833
+2022-03-01 10:41:45,626 INFO [decode.py:341] batch 58/?, cuts processed until now is 853
+2022-03-01 10:41:49,745 INFO [decode.py:341] batch 60/?, cuts processed until now is 922
+2022-03-01 10:41:54,161 INFO [decode.py:341] batch 62/?, cuts processed until now is 950
+2022-03-01 10:41:58,288 INFO [decode.py:341] batch 64/?, cuts processed until now is 958
+2022-03-01 10:42:15,589 INFO [decode.py:341] batch 66/?, cuts processed until now is 992
+2022-03-01 10:42:32,952 INFO [decode.py:341] batch 68/?, cuts processed until now is 1046
+2022-03-01 10:42:50,307 INFO [decode.py:341] batch 70/?, cuts processed until now is 1074
+2022-03-01 10:43:07,728 INFO [decode.py:341] batch 72/?, cuts processed until now is 1119
+2022-03-01 10:43:25,086 INFO [decode.py:341] batch 74/?, cuts processed until now is 1188
+2022-03-01 10:43:41,354 INFO [decode.py:341] batch 76/?, cuts processed until now is 1203
+2022-03-01 10:43:45,681 INFO [decode.py:341] batch 78/?, cuts processed until now is 1243
+2022-03-01 10:43:49,831 INFO [decode.py:341] batch 80/?, cuts processed until now is 1274
+2022-03-01 10:43:53,931 INFO [decode.py:341] batch 82/?, cuts processed until now is 1310
+2022-03-01 10:43:58,285 INFO [decode.py:341] batch 84/?, cuts processed until now is 1320
+2022-03-01 10:44:02,434 INFO [decode.py:341] batch 86/?, cuts processed until now is 1343
+2022-03-01 10:44:06,523 INFO [decode.py:341] batch 88/?, cuts processed until now is 1377
+2022-03-01 10:44:10,655 INFO [decode.py:341] batch 90/?, cuts processed until now is 1422
+2022-03-01 10:44:14,787 INFO [decode.py:341] batch 92/?, cuts processed until now is 1448
+2022-03-01 10:44:18,888 INFO [decode.py:341] batch 94/?, cuts processed until now is 1514
+2022-03-01 10:44:23,062 INFO [decode.py:341] batch 96/?, cuts processed until now is 1547
+2022-03-01 10:44:26,384 INFO [decode.py:341] batch 98/?, cuts processed until now is 1594
+2022-03-01 10:44:30,339 INFO [decode.py:341] batch 100/?, cuts processed until now is 1614
+2022-03-01 10:44:34,682 INFO [decode.py:341] batch 102/?, cuts processed until now is 1631
+2022-03-01 10:44:38,802 INFO [decode.py:341] batch 104/?, cuts processed until now is 1660
+2022-03-01 10:44:42,923 INFO [decode.py:341] batch 106/?, cuts processed until now is 1686
+2022-03-01 10:44:47,033 INFO [decode.py:341] batch 108/?, cuts processed until now is 1716
+2022-03-01 10:44:51,103 INFO [decode.py:341] batch 110/?, cuts processed until now is 1774
+2022-03-01 10:44:55,193 INFO [decode.py:341] batch 112/?, cuts processed until now is 1812
+2022-03-01 10:44:59,328 INFO [decode.py:341] batch 114/?, cuts processed until now is 1849
+2022-03-01 10:45:03,324 INFO [decode.py:341] batch 116/?, cuts processed until now is 1872
+2022-03-01 10:45:07,416 INFO [decode.py:341] batch 118/?, cuts processed until now is 1894
+2022-03-01 10:45:11,599 INFO [decode.py:341] batch 120/?, cuts processed until now is 1938
+2022-03-01 10:45:15,819 INFO [decode.py:341] batch 122/?, cuts processed until now is 1968
+2022-03-01 10:45:19,922 INFO [decode.py:341] batch 124/?, cuts processed until now is 1982
+2022-03-01 10:45:24,132 INFO [decode.py:341] batch 126/?, cuts processed until now is 2007
+2022-03-01 10:45:28,299 INFO [decode.py:341] batch 128/?, cuts processed until now is 2037
+2022-03-01 10:45:32,431 INFO [decode.py:341] batch 130/?, cuts processed until now is 2105
+2022-03-01 10:45:36,575 INFO [decode.py:341] batch 132/?, cuts processed until now is 2152
+2022-03-01 10:45:40,656 INFO [decode.py:341] batch 134/?, cuts processed until now is 2172
+2022-03-01 10:45:44,800 INFO [decode.py:341] batch 136/?, cuts processed until now is 2206
+2022-03-01 10:45:48,055 INFO [decode.py:341] batch 138/?, cuts processed until now is 2228
+2022-03-01 10:45:51,102 INFO [decode.py:341] batch 140/?, cuts processed until now is 2238
+2022-03-01 10:45:54,372 INFO [decode.py:341] batch 142/?, cuts processed until now is 2290
+2022-03-01 10:45:57,482 INFO [decode.py:341] batch 144/?, cuts processed until now is 2321
+2022-03-01 10:45:59,750 INFO [decode.py:341] batch 146/?, cuts processed until now is 2353
+2022-03-01 10:46:02,926 INFO [decode.py:341] batch 148/?, cuts processed until now is 2410
+2022-03-01 10:46:05,895 INFO [decode.py:341] batch 150/?, cuts processed until now is 2420
+2022-03-01 10:46:09,090 INFO [decode.py:341] batch 152/?, cuts processed until now is 2456
+2022-03-01 10:46:12,132 INFO [decode.py:341] batch 154/?, cuts processed until now is 2479
+2022-03-01 10:46:15,194 INFO [decode.py:341] batch 156/?, cuts processed until now is 2496
+2022-03-01 10:46:17,202 INFO [decode.py:341] batch 158/?, cuts processed until now is 2513
+2022-03-01 10:46:20,516 INFO [decode.py:341] batch 160/?, cuts processed until now is 2531
+2022-03-01 10:46:23,642 INFO [decode.py:341] batch 162/?, cuts processed until now is 2555
+2022-03-01 10:46:26,860 INFO [decode.py:341] batch 164/?, cuts processed until now is 2587
+2022-03-01 10:46:29,979 INFO [decode.py:341] batch 166/?, cuts processed until now is 2621
+2022-03-01 10:46:33,252 INFO [decode.py:341] batch 168/?, cuts processed until now is 2650
+2022-03-01 10:46:35,338 INFO [decode.py:341] batch 170/?, cuts processed until now is 2661
+2022-03-01 10:46:38,675 INFO [decode.py:341] batch 172/?, cuts processed until now is 2673
+2022-03-01 10:46:42,668 INFO [decode.py:341] batch 174/?, cuts processed until now is 2698
+2022-03-01 10:46:46,996 INFO [decode.py:341] batch 176/?, cuts processed until now is 2721
+2022-03-01 10:46:51,185 INFO [decode.py:341] batch 178/?, cuts processed until now is 2737
+2022-03-01 10:46:54,152 INFO [decode.py:341] batch 180/?, cuts processed until now is 2758
+2022-03-01 10:46:58,351 INFO [decode.py:341] batch 182/?, cuts processed until now is 2770
+2022-03-01 10:47:02,462 INFO [decode.py:341] batch 184/?, cuts processed until now is 2786
+2022-03-01 10:47:06,254 INFO [decode.py:341] batch 186/?, cuts processed until now is 2805
+2022-03-01 10:47:10,214 INFO [decode.py:341] batch 188/?, cuts processed until now is 2817
+2022-03-01 10:47:12,517 INFO [decode.py:341] batch 190/?, cuts processed until now is 2825
+2022-03-01 10:47:16,292 INFO [decode.py:341] batch 192/?, cuts processed until now is 2843
+2022-03-01 10:47:20,752 INFO [decode.py:341] batch 194/?, cuts processed until now is 2857
+2022-03-01 10:47:25,151 INFO [decode.py:341] batch 196/?, cuts processed until now is 2871
+2022-03-01 10:47:29,706 INFO [decode.py:341] batch 198/?, cuts processed until now is 2885
+2022-03-01 10:47:43,670 INFO [decode.py:341] batch 200/?, cuts processed until now is 2899
+2022-03-01 10:48:00,238 INFO [decode.py:341] batch 202/?, cuts processed until now is 2913
+2022-03-01 10:48:17,396 INFO [decode.py:341] batch 204/?, cuts processed until now is 2927
+2022-03-01 10:48:31,564 INFO [decode.py:341] batch 206/?, cuts processed until now is 2939
+2022-03-01 10:48:31,719 INFO [decode.py:358] The transcripts are stored in transducer_stateless_multi_datasets/exp-full-2/modified_beam_search/recogs-test-other-beam_4-epoch-39-avg-15-beam-4.txt
+2022-03-01 10:48:31,793 INFO [utils.py:404] [test-other-beam_4] %WER 6.46% [3381 / 52343, 362 ins, 294 del, 2725 sub ]
+2022-03-01 10:48:32,010 INFO [decode.py:371] Wrote detailed error stats to transducer_stateless_multi_datasets/exp-full-2/modified_beam_search/errs-test-other-beam_4-epoch-39-avg-15-beam-4.txt
+2022-03-01 10:48:32,011 INFO [decode.py:388] 
+For test-other, WER of different settings are:
+beam_4	6.46	best for test-other
+
+2022-03-01 10:48:32,011 INFO [decode.py:483] Done!

log/log-decode-epoch-39-avg-15-context-2-max-sym-per-frame-1-2022-03-01-10-29-35

@@ -0,0 +1,29 @@
+2022-03-01 10:29:35,513 INFO [decode.py:416] Decoding started
+2022-03-01 10:29:35,513 INFO [decode.py:422] Device: cuda:0
+2022-03-01 10:29:35,519 INFO [decode.py:431] {'feature_dim': 80, 'encoder_out_dim': 512, 'subsampling_factor': 4, 'attention_dim': 512, 'nhead': 8, 'dim_feedforward': 2048, 'num_encoder_layers': 12, 'vgg_frontend': False, 'env_info': {'k2-version': '1.13', 'k2-build-type': 'Release', 'k2-with-cuda': True, 'k2-git-sha1': 'f4fefe4882bc0ae59af951da3f47335d5495ef71', 'k2-git-date': 'Thu Feb 10 15:16:02 2022', 'lhotse-version': '1.0.0.dev+missing.version.file', 'torch-cuda-available': True, 'torch-cuda-version': '10.2', 'python-version': '3.8', 'icefall-git-branch': 'multiple-datasets', 'icefall-git-sha1': 'aadd7ca-clean', 'icefall-git-date': 'Mon Feb 21 15:11:46 2022', 'icefall-path': '/ceph-fj/fangjun/open-source-2/icefall-multi-datasets', 'k2-path': '/ceph-fj/fangjun/open-source-2/k2-multi-datasets/k2/python/k2/__init__.py', 'lhotse-path': '/ceph-fj/fangjun/open-source-2/lhotse-multi-datasets/lhotse/__init__.py', 'hostname': 'de-74279-k2-dev-8-0218134109-68b6994b68-l4qrs', 'IP address': '10.177.63.208'}, 'epoch': 39, 'avg': 15, 'exp_dir': PosixPath('transducer_stateless_multi_datasets/exp-full-2'), 'bpe_model': './data/lang_bpe_500/bpe.model', 'decoding_method': 'greedy_search', 'beam_size': 4, 'context_size': 2, 'max_sym_per_frame': 1, 'max_duration': 100, 'bucketing_sampler': True, 'num_buckets': 30, 'shuffle': True, 'return_cuts': True, 'num_workers': 2, 'enable_spec_aug': True, 'spec_aug_time_warp_factor': 80, 'enable_musan': True, 'manifest_dir': PosixPath('data/fbank'), 'on_the_fly_feats': False, 'res_dir': PosixPath('transducer_stateless_multi_datasets/exp-full-2/greedy_search'), 'suffix': 'epoch-39-avg-15-context-2-max-sym-per-frame-1', 'blank_id': 0, 'vocab_size': 500}
+2022-03-01 10:29:35,519 INFO [decode.py:433] About to create model
+2022-03-01 10:29:36,012 INFO [decode.py:444] averaging ['transducer_stateless_multi_datasets/exp-full-2/epoch-25.pt', 'transducer_stateless_multi_datasets/exp-full-2/epoch-26.pt', 'transducer_stateless_multi_datasets/exp-full-2/epoch-27.pt', 'transducer_stateless_multi_datasets/exp-full-2/epoch-28.pt', 'transducer_stateless_multi_datasets/exp-full-2/epoch-29.pt', 'transducer_stateless_multi_datasets/exp-full-2/epoch-30.pt', 'transducer_stateless_multi_datasets/exp-full-2/epoch-31.pt', 'transducer_stateless_multi_datasets/exp-full-2/epoch-32.pt', 'transducer_stateless_multi_datasets/exp-full-2/epoch-33.pt', 'transducer_stateless_multi_datasets/exp-full-2/epoch-34.pt', 'transducer_stateless_multi_datasets/exp-full-2/epoch-35.pt', 'transducer_stateless_multi_datasets/exp-full-2/epoch-36.pt', 'transducer_stateless_multi_datasets/exp-full-2/epoch-37.pt', 'transducer_stateless_multi_datasets/exp-full-2/epoch-38.pt', 'transducer_stateless_multi_datasets/exp-full-2/epoch-39.pt']
+2022-03-01 10:30:20,294 INFO [decode.py:455] Number of model parameters: 84007924
+2022-03-01 10:30:20,294 INFO [librispeech.py:58] About to get test-clean cuts from data/fbank/cuts_test-clean.json.gz
+2022-03-01 10:30:20,427 INFO [librispeech.py:63] About to get test-other cuts from data/fbank/cuts_test-other.json.gz
+2022-03-01 10:30:21,865 INFO [decode.py:341] batch 0/?, cuts processed until now is 20
+2022-03-01 10:31:36,080 INFO [decode.py:341] batch 100/?, cuts processed until now is 1406
+2022-03-01 10:32:59,172 INFO [decode.py:341] batch 200/?, cuts processed until now is 2563
+2022-03-01 10:33:07,070 INFO [decode.py:358] The transcripts are stored in transducer_stateless_multi_datasets/exp-full-2/greedy_search/recogs-test-clean-greedy_search-epoch-39-avg-15-context-2-max-sym-per-frame-1.txt
+2022-03-01 10:33:07,143 INFO [utils.py:404] [test-clean-greedy_search] %WER 2.64% [1389 / 52576, 162 ins, 111 del, 1116 sub ]
+2022-03-01 10:33:07,355 INFO [decode.py:371] Wrote detailed error stats to transducer_stateless_multi_datasets/exp-full-2/greedy_search/errs-test-clean-greedy_search-epoch-39-avg-15-context-2-max-sym-per-frame-1.txt
+2022-03-01 10:33:07,356 INFO [decode.py:388] 
+For test-clean, WER of different settings are:
+greedy_search	2.64	best for test-clean
+
+2022-03-01 10:33:08,566 INFO [decode.py:341] batch 0/?, cuts processed until now is 23
+2022-03-01 10:34:33,508 INFO [decode.py:341] batch 100/?, cuts processed until now is 1614
+2022-03-01 10:35:55,650 INFO [decode.py:341] batch 200/?, cuts processed until now is 2899
+2022-03-01 10:36:00,523 INFO [decode.py:358] The transcripts are stored in transducer_stateless_multi_datasets/exp-full-2/greedy_search/recogs-test-other-greedy_search-epoch-39-avg-15-context-2-max-sym-per-frame-1.txt
+2022-03-01 10:36:00,599 INFO [utils.py:404] [test-other-greedy_search] %WER 6.55% [3431 / 52343, 360 ins, 321 del, 2750 sub ]
+2022-03-01 10:36:00,819 INFO [decode.py:371] Wrote detailed error stats to transducer_stateless_multi_datasets/exp-full-2/greedy_search/errs-test-other-greedy_search-epoch-39-avg-15-context-2-max-sym-per-frame-1.txt
+2022-03-01 10:36:00,819 INFO [decode.py:388] 
+For test-other, WER of different settings are:
+greedy_search	6.55	best for test-other
+
+2022-03-01 10:36:00,820 INFO [decode.py:483] Done!