> Training Environment: | > Backend: Torch | > Mixed precision: False | > Precision: float32 | > Current device: 0 | > Num. of GPUs: 1 | > Num. of CPUs: 64 | > Num. of Torch Threads: 1 | > Torch seed: 54321 | > Torch CUDNN: True | > Torch CUDNN deterministic: False | > Torch CUDNN benchmark: False | > Torch TF32 MatMul: False > Start Tensorboard: tensorboard --logdir=/checkpoints/GPT_XTTS_FT-December-22-2024_11+26AM-0000000 > Model has 528275198 parameters  > EPOCH: 0/10 --> /checkpoints/GPT_XTTS_FT-December-22-2024_11+26AM-0000000  > TRAINING (2024-12-22 11:26:59)   --> TIME: 2024-12-22 11:27:03 -- STEP: 0/2322 -- GLOBAL_STEP: 0 | > loss_text_ce: 0.2530462145805359 (0.2530462145805359) | > loss_mel_ce: 5.085217475891113 (5.085217475891113) | > loss: 0.6672829389572144 (0.6672829389572144) | > current_lr: 5e-06 | > step_time: 0.977 (0.9769892692565918) | > loader_time: 2.4113 (2.4113035202026367)  --> TIME: 2024-12-22 11:27:39 -- STEP: 50/2322 -- GLOBAL_STEP: 50 | > loss_text_ce: 0.2519530951976776 (0.24752828538417815) | > loss_mel_ce: 4.792637825012207 (4.971259889602662) | > loss: 0.6305738687515259 (0.6523485243320468) | > current_lr: 5e-06 | > step_time: 0.572 (0.4748188257217407) | > loader_time: 0.0418 (0.041012115478515646)  --> TIME: 2024-12-22 11:28:14 -- STEP: 100/2322 -- GLOBAL_STEP: 100 | > loss_text_ce: 0.23473207652568817 (0.24399676710367202) | > loss_mel_ce: 4.643819332122803 (4.838841361999509) | > loss: 0.6098189353942871 (0.6353547680377962) | > current_lr: 5e-06 | > step_time: 0.5376 (0.4641112446784973) | > loader_time: 0.0525 (0.03901399374008178)  --> TIME: 2024-12-22 11:28:51 -- STEP: 150/2322 -- GLOBAL_STEP: 150 | > loss_text_ce: 0.22992762923240662 (0.23955518762270608) | > loss_mel_ce: 4.568089485168457 (4.763177560170488) | > loss: 0.5997521281242371 (0.6253415950139366) | > current_lr: 5e-06 | > step_time: 0.4171 (0.466196084022522) | > loader_time: 0.0391 (0.03972836653391519)  --> TIME: 2024-12-22 11:29:26 -- STEP: 200/2322 -- GLOBAL_STEP: 200 | > loss_text_ce: 0.22239428758621216 (0.2356411088258028) | > loss_mel_ce: 4.591098785400391 (4.703710868358612) | > loss: 0.6016866564750671 (0.6174189981818207) | > current_lr: 5e-06 | > step_time: 0.4163 (0.46508031129837035) | > loader_time: 0.0346 (0.039306550025939926)  --> TIME: 2024-12-22 11:30:02 -- STEP: 250/2322 -- GLOBAL_STEP: 250 | > loss_text_ce: 0.21303792297840118 (0.23170362889766694) | > loss_mel_ce: 4.439981460571289 (4.662507137298582) | > loss: 0.5816274285316467 (0.6117763469219212) | > current_lr: 5e-06 | > step_time: 0.4665 (0.4646471948623657) | > loader_time: 0.0385 (0.038590292930603017)  --> TIME: 2024-12-22 11:30:37 -- STEP: 300/2322 -- GLOBAL_STEP: 300 | > loss_text_ce: 0.20455437898635864 (0.22782549391190207) | > loss_mel_ce: 4.470847129821777 (4.624527915318805) | > loss: 0.5844252109527588 (0.606544176737468) | > current_lr: 5e-06 | > step_time: 0.4659 (0.463646289507548) | > loader_time: 0.031 (0.037736974557240795)  --> TIME: 2024-12-22 11:31:13 -- STEP: 350/2322 -- GLOBAL_STEP: 350 | > loss_text_ce: 0.2059239149093628 (0.22435995829956867) | > loss_mel_ce: 4.430941104888916 (4.5904672799791575) | > loss: 0.579608142375946 (0.6018534060886929) | > current_lr: 5e-06 | > step_time: 0.4295 (0.4637547322681972) | > loader_time: 0.0327 (0.03703739915575298)  --> TIME: 2024-12-22 11:31:49 -- STEP: 400/2322 -- GLOBAL_STEP: 400 | > loss_text_ce: 0.19573615491390228 (0.2208379519730806) | > loss_mel_ce: 4.317454814910889 (4.563533273935316) | > loss: 0.5641488432884216 (0.598046403974295) | > current_lr: 5e-06 | > step_time: 0.4167 (0.4652076530456543) | > loader_time: 0.0388 (0.036983267664909364)  --> TIME: 2024-12-22 11:32:25 -- STEP: 450/2322 -- GLOBAL_STEP: 450 | > loss_text_ce: 0.18778377771377563 (0.21738604118426638) | > loss_mel_ce: 4.208941459655762 (4.539658430947201) | > loss: 0.5495906472206116 (0.5946305595503916) | > current_lr: 5e-06 | > step_time: 0.4922 (0.46564721743265786) | > loader_time: 0.0373 (0.036927209430270724)  --> TIME: 2024-12-22 11:33:01 -- STEP: 500/2322 -- GLOBAL_STEP: 500 | > loss_text_ce: 0.18229594826698303 (0.21399873515963552) | > loss_mel_ce: 4.356030464172363 (4.516777070045473) | > loss: 0.5672907829284668 (0.5913469763994219) | > current_lr: 5e-06 | > step_time: 0.4301 (0.4659002928733826) | > loader_time: 0.0337 (0.036838791370391845)  --> TIME: 2024-12-22 11:33:37 -- STEP: 550/2322 -- GLOBAL_STEP: 550 | > loss_text_ce: 0.17852988839149475 (0.21065986522219396) | > loss_mel_ce: 4.274847507476807 (4.495710451819681) | > loss: 0.5566721558570862 (0.5882962900942024) | > current_lr: 5e-06 | > step_time: 0.4114 (0.4658974096991799) | > loader_time: 0.0323 (0.036689932563088154)  --> TIME: 2024-12-22 11:34:12 -- STEP: 600/2322 -- GLOBAL_STEP: 600 | > loss_text_ce: 0.17110136151313782 (0.20735888558129473) | > loss_mel_ce: 4.3340044021606445 (4.477433528105417) | > loss: 0.5631382465362549 (0.5855990522106488) | > current_lr: 5e-06 | > step_time: 0.3864 (0.4651001199086507) | > loader_time: 0.029 (0.036557054917017634)  --> TIME: 2024-12-22 11:34:48 -- STEP: 650/2322 -- GLOBAL_STEP: 650 | > loss_text_ce: 0.15984788537025452 (0.20407032815309661) | > loss_mel_ce: 4.1352996826171875 (4.460706098996674) | > loss: 0.5368934273719788 (0.5830970536745511) | > current_lr: 5e-06 | > step_time: 0.4853 (0.46496966325319733) | > loader_time: 0.0392 (0.03647723821493297)  --> TIME: 2024-12-22 11:35:24 -- STEP: 700/2322 -- GLOBAL_STEP: 700 | > loss_text_ce: 0.1551288515329361 (0.2008209100152764) | > loss_mel_ce: 4.289712905883789 (4.446047600337434) | > loss: 0.5556052327156067 (0.5808585637807845) | > current_lr: 5e-06 | > step_time: 0.4663 (0.465340895993369) | > loader_time: 0.0356 (0.03642505202974589)  --> TIME: 2024-12-22 11:35:59 -- STEP: 750/2322 -- GLOBAL_STEP: 750 | > loss_text_ce: 0.15145930647850037 (0.1975747790336608) | > loss_mel_ce: 4.2386040687561035 (4.431685067494702) | > loss: 0.5487579107284546 (0.5786574806372328) | > current_lr: 5e-06 | > step_time: 0.4287 (0.46469851779937743) | > loader_time: 0.0355 (0.03636256567637125)  --> TIME: 2024-12-22 11:36:35 -- STEP: 800/2322 -- GLOBAL_STEP: 800 | > loss_text_ce: 0.1394500434398651 (0.19431897059082978) | > loss_mel_ce: 4.17852258682251 (4.417942085862154) | > loss: 0.5397465825080872 (0.5765326319634914) | > current_lr: 5e-06 | > step_time: 0.4128 (0.4646125116944313) | > loader_time: 0.0354 (0.03636121779680248)  --> TIME: 2024-12-22 11:37:12 -- STEP: 850/2322 -- GLOBAL_STEP: 850 | > loss_text_ce: 0.13224540650844574 (0.19110006449853667) | > loss_mel_ce: 4.25133752822876 (4.404978122150196) | > loss: 0.547947883605957 (0.5745097731842711) | > current_lr: 5e-06 | > step_time: 0.5449 (0.4650430166020113) | > loader_time: 0.0431 (0.03634578480440025)  --> TIME: 2024-12-22 11:37:47 -- STEP: 900/2322 -- GLOBAL_STEP: 900 | > loss_text_ce: 0.1351826936006546 (0.1879877815478377) | > loss_mel_ce: 4.1280999183654785 (4.392053176032171) | > loss: 0.5329103469848633 (0.5725051195753942) | > current_lr: 5e-06 | > step_time: 0.4534 (0.46466527462005613) | > loader_time: 0.0309 (0.03633786042531326)  --> TIME: 2024-12-22 11:38:23 -- STEP: 950/2322 -- GLOBAL_STEP: 950 | > loss_text_ce: 0.12836787104606628 (0.18501411993252598) | > loss_mel_ce: 4.1709747314453125 (4.378682505457023) | > loss: 0.5374178290367126 (0.5704620778246926) | > current_lr: 5e-06 | > step_time: 0.432 (0.4645633775309512) | > loader_time: 0.0335 (0.03632457055543594)  --> TIME: 2024-12-22 11:38:58 -- STEP: 1000/2322 -- GLOBAL_STEP: 1000 | > loss_text_ce: 0.125458225607872 (0.18216444663703435) | > loss_mel_ce: 4.00344705581665 (4.366293809890745) | > loss: 0.5161131620407104 (0.5685572816431519) | > current_lr: 5e-06 | > step_time: 0.4299 (0.46441864109039305) | > loader_time: 0.0338 (0.03637665557861324)  --> TIME: 2024-12-22 11:39:34 -- STEP: 1050/2322 -- GLOBAL_STEP: 1050 | > loss_text_ce: 0.12487774342298508 (0.17943835232229455) | > loss_mel_ce: 4.146235942840576 (4.354810301916937) | > loss: 0.5338892340660095 (0.5667810812166756) | > current_lr: 5e-06 | > step_time: 0.4532 (0.4643201691763742) | > loader_time: 0.0296 (0.0363550336020333)  --> TIME: 2024-12-22 11:40:09 -- STEP: 1100/2322 -- GLOBAL_STEP: 1100 | > loss_text_ce: 0.12050288915634155 (0.1768324163285168) | > loss_mel_ce: 4.093320846557617 (4.3449719524383505) | > loss: 0.5267279744148254 (0.5652255455201319) | > current_lr: 5e-06 | > step_time: 0.4552 (0.4641665337302469) | > loader_time: 0.0382 (0.03632745330983939)  --> TIME: 2024-12-22 11:40:45 -- STEP: 1150/2322 -- GLOBAL_STEP: 1150 | > loss_text_ce: 0.11516667157411575 (0.17433122684126307) | > loss_mel_ce: 4.095541477203369 (4.334519230593803) | > loss: 0.526338517665863 (0.5636063068068543) | > current_lr: 5e-06 | > step_time: 0.4661 (0.4640763809369959) | > loader_time: 0.0314 (0.03632057335065755)  --> TIME: 2024-12-22 11:41:21 -- STEP: 1200/2322 -- GLOBAL_STEP: 1200 | > loss_text_ce: 0.11734075099229813 (0.17191034689545626) | > loss_mel_ce: 3.9981796741485596 (4.324043659170469) | > loss: 0.5144400596618652 (0.5619942504415902) | > current_lr: 5e-06 | > step_time: 0.4427 (0.4641764706373216) | > loader_time: 0.0366 (0.03631635427474973)  --> TIME: 2024-12-22 11:41:56 -- STEP: 1250/2322 -- GLOBAL_STEP: 1250 | > loss_text_ce: 0.11479064077138901 (0.16962148438692087) | > loss_mel_ce: 4.043733596801758 (4.314776177406311) | > loss: 0.5198155045509338 (0.5605497074842448) | > current_lr: 5e-06 | > step_time: 0.3863 (0.4639850841522218) | > loader_time: 0.0353 (0.03627616081237792)  --> TIME: 2024-12-22 11:42:32 -- STEP: 1300/2322 -- GLOBAL_STEP: 1300 | > loss_text_ce: 0.10983938723802567 (0.16735407824699694) | > loss_mel_ce: 4.203815460205078 (4.305780103390032) | > loss: 0.539206862449646 (0.5591417725040358) | > current_lr: 5e-06 | > step_time: 0.4885 (0.46390105522595926) | > loader_time: 0.0373 (0.03623527801953829)  --> TIME: 2024-12-22 11:43:07 -- STEP: 1350/2322 -- GLOBAL_STEP: 1350 | > loss_text_ce: 0.11374546587467194 (0.16522232413291926) | > loss_mel_ce: 4.021005153656006 (4.296753633463821) | > loss: 0.516843855381012 (0.5577469946057705) | > current_lr: 5e-06 | > step_time: 0.4643 (0.463655838613157) | > loader_time: 0.0313 (0.03616576477333352)  --> TIME: 2024-12-22 11:43:43 -- STEP: 1400/2322 -- GLOBAL_STEP: 1400 | > loss_text_ce: 0.10654930025339127 (0.16315144186041192) | > loss_mel_ce: 4.086061954498291 (4.287959182092118) | > loss: 0.5240764021873474 (0.556388828094516) | > current_lr: 5e-06 | > step_time: 0.4 (0.46375009059906014) | > loader_time: 0.0326 (0.03612212198121209)  --> TIME: 2024-12-22 11:44:18 -- STEP: 1450/2322 -- GLOBAL_STEP: 1450 | > loss_text_ce: 0.10815200209617615 (0.1611455727034602) | > loss_mel_ce: 4.043893814086914 (4.279653240894446) | > loss: 0.5190057158470154 (0.5550998519823475) | > current_lr: 5e-06 | > step_time: 0.4375 (0.46344571162914416) | > loader_time: 0.0297 (0.03606331282648552)  --> TIME: 2024-12-22 11:44:54 -- STEP: 1500/2322 -- GLOBAL_STEP: 1500 | > loss_text_ce: 0.10736271739006042 (0.15920336287717035) | > loss_mel_ce: 4.064591884613037 (4.271503430207571) | > loss: 0.5214943289756775 (0.5538383493423467) | > current_lr: 5e-06 | > step_time: 0.4549 (0.4634764666557313) | > loader_time: 0.032 (0.03603397496541346)  --> TIME: 2024-12-22 11:45:29 -- STEP: 1550/2322 -- GLOBAL_STEP: 1550 | > loss_text_ce: 0.10297991335391998 (0.157331563993808) | > loss_mel_ce: 4.048224925994873 (4.2638263633174285) | > loss: 0.5189006328582764 (0.5526447411506409) | > current_lr: 5e-06 | > step_time: 0.4517 (0.463476899516198) | > loader_time: 0.0367 (0.03601055683628212)  --> TIME: 2024-12-22 11:46:06 -- STEP: 1600/2322 -- GLOBAL_STEP: 1600 | > loss_text_ce: 0.09907420724630356 (0.15551578890066628) | > loss_mel_ce: 4.084766864776611 (4.256289355009791) | > loss: 0.5229801535606384 (0.5514756432734431) | > current_lr: 5e-06 | > step_time: 0.4357 (0.4637131020426751) | > loader_time: 0.0358 (0.03601108878850939)  --> TIME: 2024-12-22 11:46:42 -- STEP: 1650/2322 -- GLOBAL_STEP: 1650 | > loss_text_ce: 0.09642602503299713 (0.1537433748037529) | > loss_mel_ce: 4.055901050567627 (4.249136765797932) | > loss: 0.5190408825874329 (0.5503600179607215) | > current_lr: 5e-06 | > step_time: 0.4687 (0.4638114553509337) | > loader_time: 0.0321 (0.036008804494684445)  --> TIME: 2024-12-22 11:47:18 -- STEP: 1700/2322 -- GLOBAL_STEP: 1700 | > loss_text_ce: 0.09802189469337463 (0.15205106164164436) | > loss_mel_ce: 4.001745223999023 (4.242188008813295) | > loss: 0.5124709010124207 (0.5492798841876143) | > current_lr: 5e-06 | > step_time: 0.4304 (0.4640892588391024) | > loader_time: 0.0349 (0.03601830440409044)  --> TIME: 2024-12-22 11:47:54 -- STEP: 1750/2322 -- GLOBAL_STEP: 1750 | > loss_text_ce: 0.08611434698104858 (0.15039151180216276) | > loss_mel_ce: 4.036783695220947 (4.235875848361421) | > loss: 0.5153622627258301 (0.5482834203924453) | > current_lr: 5e-06 | > step_time: 0.5496 (0.463982705797468) | > loader_time: 0.0405 (0.03603122016361784)  --> TIME: 2024-12-22 11:48:29 -- STEP: 1800/2322 -- GLOBAL_STEP: 1800 | > loss_text_ce: 0.08751840144395828 (0.14879192525727913) | > loss_mel_ce: 4.010566711425781 (4.229032619264392) | > loss: 0.5122606158256531 (0.5472280684444641) | > current_lr: 5e-06 | > step_time: 0.3743 (0.46379546602567046) | > loader_time: 0.0351 (0.03602115511894226)  --> TIME: 2024-12-22 11:49:04 -- STEP: 1850/2322 -- GLOBAL_STEP: 1850 | > loss_text_ce: 0.0930122509598732 (0.1472384589709143) | > loss_mel_ce: 3.955056667327881 (4.222203999596671) | > loss: 0.5060086250305176 (0.5461803077523778) | > current_lr: 5e-06 | > step_time: 0.4884 (0.46374154425956116) | > loader_time: 0.0327 (0.03602384618810705)  --> TIME: 2024-12-22 11:49:40 -- STEP: 1900/2322 -- GLOBAL_STEP: 1900 | > loss_text_ce: 0.08477382361888885 (0.14571948446725574) | > loss_mel_ce: 3.8823776245117188 (4.21574178808614) | > loss: 0.4958939254283905 (0.5451826594691532) | > current_lr: 5e-06 | > step_time: 0.4509 (0.4637713817546243) | > loader_time: 0.0398 (0.03600347820081209)  --> TIME: 2024-12-22 11:50:16 -- STEP: 1950/2322 -- GLOBAL_STEP: 1950 | > loss_text_ce: 0.08470863848924637 (0.14424753363315904) | > loss_mel_ce: 4.027495384216309 (4.209731359970877) | > loss: 0.5140255093574524 (0.5442473621551812) | > current_lr: 5e-06 | > step_time: 0.4884 (0.463829213655912) | > loader_time: 0.0504 (0.03593394169440636)  --> TIME: 2024-12-22 11:50:51 -- STEP: 2000/2322 -- GLOBAL_STEP: 2000 | > loss_text_ce: 0.08173445612192154 (0.14281660969927937) | > loss_mel_ce: 3.9529123306274414 (4.203545567035677) | > loss: 0.5043308734893799 (0.5432952725142245) | > current_lr: 5e-06 | > step_time: 0.419 (0.4636869518756867) | > loader_time: 0.0311 (0.03584446442127228)  --> TIME: 2024-12-22 11:51:26 -- STEP: 2050/2322 -- GLOBAL_STEP: 2050 | > loss_text_ce: 0.08382633328437805 (0.14143969696469452) | > loss_mel_ce: 4.006777763366699 (4.197507537516154) | > loss: 0.5113255381584167 (0.5423684048361899) | > current_lr: 5e-06 | > step_time: 0.4657 (0.4634868336886895) | > loader_time: 0.0388 (0.0357816346098737)  --> TIME: 2024-12-22 11:52:01 -- STEP: 2100/2322 -- GLOBAL_STEP: 2100 | > loss_text_ce: 0.08509717881679535 (0.14011089529664772) | > loss_mel_ce: 4.034221649169922 (4.191829716818675) | > loss: 0.514914870262146 (0.5414925770532522) | > current_lr: 5e-06 | > step_time: 0.4914 (0.46312098037628907) | > loader_time: 0.0311 (0.03569989056814284)  --> TIME: 2024-12-22 11:52:36 -- STEP: 2150/2322 -- GLOBAL_STEP: 2150 | > loss_text_ce: 0.08064962178468704 (0.1388060712017295) | > loss_mel_ce: 3.957369565963745 (4.186203351020814) | > loss: 0.5047523975372314 (0.5406261783561046) | > current_lr: 5e-06 | > step_time: 0.4653 (0.46318638568700754) | > loader_time: 0.0392 (0.03565392682718675)  --> TIME: 2024-12-22 11:53:12 -- STEP: 2200/2322 -- GLOBAL_STEP: 2200 | > loss_text_ce: 0.0836881622672081 (0.13754234724424122) | > loss_mel_ce: 3.9271059036254883 (4.180703059326519) | > loss: 0.5013492703437805 (0.5397806764055385) | > current_lr: 5e-06 | > step_time: 0.5021 (0.46324028654532007) | > loader_time: 0.0329 (0.035596780343489204)  --> TIME: 2024-12-22 11:53:48 -- STEP: 2250/2322 -- GLOBAL_STEP: 2250 | > loss_text_ce: 0.08315614610910416 (0.136332852608628) | > loss_mel_ce: 3.9954161643981934 (4.175249458842807) | > loss: 0.5098215341567993 (0.5389477895233369) | > current_lr: 5e-06 | > step_time: 0.5772 (0.46327219019995797) | > loader_time: 0.0431 (0.03554827054341633)  --> TIME: 2024-12-22 11:54:24 -- STEP: 2300/2322 -- GLOBAL_STEP: 2300 | > loss_text_ce: 0.08290847390890121 (0.13515926069863493) | > loss_mel_ce: 3.9278173446655273 (4.169745903015137) | > loss: 0.5013407468795776 (0.5381131460485249) | > current_lr: 5e-06 | > step_time: 0.4659 (0.4633499615088753) | > loader_time: 0.0316 (0.03549113180326379)  > EVALUATION  --> EVAL PERFORMANCE | > avg_loader_time: 0.19730509892858633 (+0) | > avg_loss_text_ce: 0.07578372616659511 (+0) | > avg_loss_mel_ce: 3.847918421331078 (+0) | > avg_loss: 3.9237021508843006 (+0)  > EPOCH: 1/10 --> /checkpoints/GPT_XTTS_FT-December-22-2024_11+26AM-0000000  > TRAINING (2024-12-22 11:56:31)   --> TIME: 2024-12-22 11:56:53 -- STEP: 28/2322 -- GLOBAL_STEP: 2350 | > loss_text_ce: 0.08205411583185196 (0.0807053494666304) | > loss_mel_ce: 3.919638156890869 (3.9259592464991977) | > loss: 0.5002115368843079 (0.5008330738970213) | > current_lr: 5e-06 | > step_time: 0.4646 (0.469193092414311) | > loader_time: 0.0401 (0.03677861179624285)  --> TIME: 2024-12-22 11:57:28 -- STEP: 78/2322 -- GLOBAL_STEP: 2400 | > loss_text_ce: 0.07956216484308243 (0.08064665482976499) | > loss_mel_ce: 3.9128811359405518 (3.9120480525187955) | > loss: 0.499055415391922 (0.49908683620966404) | > current_lr: 5e-06 | > step_time: 0.4651 (0.4609218346766936) | > loader_time: 0.03 (0.035483665955372355)  --> TIME: 2024-12-22 11:58:03 -- STEP: 128/2322 -- GLOBAL_STEP: 2450 | > loss_text_ce: 0.07765382528305054 (0.08030749758472669) | > loss_mel_ce: 3.859226942062378 (3.9080324582755566) | > loss: 0.49211010336875916 (0.4985424927435816) | > current_lr: 5e-06 | > step_time: 0.3747 (0.4581131748855114) | > loader_time: 0.0385 (0.035082072019577054)  --> TIME: 2024-12-22 11:58:39 -- STEP: 178/2322 -- GLOBAL_STEP: 2500 | > loss_text_ce: 0.07950159162282944 (0.07992480264118548) | > loss_mel_ce: 4.061079025268555 (3.9100331242164867) | > loss: 0.5175725817680359 (0.49874474024504756) | > current_lr: 5e-06 | > step_time: 0.442 (0.460350080822291) | > loader_time: 0.0291 (0.03505270266800785)  --> TIME: 2024-12-22 11:59:14 -- STEP: 228/2322 -- GLOBAL_STEP: 2550 | > loss_text_ce: 0.08108857274055481 (0.07962884652640738) | > loss_mel_ce: 4.011130332946777 (3.906692063599302) | > loss: 0.5115273594856262 (0.49829011345118807) | > current_lr: 5e-06 | > step_time: 0.4835 (0.4614200612954926) | > loader_time: 0.0398 (0.03506590922673545)  --> TIME: 2024-12-22 11:59:51 -- STEP: 278/2322 -- GLOBAL_STEP: 2600 | > loss_text_ce: 0.07609720528125763 (0.07942164413255753) | > loss_mel_ce: 3.9057936668395996 (3.9038843568280446) | > loss: 0.4977363646030426 (0.49791325006982406) | > current_lr: 5e-06 | > step_time: 0.445 (0.4653521527489312) | > loader_time: 0.0292 (0.035277500427026556)  --> TIME: 2024-12-22 12:00:27 -- STEP: 328/2322 -- GLOBAL_STEP: 2650 | > loss_text_ce: 0.07821682095527649 (0.07919995532166668) | > loss_mel_ce: 3.901764154434204 (3.8989291423704566) | > loss: 0.4974976181983948 (0.49726613710929707) | > current_lr: 5e-06 | > step_time: 0.4359 (0.46499277251522714) | > loader_time: 0.0309 (0.0351661552743214)  --> TIME: 2024-12-22 12:01:02 -- STEP: 378/2322 -- GLOBAL_STEP: 2700 | > loss_text_ce: 0.07392067462205887 (0.07897616242842065) | > loss_mel_ce: 3.8986432552337646 (3.8971006573823392) | > loss: 0.49657049775123596 (0.49700960240982195) | > current_lr: 5e-06 | > step_time: 0.4684 (0.46388059318381014) | > loader_time: 0.0302 (0.034649264244806244)  --> TIME: 2024-12-22 12:01:37 -- STEP: 428/2322 -- GLOBAL_STEP: 2750 | > loss_text_ce: 0.07816468924283981 (0.07877792767901841) | > loss_mel_ce: 3.9022061824798584 (3.893749427572589) | > loss: 0.49754634499549866 (0.49656591905611697) | > current_lr: 5e-06 | > step_time: 0.456 (0.46336689006502385) | > loader_time: 0.0293 (0.0340867889261692)  --> TIME: 2024-12-22 12:02:12 -- STEP: 478/2322 -- GLOBAL_STEP: 2800 | > loss_text_ce: 0.07412288337945938 (0.07856870961675581) | > loss_mel_ce: 3.8410184383392334 (3.8918690866007464) | > loss: 0.4893926680088043 (0.49630472406932) | > current_lr: 5e-06 | > step_time: 0.4505 (0.46302670814003405) | > loader_time: 0.0318 (0.0338493645440585)  --> TIME: 2024-12-22 12:02:48 -- STEP: 528/2322 -- GLOBAL_STEP: 2850 | > loss_text_ce: 0.07515037059783936 (0.07830919699291837) | > loss_mel_ce: 3.8430988788604736 (3.8877929024624103) | > loss: 0.48978114128112793 (0.49576276190804713) | > current_lr: 5e-06 | > step_time: 0.4349 (0.4636493876124873) | > loader_time: 0.0312 (0.03375166880361966)  --> TIME: 2024-12-22 12:03:24 -- STEP: 578/2322 -- GLOBAL_STEP: 2900 | > loss_text_ce: 0.07353952527046204 (0.07807728613381978) | > loss_mel_ce: 3.8123459815979004 (3.885490921129405) | > loss: 0.485735684633255 (0.49544602555180917) | > current_lr: 5e-06 | > step_time: 0.5444 (0.4639756691909579) | > loader_time: 0.0315 (0.03370965104614578)  --> TIME: 2024-12-22 12:03:59 -- STEP: 628/2322 -- GLOBAL_STEP: 2950 | > loss_text_ce: 0.08018277585506439 (0.0778622015432757) | > loss_mel_ce: 3.8410885334014893 (3.8828601928273585) | > loss: 0.49015891551971436 (0.49509029897155277) | > current_lr: 5e-06 | > step_time: 0.3696 (0.463913282391372) | > loader_time: 0.0315 (0.03365892741330873)  --> TIME: 2024-12-22 12:04:34 -- STEP: 678/2322 -- GLOBAL_STEP: 3000 | > loss_text_ce: 0.07450820505619049 (0.07766078750995761) | > loss_mel_ce: 3.842301845550537 (3.880699925718054) | > loss: 0.4896012544631958 (0.4947950887908626) | > current_lr: 5e-06 | > step_time: 0.4921 (0.4629949503591982) | > loader_time: 0.0319 (0.03352946341916879)  --> TIME: 2024-12-22 12:05:09 -- STEP: 728/2322 -- GLOBAL_STEP: 3050 | > loss_text_ce: 0.07521761953830719 (0.07748106919269966) | > loss_mel_ce: 3.7010529041290283 (3.877863790635224) | > loss: 0.472033828496933 (0.49441810721879476) | > current_lr: 5e-06 | > step_time: 0.4303 (0.4628686335060623) | > loader_time: 0.0315 (0.03346973723107647)  --> TIME: 2024-12-22 12:05:44 -- STEP: 778/2322 -- GLOBAL_STEP: 3100 | > loss_text_ce: 0.07071268558502197 (0.07729294758223015) | > loss_mel_ce: 3.7258567810058594 (3.8745785053714075) | > loss: 0.474571168422699 (0.49398393143724967) | > current_lr: 5e-06 | > step_time: 0.4914 (0.4625744865608706) | > loader_time: 0.0324 (0.033410613518447714)  --> TIME: 2024-12-22 12:06:19 -- STEP: 828/2322 -- GLOBAL_STEP: 3150 | > loss_text_ce: 0.07221857458353043 (0.07712332548906549) | > loss_mel_ce: 3.8114869594573975 (3.8721250808181393) | > loss: 0.4854632019996643 (0.4936560506478024) | > current_lr: 5e-06 | > step_time: 0.4639 (0.46221333310224005) | > loader_time: 0.0303 (0.03337904969275291)  --> TIME: 2024-12-22 12:06:54 -- STEP: 878/2322 -- GLOBAL_STEP: 3200 | > loss_text_ce: 0.07444940507411957 (0.07694942826630041) | > loss_mel_ce: 3.794198513031006 (3.8699746810765365) | > loss: 0.48358097672462463 (0.49336551347055846) | > current_lr: 5e-06 | > step_time: 0.4652 (0.4618587390708489) | > loader_time: 0.0305 (0.033342633269099316)  --> TIME: 2024-12-22 12:07:30 -- STEP: 928/2322 -- GLOBAL_STEP: 3250 | > loss_text_ce: 0.07351190596818924 (0.07675740055354503) | > loss_mel_ce: 3.8975071907043457 (3.8676668981025957) | > loss: 0.4963773787021637 (0.4930530370630581) | > current_lr: 5e-06 | > step_time: 0.3698 (0.4619192596653412) | > loader_time: 0.0292 (0.03330393495230845)  --> TIME: 2024-12-22 12:08:05 -- STEP: 978/2322 -- GLOBAL_STEP: 3300 | > loss_text_ce: 0.07235176116228104 (0.07657853152092492) | > loss_mel_ce: 3.960911273956299 (3.8651392764596606) | > loss: 0.5041579008102417 (0.4927147257852164) | > current_lr: 5e-06 | > step_time: 0.4438 (0.461978464526389) | > loader_time: 0.0288 (0.033167050903804035)  --> TIME: 2024-12-22 12:08:40 -- STEP: 1028/2322 -- GLOBAL_STEP: 3350 | > loss_text_ce: 0.07563523948192596 (0.07640398176321722) | > loss_mel_ce: 3.7559592723846436 (3.862317118431344) | > loss: 0.47894930839538574 (0.4923401373195741) | > current_lr: 5e-06 | > step_time: 0.4632 (0.4615288917192689) | > loader_time: 0.031 (0.03302069420016699)  --> TIME: 2024-12-22 12:09:16 -- STEP: 1078/2322 -- GLOBAL_STEP: 3400 | > loss_text_ce: 0.07415470480918884 (0.07624803601672564) | > loss_mel_ce: 3.9416234493255615 (3.8601680624684067) | > loss: 0.5019722580909729 (0.49205201209033794) | > current_lr: 5e-06 | > step_time: 0.3682 (0.4620537950289271) | > loader_time: 0.0316 (0.03291802459391244)  --> TIME: 2024-12-22 12:09:52 -- STEP: 1128/2322 -- GLOBAL_STEP: 3450 | > loss_text_ce: 0.06851973384618759 (0.07606096103364694) | > loss_mel_ce: 3.8556535243988037 (3.8575865218402647) | > loss: 0.4905216693878174 (0.49170593515778266) | > current_lr: 5e-06 | > step_time: 0.4045 (0.4621787538342441) | > loader_time: 0.0305 (0.03284339511648144)  --> TIME: 2024-12-22 12:10:27 -- STEP: 1178/2322 -- GLOBAL_STEP: 3500 | > loss_text_ce: 0.0687602162361145 (0.07588168296248277) | > loss_mel_ce: 3.7087950706481934 (3.8548462081238855) | > loss: 0.4721944034099579 (0.49134098620791183) | > current_lr: 5e-06 | > step_time: 0.4658 (0.4619040622775946) | > loader_time: 0.0295 (0.03270711923090836)  --> TIME: 2024-12-22 12:11:02 -- STEP: 1228/2322 -- GLOBAL_STEP: 3550 | > loss_text_ce: 0.0713701918721199 (0.07571924060388963) | > loss_mel_ce: 3.7463066577911377 (3.8531992583010797) | > loss: 0.47720959782600403 (0.4911148121962718) | > current_lr: 5e-06 | > step_time: 0.4294 (0.4619786554905024) | > loader_time: 0.029 (0.0325988135042719)  --> TIME: 2024-12-22 12:11:37 -- STEP: 1278/2322 -- GLOBAL_STEP: 3600 | > loss_text_ce: 0.0736505538225174 (0.07557047258170557) | > loss_mel_ce: 3.8800811767578125 (3.8510848854629085) | > loss: 0.4942164719104767 (0.49083191958578165) | > current_lr: 5e-06 | > step_time: 0.4805 (0.4617228280397274) | > loader_time: 0.0299 (0.032500882663637286)  --> TIME: 2024-12-22 12:12:12 -- STEP: 1328/2322 -- GLOBAL_STEP: 3650 | > loss_text_ce: 0.07592066377401352 (0.07541453944384514) | > loss_mel_ce: 3.738670825958252 (3.8487348843769853) | > loss: 0.47682392597198486 (0.4905186778675002) | > current_lr: 5e-06 | > step_time: 0.4186 (0.4615636182477674) | > loader_time: 0.0301 (0.03241711908794315)  --> TIME: 2024-12-22 12:12:47 -- STEP: 1378/2322 -- GLOBAL_STEP: 3700 | > loss_text_ce: 0.07216043770313263 (0.07524986903038534) | > loss_mel_ce: 3.7724311351776123 (3.846314114652282) | > loss: 0.48057395219802856 (0.490195497848818) | > current_lr: 5e-06 | > step_time: 0.4606 (0.46151157197135617) | > loader_time: 0.0297 (0.0323416537920173)  --> TIME: 2024-12-22 12:13:23 -- STEP: 1428/2322 -- GLOBAL_STEP: 3750 | > loss_text_ce: 0.07390996813774109 (0.07509618293212242) | > loss_mel_ce: 3.697798490524292 (3.843977682730731) | > loss: 0.47146356105804443 (0.4898842331282899) | > current_lr: 5e-06 | > step_time: 0.4928 (0.4616045031894822) | > loader_time: 0.0319 (0.0322773611846091)  --> TIME: 2024-12-22 12:13:59 -- STEP: 1478/2322 -- GLOBAL_STEP: 3800 | > loss_text_ce: 0.06914984434843063 (0.07496219533665736) | > loss_mel_ce: 3.839860200881958 (3.841913259077782) | > loss: 0.48862624168395996 (0.48960943163167153) | > current_lr: 5e-06 | > step_time: 0.4635 (0.4618951890400846) | > loader_time: 0.0303 (0.03222111258680995)  --> TIME: 2024-12-22 12:14:34 -- STEP: 1528/2322 -- GLOBAL_STEP: 3850 | > loss_text_ce: 0.06971309334039688 (0.0748124759771047) | > loss_mel_ce: 3.6958467960357666 (3.839681373216719) | > loss: 0.47069498896598816 (0.4893117310254986) | > current_lr: 5e-06 | > step_time: 0.4164 (0.46201715029346996) | > loader_time: 0.0309 (0.03215811218266717)  --> TIME: 2024-12-22 12:15:10 -- STEP: 1578/2322 -- GLOBAL_STEP: 3900 | > loss_text_ce: 0.07088511437177658 (0.07466676378450315) | > loss_mel_ce: 3.888422966003418 (3.8374796480280366) | > loss: 0.4949135184288025 (0.4890183013012805) | > current_lr: 5e-06 | > step_time: 0.4646 (0.4620522580974757) | > loader_time: 0.0297 (0.03210135799548177)  --> TIME: 2024-12-22 12:15:45 -- STEP: 1628/2322 -- GLOBAL_STEP: 3950 | > loss_text_ce: 0.07198931276798248 (0.07452855415697177) | > loss_mel_ce: 3.6499738693237305 (3.834647185093648) | > loss: 0.46524539589881897 (0.4886469672038163) | > current_lr: 5e-06 | > step_time: 0.3986 (0.4618654874970344) | > loader_time: 0.0288 (0.03203573215212816)  --> TIME: 2024-12-22 12:16:20 -- STEP: 1678/2322 -- GLOBAL_STEP: 4000 | > loss_text_ce: 0.0696544423699379 (0.07440174248011802) | > loss_mel_ce: 3.706737518310547 (3.8324711649579855) | > loss: 0.4720489978790283 (0.48835911323828124) | > current_lr: 5e-06 | > step_time: 0.4194 (0.46199298231763686) | > loader_time: 0.0304 (0.03199120514156998)  --> TIME: 2024-12-22 12:16:56 -- STEP: 1728/2322 -- GLOBAL_STEP: 4050 | > loss_text_ce: 0.06718924641609192 (0.07426340364057706) | > loss_mel_ce: 3.748014211654663 (3.8302795544818595) | > loss: 0.4769004285335541 (0.4880678695281623) | > current_lr: 5e-06 | > step_time: 0.4399 (0.46209429411424524) | > loader_time: 0.0322 (0.03194721526017902)  --> TIME: 2024-12-22 12:17:32 -- STEP: 1778/2322 -- GLOBAL_STEP: 4100 | > loss_text_ce: 0.07131592929363251 (0.07414278760552404) | > loss_mel_ce: 3.699859380722046 (3.827896394397062) | > loss: 0.47139692306518555 (0.4877548975905632) | > current_lr: 5e-06 | > step_time: 0.4837 (0.4623753016121073) | > loader_time: 0.0298 (0.03190637640529336)  --> TIME: 2024-12-22 12:18:07 -- STEP: 1828/2322 -- GLOBAL_STEP: 4150 | > loss_text_ce: 0.06930878013372421 (0.07400622657812003) | > loss_mel_ce: 3.6925649642944336 (3.825463837815583) | > loss: 0.470234215259552 (0.48743375790197424) | > current_lr: 5e-06 | > step_time: 0.4853 (0.4623141773941741) | > loader_time: 0.0313 (0.03187346158455455)  --> TIME: 2024-12-22 12:18:42 -- STEP: 1878/2322 -- GLOBAL_STEP: 4200 | > loss_text_ce: 0.06891480088233948 (0.07388713826148652) | > loss_mel_ce: 3.799234628677368 (3.8233166976223867) | > loss: 0.48351868987083435 (0.4871504793501002) | > current_lr: 5e-06 | > step_time: 0.5898 (0.46220797319381757) | > loader_time: 0.0343 (0.03183297163889185)  --> TIME: 2024-12-22 12:19:17 -- STEP: 1928/2322 -- GLOBAL_STEP: 4250 | > loss_text_ce: 0.06892570108175278 (0.07376760038782944) | > loss_mel_ce: 3.6925082206726074 (3.8211661388023264) | > loss: 0.4701792299747467 (0.48686671725385416) | > current_lr: 5e-06 | > step_time: 0.3911 (0.4619829846368291) | > loader_time: 0.0298 (0.031789862886998754)  --> TIME: 2024-12-22 12:19:52 -- STEP: 1978/2322 -- GLOBAL_STEP: 4300 | > loss_text_ce: 0.06985936313867569 (0.07364050696318622) | > loss_mel_ce: 3.7385759353637695 (3.8193793008734893) | > loss: 0.4760544002056122 (0.4866274758435115) | > current_lr: 5e-06 | > step_time: 0.4639 (0.4620312422182489) | > loader_time: 0.0303 (0.03175436787465474)  --> TIME: 2024-12-22 12:20:28 -- STEP: 2028/2322 -- GLOBAL_STEP: 4350 | > loss_text_ce: 0.0686088278889656 (0.07351898576483804) | > loss_mel_ce: 3.709003448486328 (3.8172449629452574) | > loss: 0.47220152616500854 (0.4863454934496146) | > current_lr: 5e-06 | > step_time: 0.4891 (0.4620908609273635) | > loader_time: 0.0309 (0.03171988598693769)  --> TIME: 2024-12-22 12:21:03 -- STEP: 2078/2322 -- GLOBAL_STEP: 4400 | > loss_text_ce: 0.06669996678829193 (0.07339519823079386) | > loss_mel_ce: 3.8297340869903564 (3.815358415375086) | > loss: 0.4870542585849762 (0.48609420156628036) | > current_lr: 5e-06 | > step_time: 0.4469 (0.46195949420433297) | > loader_time: 0.0309 (0.03171079966514827)  --> TIME: 2024-12-22 12:21:38 -- STEP: 2128/2322 -- GLOBAL_STEP: 4450 | > loss_text_ce: 0.07149401307106018 (0.07328378476370544) | > loss_mel_ce: 3.7921605110168457 (3.813456854986069) | > loss: 0.48295682668685913 (0.4858425798356757) | > current_lr: 5e-06 | > step_time: 0.4175 (0.46183078327125177) | > loader_time: 0.0305 (0.03168359645327243)  --> TIME: 2024-12-22 12:22:12 -- STEP: 2178/2322 -- GLOBAL_STEP: 4500 | > loss_text_ce: 0.06648009270429611 (0.0731701369340043) | > loss_mel_ce: 3.608302116394043 (3.811477836279611) | > loss: 0.45934778451919556 (0.485580996527269) | > current_lr: 5e-06 | > step_time: 0.4659 (0.46160820561663835) | > loader_time: 0.0304 (0.03165727268127931)  --> TIME: 2024-12-22 12:22:48 -- STEP: 2228/2322 -- GLOBAL_STEP: 4550 | > loss_text_ce: 0.0717756599187851 (0.0730591689502315) | > loss_mel_ce: 3.6952781677246094 (3.8098520271653973) | > loss: 0.47088173031806946 (0.4853638994174757) | > current_lr: 5e-06 | > step_time: 0.5407 (0.4618965907413613) | > loader_time: 0.0319 (0.031640884585183784)  --> TIME: 2024-12-22 12:23:24 -- STEP: 2278/2322 -- GLOBAL_STEP: 4600 | > loss_text_ce: 0.06663098931312561 (0.07294841681437814) | > loss_mel_ce: 3.6458563804626465 (3.8079327949837074) | > loss: 0.4640609323978424 (0.48511015137786717) | > current_lr: 5e-06 | > step_time: 0.4441 (0.46200685484352816) | > loader_time: 0.0294 (0.03162491823938262)  > EVALUATION  --> EVAL PERFORMANCE | > avg_loader_time: 0.19047942787709862 (-0.006825671051487708) | > avg_loss_text_ce: 0.0641348733181002 (-0.011648852848494914) | > avg_loss_mel_ce: 3.635368972113638 (-0.2125494492174398) | > avg_loss: 3.699503846842833 (-0.22419830404146746)  > EPOCH: 2/10 --> /checkpoints/GPT_XTTS_FT-December-22-2024_11+26AM-0000000  > TRAINING (2024-12-22 12:25:12)   --> TIME: 2024-12-22 12:25:17 -- STEP: 6/2322 -- GLOBAL_STEP: 4650 | > loss_text_ce: 0.06828965246677399 (0.06761396055420239) | > loss_mel_ce: 3.727180242538452 (3.6996793349583945) | > loss: 0.4744337499141693 (0.4709116667509079) | > current_lr: 5e-06 | > step_time: 0.4996 (0.4877891540527344) | > loader_time: 0.0317 (0.034049550692240395)  --> TIME: 2024-12-22 12:25:53 -- STEP: 56/2322 -- GLOBAL_STEP: 4700 | > loss_text_ce: 0.06508634239435196 (0.06747477169015574) | > loss_mel_ce: 3.7143287658691406 (3.713602457727705) | > loss: 0.4724268913269043 (0.47263465502432417) | > current_lr: 5e-06 | > step_time: 0.4403 (0.46530509846551077) | > loader_time: 0.0318 (0.033006970371518805)  --> TIME: 2024-12-22 12:26:29 -- STEP: 106/2322 -- GLOBAL_STEP: 4750 | > loss_text_ce: 0.06750959903001785 (0.06762431168331288) | > loss_mel_ce: 3.6415882110595703 (3.71818948691746) | > loss: 0.46363723278045654 (0.4732267257739913) | > current_lr: 5e-06 | > step_time: 0.4935 (0.46442873747843616) | > loader_time: 0.0316 (0.032810217929336256)  --> TIME: 2024-12-22 12:27:04 -- STEP: 156/2322 -- GLOBAL_STEP: 4800 | > loss_text_ce: 0.06967833638191223 (0.06757639229106599) | > loss_mel_ce: 3.681201696395874 (3.7120021306551427) | > loss: 0.468860000371933 (0.47244731527872574) | > current_lr: 5e-06 | > step_time: 0.4831 (0.4638998126372313) | > loader_time: 0.0302 (0.032006777249849724)  --> TIME: 2024-12-22 12:27:41 -- STEP: 206/2322 -- GLOBAL_STEP: 4850 | > loss_text_ce: 0.0669780969619751 (0.06729839335295182) | > loss_mel_ce: 3.7688608169555664 (3.708274278825927) | > loss: 0.4794798493385315 (0.4719465840788721) | > current_lr: 5e-06 | > step_time: 0.549 (0.4684325699667329) | > loader_time: 0.0319 (0.03155579266038909)  --> TIME: 2024-12-22 12:28:16 -- STEP: 256/2322 -- GLOBAL_STEP: 4900 | > loss_text_ce: 0.06661108136177063 (0.06732037659094206) | > loss_mel_ce: 3.6394405364990234 (3.704817527905107) | > loss: 0.46325644850730896 (0.47151723806746304) | > current_lr: 5e-06 | > step_time: 0.4363 (0.4662054777145386) | > loader_time: 0.0307 (0.031223031692206787)  --> TIME: 2024-12-22 12:28:51 -- STEP: 306/2322 -- GLOBAL_STEP: 4950 | > loss_text_ce: 0.06869287043809891 (0.06722254324339187) | > loss_mel_ce: 3.6672844886779785 (3.7035586989782994) | > loss: 0.4669971764087677 (0.471347655346191) | > current_lr: 5e-06 | > step_time: 0.4303 (0.4653404397902146) | > loader_time: 0.0281 (0.03099860319125101)  --> TIME: 2024-12-22 12:29:26 -- STEP: 356/2322 -- GLOBAL_STEP: 5000 | > loss_text_ce: 0.06649009138345718 (0.0671649866768818) | > loss_mel_ce: 3.67549467086792 (3.699479623457019) | > loss: 0.46774810552597046 (0.47083057630597874) | > current_lr: 5e-06 | > step_time: 0.3886 (0.4639990758360102) | > loader_time: 0.0288 (0.030789850802903716)  --> TIME: 2024-12-22 12:30:01 -- STEP: 406/2322 -- GLOBAL_STEP: 5050 | > loss_text_ce: 0.06216529384255409 (0.06709050228406346) | > loss_mel_ce: 3.613802909851074 (3.698706446610061) | > loss: 0.45949602127075195 (0.4707246189340582) | > current_lr: 5e-06 | > step_time: 0.4127 (0.46290890688966646) | > loader_time: 0.0285 (0.030669190026269128)  --> TIME: 2024-12-22 12:30:36 -- STEP: 456/2322 -- GLOBAL_STEP: 5100 | > loss_text_ce: 0.06755370646715164 (0.06708799912839343) | > loss_mel_ce: 3.656904697418213 (3.695283024457463) | > loss: 0.4655573070049286 (0.4702963781330669) | > current_lr: 5e-06 | > step_time: 0.439 (0.46233832679296794) | > loader_time: 0.0306 (0.030587515810079704)  --> TIME: 2024-12-22 12:31:11 -- STEP: 506/2322 -- GLOBAL_STEP: 5150 | > loss_text_ce: 0.06680998206138611 (0.06706688413948644) | > loss_mel_ce: 3.693211317062378 (3.6938066105597573) | > loss: 0.4700026512145996 (0.4701091870371061) | > current_lr: 5e-06 | > step_time: 0.4884 (0.4627713766022633) | > loader_time: 0.0304 (0.030579357750330955)  --> TIME: 2024-12-22 12:31:47 -- STEP: 556/2322 -- GLOBAL_STEP: 5200 | > loss_text_ce: 0.065360426902771 (0.06698995679884935) | > loss_mel_ce: 3.726656198501587 (3.6920806731251505) | > loss: 0.47400206327438354 (0.4698838289264296) | > current_lr: 5e-06 | > step_time: 0.4626 (0.4634098466351734) | > loader_time: 0.0302 (0.0305319093971801)  --> TIME: 2024-12-22 12:32:22 -- STEP: 606/2322 -- GLOBAL_STEP: 5250 | > loss_text_ce: 0.06869962811470032 (0.06694501182279572) | > loss_mel_ce: 3.6390793323516846 (3.6913963332034574) | > loss: 0.4634723663330078 (0.46979266832960725) | > current_lr: 5e-06 | > step_time: 0.3885 (0.4631217962050987) | > loader_time: 0.0277 (0.030462170984878762)  --> TIME: 2024-12-22 12:32:58 -- STEP: 656/2322 -- GLOBAL_STEP: 5300 | > loss_text_ce: 0.0636221319437027 (0.06682948259886631) | > loss_mel_ce: 3.621560573577881 (3.6888712826298504) | > loss: 0.460647851228714 (0.4694625958346013) | > current_lr: 5e-06 | > step_time: 0.4176 (0.4632072546860065) | > loader_time: 0.0304 (0.03042615768386094)  --> TIME: 2024-12-22 12:33:33 -- STEP: 706/2322 -- GLOBAL_STEP: 5350 | > loss_text_ce: 0.06371721625328064 (0.06675588593900039) | > loss_mel_ce: 3.783712387084961 (3.687659522967028) | > loss: 0.4809286892414093 (0.469301926262318) | > current_lr: 5e-06 | > step_time: 0.4639 (0.4625983099761832) | > loader_time: 0.0298 (0.030371337369210973)  --> TIME: 2024-12-22 12:34:08 -- STEP: 756/2322 -- GLOBAL_STEP: 5400 | > loss_text_ce: 0.06534083187580109 (0.06672519583393029) | > loss_mel_ce: 3.6383814811706543 (3.6862678521524663) | > loss: 0.4629652798175812 (0.469124131141201) | > current_lr: 5e-06 | > step_time: 0.4911 (0.46285216581253763) | > loader_time: 0.0306 (0.03034175451470428)  --> TIME: 2024-12-22 12:34:44 -- STEP: 806/2322 -- GLOBAL_STEP: 5450 | > loss_text_ce: 0.06209181621670723 (0.06663672601984391) | > loss_mel_ce: 3.608383893966675 (3.6839917779856224) | > loss: 0.4588094651699066 (0.4688285629891285) | > current_lr: 5e-06 | > step_time: 0.4373 (0.46307293150028567) | > loader_time: 0.0282 (0.030319907529182507)  --> TIME: 2024-12-22 12:35:19 -- STEP: 856/2322 -- GLOBAL_STEP: 5500 | > loss_text_ce: 0.06495242565870285 (0.06656121289810141) | > loss_mel_ce: 3.742955207824707 (3.6824526842509475) | > loss: 0.4759884476661682 (0.4686267370723676) | > current_lr: 5e-06 | > step_time: 0.4157 (0.4625772577579889) | > loader_time: 0.0302 (0.03029065934297078)  --> TIME: 2024-12-22 12:35:55 -- STEP: 906/2322 -- GLOBAL_STEP: 5550 | > loss_text_ce: 0.06858200579881668 (0.06650537918948833) | > loss_mel_ce: 3.732349395751953 (3.6808490111075227) | > loss: 0.47511643171310425 (0.46841929879278016) | > current_lr: 5e-06 | > step_time: 0.4531 (0.46309215448813185) | > loader_time: 0.0292 (0.03029308124356973)  --> TIME: 2024-12-22 12:36:30 -- STEP: 956/2322 -- GLOBAL_STEP: 5600 | > loss_text_ce: 0.059323590248823166 (0.06643138262423758) | > loss_mel_ce: 3.6497209072113037 (3.679314073408997) | > loss: 0.4636305570602417 (0.46821818195252246) | > current_lr: 5e-06 | > step_time: 0.4914 (0.4628414723663648) | > loader_time: 0.0318 (0.030283822175349133)  --> TIME: 2024-12-22 12:37:06 -- STEP: 1006/2322 -- GLOBAL_STEP: 5650 | > loss_text_ce: 0.0637035071849823 (0.06636369142081457) | > loss_mel_ce: 3.7182538509368896 (3.6776605785248533) | > loss: 0.4727446734905243 (0.46800303367331303) | > current_lr: 5e-06 | > step_time: 0.5369 (0.4631744452546651) | > loader_time: 0.0319 (0.030302440906850747)  --> TIME: 2024-12-22 12:37:41 -- STEP: 1056/2322 -- GLOBAL_STEP: 5700 | > loss_text_ce: 0.06403090059757233 (0.06631133247830083) | > loss_mel_ce: 3.565476655960083 (3.6764047181967534) | > loss: 0.45368844270706177 (0.4678395063136564) | > current_lr: 5e-06 | > step_time: 0.4321 (0.4632062056299411) | > loader_time: 0.0312 (0.030302985147996363)  --> TIME: 2024-12-22 12:38:16 -- STEP: 1106/2322 -- GLOBAL_STEP: 5750 | > loss_text_ce: 0.06481625884771347 (0.06625944412368975) | > loss_mel_ce: 3.6385345458984375 (3.6746554189306058) | > loss: 0.46291884779930115 (0.46761435795757267) | > current_lr: 5e-06 | > step_time: 0.4668 (0.4630063752800388) | > loader_time: 0.0302 (0.030299973962104324)  --> TIME: 2024-12-22 12:38:51 -- STEP: 1156/2322 -- GLOBAL_STEP: 5800 | > loss_text_ce: 0.06494630873203278 (0.06621898327241924) | > loss_mel_ce: 3.6112489700317383 (3.6737091611413395) | > loss: 0.4595244228839874 (0.4674910181379236) | > current_lr: 5e-06 | > step_time: 0.4631 (0.4627354716347163) | > loader_time: 0.0298 (0.030293167462398417)  --> TIME: 2024-12-22 12:39:26 -- STEP: 1206/2322 -- GLOBAL_STEP: 5850 | > loss_text_ce: 0.06644149124622345 (0.06616276649026137) | > loss_mel_ce: 3.6561310291290283 (3.6721938755579453) | > loss: 0.4653215706348419 (0.46729458028305426) | > current_lr: 5e-06 | > step_time: 0.5409 (0.462554318394827) | > loader_time: 0.0318 (0.03028125470352804)  --> TIME: 2024-12-22 12:40:02 -- STEP: 1256/2322 -- GLOBAL_STEP: 5900 | > loss_text_ce: 0.05974131077528 (0.06610477946485119) | > loss_mel_ce: 3.6424286365509033 (3.670699521614488) | > loss: 0.4627712368965149 (0.46710053764900583) | > current_lr: 5e-06 | > step_time: 0.4198 (0.4626859544189113) | > loader_time: 0.0311 (0.030279122150627655)  --> TIME: 2024-12-22 12:40:38 -- STEP: 1306/2322 -- GLOBAL_STEP: 5950 | > loss_text_ce: 0.06557881832122803 (0.06605351913669028) | > loss_mel_ce: 3.691054105758667 (3.6690789035779594) | > loss: 0.4695791006088257 (0.46689155291634715) | > current_lr: 5e-06 | > step_time: 0.4339 (0.46272149914804317) | > loader_time: 0.0289 (0.030278223944659604)  --> TIME: 2024-12-22 12:41:13 -- STEP: 1356/2322 -- GLOBAL_STEP: 6000 | > loss_text_ce: 0.06094837561249733 (0.0659847525676443) | > loss_mel_ce: 3.571871757507324 (3.6677140588254) | > loss: 0.4541025161743164 (0.4667123515038012) | > current_lr: 5e-06 | > step_time: 0.571 (0.4627532324256447) | > loader_time: 0.0318 (0.030272523034638697)  --> TIME: 2024-12-22 12:41:48 -- STEP: 1406/2322 -- GLOBAL_STEP: 6050 | > loss_text_ce: 0.06588681042194366 (0.06593187095313875) | > loss_mel_ce: 3.6812946796417236 (3.666456827398384) | > loss: 0.46839767694473267 (0.46654858735852356) | > current_lr: 5e-06 | > step_time: 0.4956 (0.46257721699488114) | > loader_time: 0.0324 (0.030273477179905754)  --> TIME: 2024-12-22 12:42:23 -- STEP: 1456/2322 -- GLOBAL_STEP: 6100 | > loss_text_ce: 0.061295196413993835 (0.06587218219966998) | > loss_mel_ce: 3.562018632888794 (3.664641655899666) | > loss: 0.4529142379760742 (0.4663142298481294) | > current_lr: 5e-06 | > step_time: 0.3979 (0.46250851992722397) | > loader_time: 0.0285 (0.030263696398053836)  --> TIME: 2024-12-22 12:42:59 -- STEP: 1506/2322 -- GLOBAL_STEP: 6150 | > loss_text_ce: 0.06491030007600784 (0.06582173594282283) | > loss_mel_ce: 3.586435556411743 (3.6629903300666555) | > loss: 0.4564182460308075 (0.4661015083748664) | > current_lr: 5e-06 | > step_time: 0.4552 (0.4624753292813244) | > loader_time: 0.0302 (0.030265323669311995)  --> TIME: 2024-12-22 12:43:34 -- STEP: 1556/2322 -- GLOBAL_STEP: 6200 | > loss_text_ce: 0.06423944234848022 (0.065782556013422) | > loss_mel_ce: 3.699327230453491 (3.662087326644319) | > loss: 0.470445841550827 (0.4659837354501293) | > current_lr: 5e-06 | > step_time: 0.4864 (0.46267812494140664) | > loader_time: 0.0307 (0.03028047835612357)  --> TIME: 2024-12-22 12:44:10 -- STEP: 1606/2322 -- GLOBAL_STEP: 6250 | > loss_text_ce: 0.06881444156169891 (0.06573925583227853) | > loss_mel_ce: 3.692478895187378 (3.661119584722507) | > loss: 0.47016167640686035 (0.46585735517228083) | > current_lr: 5e-06 | > step_time: 0.4633 (0.4625907851334378) | > loader_time: 0.0304 (0.030281919174146816)  --> TIME: 2024-12-22 12:44:45 -- STEP: 1656/2322 -- GLOBAL_STEP: 6300 | > loss_text_ce: 0.0653897151350975 (0.06569156010864652) | > loss_mel_ce: 3.6123135089874268 (3.6598498246807982) | > loss: 0.4597128927707672 (0.46569267322043867) | > current_lr: 5e-06 | > step_time: 0.4363 (0.46274422706613216) | > loader_time: 0.0321 (0.030290511207304128)  --> TIME: 2024-12-22 12:45:21 -- STEP: 1706/2322 -- GLOBAL_STEP: 6350 | > loss_text_ce: 0.06509269773960114 (0.06565026965337296) | > loss_mel_ce: 3.6466310024261475 (3.6588760386597787) | > loss: 0.4639654755592346 (0.4655657886655222) | > current_lr: 5e-06 | > step_time: 0.4339 (0.46288405171871744) | > loader_time: 0.0293 (0.030300337851816146)  --> TIME: 2024-12-22 12:45:57 -- STEP: 1756/2322 -- GLOBAL_STEP: 6400 | > loss_text_ce: 0.06096242368221283 (0.06559952512247681) | > loss_mel_ce: 3.4389591217041016 (3.6573369471793296) | > loss: 0.43749019503593445 (0.4653670591109163) | > current_lr: 5e-06 | > step_time: 0.4476 (0.46289339396839535) | > loader_time: 0.0304 (0.030304161725663366)  --> TIME: 2024-12-22 12:46:31 -- STEP: 1806/2322 -- GLOBAL_STEP: 6450 | > loss_text_ce: 0.060830723494291306 (0.06555373379640925) | > loss_mel_ce: 3.4776008129119873 (3.6563292987322886) | > loss: 0.44230395555496216 (0.4652353791501435) | > current_lr: 5e-06 | > step_time: 0.4396 (0.462653294882241) | > loader_time: 0.0291 (0.03030517793044958)  --> TIME: 2024-12-22 12:47:07 -- STEP: 1856/2322 -- GLOBAL_STEP: 6500 | > loss_text_ce: 0.06344154477119446 (0.06549845516264172) | > loss_mel_ce: 3.4918432235717773 (3.654775319556738) | > loss: 0.4444105923175812 (0.4650342218931122) | > current_lr: 5e-06 | > step_time: 0.4835 (0.4627910316761198) | > loader_time: 0.0314 (0.030312196062556616)  --> TIME: 2024-12-22 12:47:43 -- STEP: 1906/2322 -- GLOBAL_STEP: 6550 | > loss_text_ce: 0.06678952276706696 (0.06545283502712444) | > loss_mel_ce: 3.6537680625915527 (3.6535562090458424) | > loss: 0.4650697112083435 (0.4648761305516314) | > current_lr: 5e-06 | > step_time: 0.4363 (0.46283666422084396) | > loader_time: 0.029 (0.03032103740656112)  --> TIME: 2024-12-22 12:48:18 -- STEP: 1956/2322 -- GLOBAL_STEP: 6600 | > loss_text_ce: 0.06396912783384323 (0.06541225990063378) | > loss_mel_ce: 3.5521159172058105 (3.6523336312278403) | > loss: 0.4520106315612793 (0.46471823648319166) | > current_lr: 5e-06 | > step_time: 0.4426 (0.4626618373857198) | > loader_time: 0.0294 (0.03033630077580488)  --> TIME: 2024-12-22 12:48:53 -- STEP: 2006/2322 -- GLOBAL_STEP: 6650 | > loss_text_ce: 0.06093942001461983 (0.06535589602123097) | > loss_mel_ce: 3.572847366333008 (3.650970368299741) | > loss: 0.4542233347892761 (0.46454078312647545) | > current_lr: 5e-06 | > step_time: 0.4814 (0.4625477127634279) | > loader_time: 0.0325 (0.030348398393077593)  --> TIME: 2024-12-22 12:49:28 -- STEP: 2056/2322 -- GLOBAL_STEP: 6700 | > loss_text_ce: 0.06331145018339157 (0.06531440318246805) | > loss_mel_ce: 3.624647378921509 (3.649756726703755) | > loss: 0.4609948396682739 (0.4643838912944386) | > current_lr: 5e-06 | > step_time: 0.4326 (0.4626045262999108) | > loader_time: 0.0321 (0.03036510735634235)  --> TIME: 2024-12-22 12:50:03 -- STEP: 2106/2322 -- GLOBAL_STEP: 6750 | > loss_text_ce: 0.06438755244016647 (0.0652674185970031) | > loss_mel_ce: 3.575662851333618 (3.6484611386473933) | > loss: 0.45500630140304565 (0.4642160697313908) | > current_lr: 5e-06 | > step_time: 0.4684 (0.4625242195690913) | > loader_time: 0.0306 (0.03037266366728576)  --> TIME: 2024-12-22 12:50:39 -- STEP: 2156/2322 -- GLOBAL_STEP: 6800 | > loss_text_ce: 0.06540363281965256 (0.06521002221714298) | > loss_mel_ce: 3.4972479343414307 (3.64718400127149) | > loss: 0.4453314542770386 (0.4640492529285198) | > current_lr: 5e-06 | > step_time: 0.3926 (0.4626494750021118) | > loader_time: 0.0274 (0.03038595050075721)  --> TIME: 2024-12-22 12:51:14 -- STEP: 2206/2322 -- GLOBAL_STEP: 6850 | > loss_text_ce: 0.06076038256287575 (0.06517280414464076) | > loss_mel_ce: 3.6278836727142334 (3.645664933694025) | > loss: 0.46108052134513855 (0.46385471722751137) | > current_lr: 5e-06 | > step_time: 0.4888 (0.46255556508182727) | > loader_time: 0.0316 (0.030395397789783066)  --> TIME: 2024-12-22 12:51:50 -- STEP: 2256/2322 -- GLOBAL_STEP: 6900 | > loss_text_ce: 0.06328649073839188 (0.06512518835102082) | > loss_mel_ce: 3.5894176959991455 (3.6441140162183867) | > loss: 0.4565880298614502 (0.4636549005773686) | > current_lr: 5e-06 | > step_time: 0.44 (0.46254941694279933) | > loader_time: 0.0314 (0.030404767034747062)  --> TIME: 2024-12-22 12:52:25 -- STEP: 2306/2322 -- GLOBAL_STEP: 6950 | > loss_text_ce: 0.06119665876030922 (0.06507777698751585) | > loss_mel_ce: 3.6653404235839844 (3.6430252991028675) | > loss: 0.4658171236515045 (0.46351288451594275) | > current_lr: 5e-06 | > step_time: 0.4878 (0.4625801496265871) | > loader_time: 0.0309 (0.03041252672207013)  > EVALUATION  --> EVAL PERFORMANCE | > avg_loader_time: 0.19075570564077363 (+0.00027627776367500356) | > avg_loss_text_ce: 0.0597896504808556 (-0.004345222837244596) | > avg_loss_mel_ce: 3.505974693731828 (-0.12939427838181006) | > avg_loss: 3.5657643477121987 (-0.13373949913063443)  > EPOCH: 3/10 --> /checkpoints/GPT_XTTS_FT-December-22-2024_11+26AM-0000000  > TRAINING (2024-12-22 12:53:53)   --> TIME: 2024-12-22 12:54:19 -- STEP: 34/2322 -- GLOBAL_STEP: 7000 | > loss_text_ce: 0.0627051442861557 (0.0627360282575383) | > loss_mel_ce: 3.6161396503448486 (3.5924853437087116) | > loss: 0.4598555862903595 (0.456902670509675) | > current_lr: 5e-06 | > step_time: 0.4539 (0.4592168611638686) | > loader_time: 0.0288 (0.02929693811080035)  --> TIME: 2024-12-22 12:54:54 -- STEP: 84/2322 -- GLOBAL_STEP: 7050 | > loss_text_ce: 0.061921313405036926 (0.06292108951934747) | > loss_mel_ce: 3.573596715927124 (3.5932243977274214) | > loss: 0.45443975925445557 (0.4570181862938972) | > current_lr: 5e-06 | > step_time: 0.4456 (0.4636660587219965) | > loader_time: 0.029 (0.029097789809817358)  --> TIME: 2024-12-22 12:55:30 -- STEP: 134/2322 -- GLOBAL_STEP: 7100 | > loss_text_ce: 0.06250446289777756 (0.06302823696229888) | > loss_mel_ce: 3.5137805938720703 (3.595098515055073) | > loss: 0.44703564047813416 (0.45726584454080954) | > current_lr: 5e-06 | > step_time: 0.4868 (0.4668086891743674) | > loader_time: 0.0294 (0.0289099625687101)  --> TIME: 2024-12-22 12:56:05 -- STEP: 184/2322 -- GLOBAL_STEP: 7150 | > loss_text_ce: 0.060533296316862106 (0.06291223384196991) | > loss_mel_ce: 3.5930445194244385 (3.5871888748977496) | > loss: 0.4566972255706787 (0.4562626390353493) | > current_lr: 5e-06 | > step_time: 0.4334 (0.46584624570348987) | > loader_time: 0.0291 (0.028854057840679005)  --> TIME: 2024-12-22 12:56:41 -- STEP: 234/2322 -- GLOBAL_STEP: 7200 | > loss_text_ce: 0.06163354590535164 (0.06279999979286117) | > loss_mel_ce: 3.6217498779296875 (3.5827815420607214) | > loss: 0.46042293310165405 (0.4556976933764596) | > current_lr: 5e-06 | > step_time: 0.4955 (0.4667842235320654) | > loader_time: 0.0299 (0.028844938318953555)  --> TIME: 2024-12-22 12:57:16 -- STEP: 284/2322 -- GLOBAL_STEP: 7250 | > loss_text_ce: 0.05982862040400505 (0.06271434719608707) | > loss_mel_ce: 3.6122186183929443 (3.5794489543202905) | > loss: 0.4590058922767639 (0.45527041283711583) | > current_lr: 5e-06 | > step_time: 0.4643 (0.4651225906022837) | > loader_time: 0.0286 (0.028819776756662717)  --> TIME: 2024-12-22 12:57:51 -- STEP: 334/2322 -- GLOBAL_STEP: 7300 | > loss_text_ce: 0.06564157456159592 (0.06267779797850975) | > loss_mel_ce: 3.5937647819519043 (3.5768113850119594) | > loss: 0.4574258029460907 (0.45493614798534415) | > current_lr: 5e-06 | > step_time: 0.4502 (0.46461785981755055) | > loader_time: 0.0283 (0.028802666121614192)  --> TIME: 2024-12-22 12:58:27 -- STEP: 384/2322 -- GLOBAL_STEP: 7350 | > loss_text_ce: 0.06259381771087646 (0.06258514215005573) | > loss_mel_ce: 3.5967373847961426 (3.5776683905472364) | > loss: 0.4574164152145386 (0.45503169189517695) | > current_lr: 5e-06 | > step_time: 0.3973 (0.4647686053067446) | > loader_time: 0.0278 (0.028799162556727726)  --> TIME: 2024-12-22 12:59:02 -- STEP: 434/2322 -- GLOBAL_STEP: 7400 | > loss_text_ce: 0.06354118883609772 (0.06260782675946375) | > loss_mel_ce: 3.49855899810791 (3.5771450144904007) | > loss: 0.44526252150535583 (0.454969105357948) | > current_lr: 5e-06 | > step_time: 0.5445 (0.4646919196651828) | > loader_time: 0.031 (0.028807111599478304)  --> TIME: 2024-12-22 12:59:37 -- STEP: 484/2322 -- GLOBAL_STEP: 7450 | > loss_text_ce: 0.06261249631643295 (0.06260960856991381) | > loss_mel_ce: 3.5269854068756104 (3.575345022619264) | > loss: 0.4486997425556183 (0.45474432876780013) | > current_lr: 5e-06 | > step_time: 0.4275 (0.463400379685331) | > loader_time: 0.0269 (0.028805899718576226)  --> TIME: 2024-12-22 13:00:12 -- STEP: 534/2322 -- GLOBAL_STEP: 7500 | > loss_text_ce: 0.06431590020656586 (0.06261058085448075) | > loss_mel_ce: 3.5197017192840576 (3.5736403326863204) | > loss: 0.4480021893978119 (0.4545313639475612) | > current_lr: 5e-06 | > step_time: 0.4605 (0.46346215630292) | > loader_time: 0.0291 (0.028813425967755834)  --> TIME: 2024-12-22 13:00:47 -- STEP: 584/2322 -- GLOBAL_STEP: 7550 | > loss_text_ce: 0.06165695935487747 (0.06253613104839649) | > loss_mel_ce: 3.6335296630859375 (3.5720811767937377) | > loss: 0.4618983268737793 (0.4543271632737493) | > current_lr: 5e-06 | > step_time: 0.4379 (0.46322582478392615) | > loader_time: 0.0301 (0.02882304746810704)  --> TIME: 2024-12-22 13:01:22 -- STEP: 634/2322 -- GLOBAL_STEP: 7600 | > loss_text_ce: 0.06306257843971252 (0.06250415197705815) | > loss_mel_ce: 3.5854103565216064 (3.5709007561018784) | > loss: 0.45605912804603577 (0.4541756132329676) | > current_lr: 5e-06 | > step_time: 0.413 (0.46306246011415114) | > loader_time: 0.0271 (0.028849047065157243)  --> TIME: 2024-12-22 13:01:58 -- STEP: 684/2322 -- GLOBAL_STEP: 7650 | > loss_text_ce: 0.06127507984638214 (0.06246023363711546) | > loss_mel_ce: 3.53194522857666 (3.568769462973053) | > loss: 0.44915252923965454 (0.4539037119836835) | > current_lr: 5e-06 | > step_time: 0.4814 (0.4632899287151314) | > loader_time: 0.0288 (0.02884986142666019)  --> TIME: 2024-12-22 13:02:33 -- STEP: 734/2322 -- GLOBAL_STEP: 7700 | > loss_text_ce: 0.06504847854375839 (0.06239887580722169) | > loss_mel_ce: 3.671886920928955 (3.567509854197177) | > loss: 0.46711692214012146 (0.4537385911236667) | > current_lr: 5e-06 | > step_time: 0.4417 (0.4628445478486105) | > loader_time: 0.028 (0.02884196747875993)  --> TIME: 2024-12-22 13:03:08 -- STEP: 784/2322 -- GLOBAL_STEP: 7750 | > loss_text_ce: 0.06059170886874199 (0.062346771905882975) | > loss_mel_ce: 3.5578904151916504 (3.5660361608072195) | > loss: 0.4523102641105652 (0.4535478665968593) | > current_lr: 5e-06 | > step_time: 0.4339 (0.46257749747256843) | > loader_time: 0.0299 (0.02885647452607447)  --> TIME: 2024-12-22 13:03:43 -- STEP: 834/2322 -- GLOBAL_STEP: 7800 | > loss_text_ce: 0.062064193189144135 (0.06230619355446576) | > loss_mel_ce: 3.5523483753204346 (3.5649399511533955) | > loss: 0.4518015682697296 (0.45340576807229066) | > current_lr: 5e-06 | > step_time: 0.4647 (0.4626639629725358) | > loader_time: 0.0296 (0.028887581196334437)  --> TIME: 2024-12-22 13:04:19 -- STEP: 884/2322 -- GLOBAL_STEP: 7850 | > loss_text_ce: 0.06452818959951401 (0.062259357865073875) | > loss_mel_ce: 3.621121406555176 (3.564432309224055) | > loss: 0.4607062041759491 (0.4533364582655117) | > current_lr: 5e-06 | > step_time: 0.5406 (0.46257048305882587) | > loader_time: 0.0301 (0.028893570824446182)  --> TIME: 2024-12-22 13:04:54 -- STEP: 934/2322 -- GLOBAL_STEP: 7900 | > loss_text_ce: 0.05930446833372116 (0.06220687300812385) | > loss_mel_ce: 3.608325958251953 (3.5634989600620632) | > loss: 0.45845380425453186 (0.4532132290415386) | > current_lr: 5e-06 | > step_time: 0.4536 (0.4623284773857231) | > loader_time: 0.0284 (0.028902079359622277)  --> TIME: 2024-12-22 13:05:29 -- STEP: 984/2322 -- GLOBAL_STEP: 7950 | > loss_text_ce: 0.06283051520586014 (0.06217726416567844) | > loss_mel_ce: 3.511221170425415 (3.561964005474152) | > loss: 0.4467564523220062 (0.45301765866759347) | > current_lr: 5e-06 | > step_time: 0.4292 (0.4620587896040785) | > loader_time: 0.0303 (0.02892161820962177)  --> TIME: 2024-12-22 13:06:04 -- STEP: 1034/2322 -- GLOBAL_STEP: 8000 | > loss_text_ce: 0.06208610534667969 (0.062132967142406265) | > loss_mel_ce: 3.568072557449341 (3.561288960205978) | > loss: 0.45376983284950256 (0.45292774090683896) | > current_lr: 5e-06 | > step_time: 0.4928 (0.46222298172963655) | > loader_time: 0.0323 (0.028965487932098213)  --> TIME: 2024-12-22 13:06:39 -- STEP: 1084/2322 -- GLOBAL_STEP: 8050 | > loss_text_ce: 0.06165574863553047 (0.06209431055287156) | > loss_mel_ce: 3.5048816204071045 (3.560054183226229) | > loss: 0.44581717252731323 (0.4527685617223876) | > current_lr: 5e-06 | > step_time: 0.4863 (0.4622590082158022) | > loader_time: 0.0294 (0.02900351303529915)  --> TIME: 2024-12-22 13:07:15 -- STEP: 1134/2322 -- GLOBAL_STEP: 8100 | > loss_text_ce: 0.060119058936834335 (0.06204576512414314) | > loss_mel_ce: 3.5951108932495117 (3.5590127708630153) | > loss: 0.45690375566482544 (0.4526323170468498) | > current_lr: 5e-06 | > step_time: 0.4198 (0.46221294941305063) | > loader_time: 0.0311 (0.02903527094994062)  --> TIME: 2024-12-22 13:07:49 -- STEP: 1184/2322 -- GLOBAL_STEP: 8150 | > loss_text_ce: 0.06357663124799728 (0.06201282142648929) | > loss_mel_ce: 3.5328023433685303 (3.5578204763902193) | > loss: 0.4495473802089691 (0.45247916232895186) | > current_lr: 5e-06 | > step_time: 0.4132 (0.46167711692081914) | > loader_time: 0.0305 (0.02905364052669422)  --> TIME: 2024-12-22 13:08:25 -- STEP: 1234/2322 -- GLOBAL_STEP: 8200 | > loss_text_ce: 0.059070419520139694 (0.061980702743731235) | > loss_mel_ce: 3.4606707096099854 (3.5569823396843483) | > loss: 0.43996763229370117 (0.45237038034577404) | > current_lr: 5e-06 | > step_time: 0.4903 (0.461742339296511) | > loader_time: 0.0302 (0.02907839064853118)  --> TIME: 2024-12-22 13:09:00 -- STEP: 1284/2322 -- GLOBAL_STEP: 8250 | > loss_text_ce: 0.06243866682052612 (0.06195860790709657) | > loss_mel_ce: 3.5338146686553955 (3.556030739504971) | > loss: 0.4495316743850708 (0.45224866846640144) | > current_lr: 5e-06 | > step_time: 0.4522 (0.4617263336790685) | > loader_time: 0.0281 (0.029087252891695017)  --> TIME: 2024-12-22 13:09:35 -- STEP: 1334/2322 -- GLOBAL_STEP: 8300 | > loss_text_ce: 0.059066809713840485 (0.061926698178119945) | > loss_mel_ce: 3.4313693046569824 (3.5553549013395176) | > loss: 0.43630450963974 (0.4521601999896218) | > current_lr: 5e-06 | > step_time: 0.4352 (0.4616444546958317) | > loader_time: 0.028 (0.029094647968011995)  --> TIME: 2024-12-22 13:10:10 -- STEP: 1384/2322 -- GLOBAL_STEP: 8350 | > loss_text_ce: 0.06229443475604057 (0.06188765167113331) | > loss_mel_ce: 3.6004645824432373 (3.5540891803068915) | > loss: 0.45784488320350647 (0.4519971040201323) | > current_lr: 5e-06 | > step_time: 0.4426 (0.4617372177584323) | > loader_time: 0.0305 (0.02910885852196313)  --> TIME: 2024-12-22 13:10:46 -- STEP: 1434/2322 -- GLOBAL_STEP: 8400 | > loss_text_ce: 0.05986313149333 (0.06186006433814974) | > loss_mel_ce: 3.447535991668701 (3.5532891650578957) | > loss: 0.43842488527297974 (0.45189365374659546) | > current_lr: 5e-06 | > step_time: 0.3854 (0.4619064794923471) | > loader_time: 0.0274 (0.029120610681371544)  --> TIME: 2024-12-22 13:11:22 -- STEP: 1484/2322 -- GLOBAL_STEP: 8450 | > loss_text_ce: 0.05781904235482216 (0.06182120162290786) | > loss_mel_ce: 3.5928256511688232 (3.552069074702712) | > loss: 0.4563305974006653 (0.4517362845956153) | > current_lr: 5e-06 | > step_time: 0.4361 (0.4621263278141176) | > loader_time: 0.0288 (0.02913596222021509)  --> TIME: 2024-12-22 13:11:57 -- STEP: 1534/2322 -- GLOBAL_STEP: 8500 | > loss_text_ce: 0.062050268054008484 (0.061790568052245885) | > loss_mel_ce: 3.50506854057312 (3.550927878824952) | > loss: 0.4458898603916168 (0.4515898059640744) | > current_lr: 5e-06 | > step_time: 0.3739 (0.46227357937739444) | > loader_time: 0.0327 (0.029162608971030027)  --> TIME: 2024-12-22 13:12:33 -- STEP: 1584/2322 -- GLOBAL_STEP: 8550 | > loss_text_ce: 0.060222312808036804 (0.06176994320456731) | > loss_mel_ce: 3.4893758296966553 (3.5502786574640655) | > loss: 0.44369977712631226 (0.4515060752141053) | > current_lr: 5e-06 | > step_time: 0.4344 (0.462491327765012) | > loader_time: 0.0315 (0.029350312219725713)  --> TIME: 2024-12-22 13:13:09 -- STEP: 1634/2322 -- GLOBAL_STEP: 8600 | > loss_text_ce: 0.06239571049809456 (0.06175370635225404) | > loss_mel_ce: 3.6218619346618652 (3.548937642734812) | > loss: 0.46053221821784973 (0.4513364188199818) | > current_lr: 5e-06 | > step_time: 0.4117 (0.46236735545873936) | > loader_time: 0.0296 (0.02942810764803005)  --> TIME: 2024-12-22 13:13:44 -- STEP: 1684/2322 -- GLOBAL_STEP: 8650 | > loss_text_ce: 0.06396688520908356 (0.06172616370553219) | > loss_mel_ce: 3.642301082611084 (3.5478524871506765) | > loss: 0.463283509016037 (0.45119733156331066) | > current_lr: 5e-06 | > step_time: 0.4607 (0.4625042611799444) | > loader_time: 0.0319 (0.02949461064825715)  --> TIME: 2024-12-22 13:14:20 -- STEP: 1734/2322 -- GLOBAL_STEP: 8700 | > loss_text_ce: 0.06157594546675682 (0.061706700135611074) | > loss_mel_ce: 3.589224100112915 (3.5472326893294968) | > loss: 0.4563499987125397 (0.4511174238367475) | > current_lr: 5e-06 | > step_time: 0.4355 (0.46238577819613025) | > loader_time: 0.0307 (0.029551024667944462)  --> TIME: 2024-12-22 13:14:55 -- STEP: 1784/2322 -- GLOBAL_STEP: 8750 | > loss_text_ce: 0.0630142018198967 (0.061674775246681135) | > loss_mel_ce: 3.468168258666992 (3.5463025150277683) | > loss: 0.4413978159427643 (0.45099716145762403) | > current_lr: 5e-06 | > step_time: 0.4173 (0.4624279545027044) | > loader_time: 0.0309 (0.029616964237572367)  --> TIME: 2024-12-22 13:15:30 -- STEP: 1834/2322 -- GLOBAL_STEP: 8800 | > loss_text_ce: 0.058043722063302994 (0.06165354122837343) | > loss_mel_ce: 3.539224624633789 (3.5455102362835547) | > loss: 0.4496585428714752 (0.4508954723697711) | > current_lr: 5e-06 | > step_time: 0.4346 (0.4622599817284321) | > loader_time: 0.0321 (0.02966713268338269)  --> TIME: 2024-12-22 13:16:05 -- STEP: 1884/2322 -- GLOBAL_STEP: 8850 | > loss_text_ce: 0.06313986331224442 (0.06162763193779629) | > loss_mel_ce: 3.639044761657715 (3.544847221258086) | > loss: 0.46277308464050293 (0.45080935682966944) | > current_lr: 5e-06 | > step_time: 0.4269 (0.4620332196513052) | > loader_time: 0.0293 (0.0297084068543339)  --> TIME: 2024-12-22 13:16:40 -- STEP: 1934/2322 -- GLOBAL_STEP: 8900 | > loss_text_ce: 0.05995406582951546 (0.061592582453354326) | > loss_mel_ce: 3.5020036697387695 (3.543652893098951) | > loss: 0.4452447295188904 (0.45065568458392913) | > current_lr: 5e-06 | > step_time: 0.4816 (0.46190808761206137) | > loader_time: 0.0325 (0.029750178124073743)  --> TIME: 2024-12-22 13:17:16 -- STEP: 1984/2322 -- GLOBAL_STEP: 8950 | > loss_text_ce: 0.06326276808977127 (0.06155930481092525) | > loss_mel_ce: 3.606341600418091 (3.542728216537544) | > loss: 0.4587005376815796 (0.4505359403368445) | > current_lr: 5e-06 | > step_time: 0.4142 (0.4621343039456875) | > loader_time: 0.0316 (0.029804973232169307)  --> TIME: 2024-12-22 13:17:52 -- STEP: 2034/2322 -- GLOBAL_STEP: 9000 | > loss_text_ce: 0.06317233294248581 (0.06153080979821841) | > loss_mel_ce: 3.5494658946990967 (3.5421254065184464) | > loss: 0.4515797793865204 (0.4504570272350967) | > current_lr: 5e-06 | > step_time: 0.4491 (0.46212196666582495) | > loader_time: 0.0306 (0.029852275182598344)  --> TIME: 2024-12-22 13:18:27 -- STEP: 2084/2322 -- GLOBAL_STEP: 9050 | > loss_text_ce: 0.06002935767173767 (0.06149561134579945) | > loss_mel_ce: 3.404021978378296 (3.5411445585413768) | > loss: 0.4330064058303833 (0.4503300213710817) | > current_lr: 5e-06 | > step_time: 0.4263 (0.4621678244129481) | > loader_time: 0.0314 (0.02989514340823534)  --> TIME: 2024-12-22 13:19:02 -- STEP: 2134/2322 -- GLOBAL_STEP: 9100 | > loss_text_ce: 0.06205710768699646 (0.061470536230570166) | > loss_mel_ce: 3.480194330215454 (3.540204505777404) | > loss: 0.4427814185619354 (0.45020938041116315) | > current_lr: 5e-06 | > step_time: 0.4676 (0.4620372016740494) | > loader_time: 0.0289 (0.029924730999847386)  --> TIME: 2024-12-22 13:19:38 -- STEP: 2184/2322 -- GLOBAL_STEP: 9150 | > loss_text_ce: 0.06313852965831757 (0.061443247538974226) | > loss_mel_ce: 3.439920663833618 (3.5393787588610315) | > loss: 0.4378823935985565 (0.4501027509897619) | > current_lr: 5e-06 | > step_time: 0.3999 (0.46210214375576253) | > loader_time: 0.0297 (0.029936674313667495)  --> TIME: 2024-12-22 13:20:14 -- STEP: 2234/2322 -- GLOBAL_STEP: 9200 | > loss_text_ce: 0.05672360211610794 (0.0614027149505053) | > loss_mel_ce: 3.518585443496704 (3.538511565036825) | > loss: 0.44691362977027893 (0.44998928518997505) | > current_lr: 5e-06 | > step_time: 0.4267 (0.4623186052539248) | > loader_time: 0.0304 (0.029984771938545957)  --> TIME: 2024-12-22 13:20:50 -- STEP: 2284/2322 -- GLOBAL_STEP: 9250 | > loss_text_ce: 0.05726983770728111 (0.06137152887952569) | > loss_mel_ce: 3.5325520038604736 (3.537489153249042) | > loss: 0.44872772693634033 (0.4498575854583294) | > current_lr: 5e-06 | > step_time: 0.4399 (0.4625603699642388) | > loader_time: 0.0291 (0.030029196350879302)  > EVALUATION  --> EVAL PERFORMANCE | > avg_loader_time: 0.19085883853411434 (+0.00010313289334071274) | > avg_loss_text_ce: 0.057123656582200165 (-0.0026659938986554332) | > avg_loss_mel_ce: 3.417161772949527 (-0.08881292078230096) | > avg_loss: 3.474285433990787 (-0.09147891372141181)  > EPOCH: 4/10 --> /checkpoints/GPT_XTTS_FT-December-22-2024_11+26AM-0000000  > TRAINING (2024-12-22 13:22:33)   --> TIME: 2024-12-22 13:22:43 -- STEP: 12/2322 -- GLOBAL_STEP: 9300 | > loss_text_ce: 0.05965147539973259 (0.06002582050859928) | > loss_mel_ce: 3.51872181892395 (3.479286034901937) | > loss: 0.4472966492176056 (0.44241398572921753) | > current_lr: 5e-06 | > step_time: 0.4349 (0.45221052567164105) | > loader_time: 0.0279 (0.02880193789800008)  --> TIME: 2024-12-22 13:23:19 -- STEP: 62/2322 -- GLOBAL_STEP: 9350 | > loss_text_ce: 0.06011949107050896 (0.05968656475024839) | > loss_mel_ce: 3.4410128593444824 (3.4831205414187525) | > loss: 0.43764153122901917 (0.4428508896981516) | > current_lr: 5e-06 | > step_time: 0.4909 (0.46772650749452654) | > loader_time: 0.0299 (0.02899089551741077)  --> TIME: 2024-12-22 13:23:54 -- STEP: 112/2322 -- GLOBAL_STEP: 9400 | > loss_text_ce: 0.06149492785334587 (0.059801515590931685) | > loss_mel_ce: 3.523479461669922 (3.485494362456458) | > loss: 0.4481217861175537 (0.4431619854377849) | > current_lr: 5e-06 | > step_time: 0.4182 (0.4645940342119762) | > loader_time: 0.028 (0.028825080820492337)  --> TIME: 2024-12-22 13:24:30 -- STEP: 162/2322 -- GLOBAL_STEP: 9450 | > loss_text_ce: 0.05770587921142578 (0.05956138861308127) | > loss_mel_ce: 3.605559825897217 (3.4861946930120022) | > loss: 0.4579082131385803 (0.4432195104934551) | > current_lr: 5e-06 | > step_time: 0.4665 (0.4667727196658099) | > loader_time: 0.0292 (0.028884950979256335)  --> TIME: 2024-12-22 13:25:05 -- STEP: 212/2322 -- GLOBAL_STEP: 9500 | > loss_text_ce: 0.05842948704957962 (0.05971776639585787) | > loss_mel_ce: 3.4538209438323975 (3.488030476390191) | > loss: 0.43903130292892456 (0.4434685309259397) | > current_lr: 5e-06 | > step_time: 0.4687 (0.4643830713236107) | > loader_time: 0.0297 (0.02881282792901093)  --> TIME: 2024-12-22 13:25:41 -- STEP: 262/2322 -- GLOBAL_STEP: 9550 | > loss_text_ce: 0.059433843940496445 (0.05971895579163355) | > loss_mel_ce: 3.403482437133789 (3.489545004968425) | > loss: 0.43286454677581787 (0.4436579957490659) | > current_lr: 5e-06 | > step_time: 0.4711 (0.46557282673493594) | > loader_time: 0.0307 (0.028877412089864718)  --> TIME: 2024-12-22 13:26:16 -- STEP: 312/2322 -- GLOBAL_STEP: 9600 | > loss_text_ce: 0.06182936578989029 (0.05968767630222898) | > loss_mel_ce: 3.417755365371704 (3.488019286057888) | > loss: 0.4349480867385864 (0.4434633706815732) | > current_lr: 5e-06 | > step_time: 0.4326 (0.4651065346522209) | > loader_time: 0.0294 (0.028885783293308355)  --> TIME: 2024-12-22 13:26:51 -- STEP: 362/2322 -- GLOBAL_STEP: 9650 | > loss_text_ce: 0.056663449853658676 (0.05968460504438996) | > loss_mel_ce: 3.484206438064575 (3.4893517000240517) | > loss: 0.4426087439060211 (0.44362953848601705) | > current_lr: 5e-06 | > step_time: 0.4646 (0.4642338364163815) | > loader_time: 0.0283 (0.028907501236509883)  --> TIME: 2024-12-22 13:27:27 -- STEP: 412/2322 -- GLOBAL_STEP: 9700 | > loss_text_ce: 0.05592989921569824 (0.05964182480916526) | > loss_mel_ce: 3.471928358078003 (3.487243017525349) | > loss: 0.44098228216171265 (0.44336060572017744) | > current_lr: 5e-06 | > step_time: 0.4403 (0.46413461907396036) | > loader_time: 0.028 (0.028993454951684452)  --> TIME: 2024-12-22 13:28:02 -- STEP: 462/2322 -- GLOBAL_STEP: 9750 | > loss_text_ce: 0.05962081626057625 (0.05963474313740606) | > loss_mel_ce: 3.52028751373291 (3.4844051873013053) | > loss: 0.44748854637145996 (0.44300499158504203) | > current_lr: 5e-06 | > step_time: 0.4637 (0.4641071361896796) | > loader_time: 0.0289 (0.02903414959515328)  --> TIME: 2024-12-22 13:28:38 -- STEP: 512/2322 -- GLOBAL_STEP: 9800 | > loss_text_ce: 0.06102589890360832 (0.05957843060605228) | > loss_mel_ce: 3.4480268955230713 (3.483164710458368) | > loss: 0.4386315941810608 (0.442842892894987) | > current_lr: 5e-06 | > step_time: 0.4311 (0.4653032813221216) | > loader_time: 0.0294 (0.02911062678322196)  --> TIME: 2024-12-22 13:29:14 -- STEP: 562/2322 -- GLOBAL_STEP: 9850 | > loss_text_ce: 0.057538703083992004 (0.05953995295505295) | > loss_mel_ce: 3.5336105823516846 (3.480202855588703) | > loss: 0.448893666267395 (0.4424678514118297) | > current_lr: 5e-06 | > step_time: 0.4498 (0.4648247100280273) | > loader_time: 0.0287 (0.02916981826049153)  --> TIME: 2024-12-22 13:29:49 -- STEP: 612/2322 -- GLOBAL_STEP: 9900 | > loss_text_ce: 0.057206619530916214 (0.05955474093872932) | > loss_mel_ce: 3.5353384017944336 (3.480220923626345) | > loss: 0.4490681290626526 (0.442471958355966) | > current_lr: 5e-06 | > step_time: 0.4378 (0.4649011586226669) | > loader_time: 0.0288 (0.029229226455189824)  --> TIME: 2024-12-22 13:30:25 -- STEP: 662/2322 -- GLOBAL_STEP: 9950 | > loss_text_ce: 0.05749789997935295 (0.05952069819468746) | > loss_mel_ce: 3.4110679626464844 (3.4795438782326045) | > loss: 0.4335707426071167 (0.44238307239245794) | > current_lr: 5e-06 | > step_time: 0.5703 (0.4647755118655294) | > loader_time: 0.0327 (0.02928259977761352)  --> TIME: 2024-12-22 13:31:00 -- STEP: 712/2322 -- GLOBAL_STEP: 10000 | > loss_text_ce: 0.060476865619421005 (0.059516809012196706) | > loss_mel_ce: 3.426574468612671 (3.4797296587670785) | > loss: 0.4358814060688019 (0.4424058085914408) | > current_lr: 5e-06 | > step_time: 0.4163 (0.4648818413863021) | > loader_time: 0.0312 (0.029337051544296607)  --> TIME: 2024-12-22 13:31:36 -- STEP: 762/2322 -- GLOBAL_STEP: 10050 | > loss_text_ce: 0.05987802892923355 (0.0594823604151411) | > loss_mel_ce: 3.476862907409668 (3.4786976613397673) | > loss: 0.442092627286911 (0.4422725028800839) | > current_lr: 5e-06 | > step_time: 0.4644 (0.4648897722950132) | > loader_time: 0.0311 (0.029496000507685142)  --> TIME: 2024-12-22 13:32:11 -- STEP: 812/2322 -- GLOBAL_STEP: 10100 | > loss_text_ce: 0.05909470468759537 (0.05946075068006815) | > loss_mel_ce: 3.472477912902832 (3.4783505042785494) | > loss: 0.44144657254219055 (0.4422264069392176) | > current_lr: 5e-06 | > step_time: 0.4655 (0.4643714595310794) | > loader_time: 0.0319 (0.02962349729584943)  --> TIME: 2024-12-22 13:32:46 -- STEP: 862/2322 -- GLOBAL_STEP: 10150 | > loss_text_ce: 0.06038908287882805 (0.05941257908888455) | > loss_mel_ce: 3.4998137950897217 (3.4764747066453547) | > loss: 0.44502535462379456 (0.44198591087506156) | > current_lr: 5e-06 | > step_time: 0.4697 (0.4642904897300384) | > loader_time: 0.0298 (0.029748618741046524)  --> TIME: 2024-12-22 13:33:22 -- STEP: 912/2322 -- GLOBAL_STEP: 10200 | > loss_text_ce: 0.05975012108683586 (0.05939051082047323) | > loss_mel_ce: 3.4000563621520996 (3.475087487122469) | > loss: 0.4324758052825928 (0.44180974988430216) | > current_lr: 5e-06 | > step_time: 0.4341 (0.4645511900123797) | > loader_time: 0.0307 (0.029756587064057066)  --> TIME: 2024-12-22 13:33:58 -- STEP: 962/2322 -- GLOBAL_STEP: 10250 | > loss_text_ce: 0.05815450847148895 (0.059375621432635986) | > loss_mel_ce: 3.497819185256958 (3.4747324931646335) | > loss: 0.4444967210292816 (0.4417635145405474) | > current_lr: 5e-06 | > step_time: 0.4921 (0.4649591153475946) | > loader_time: 0.0308 (0.02978329177705761)  --> TIME: 2024-12-22 13:34:34 -- STEP: 1012/2322 -- GLOBAL_STEP: 10300 | > loss_text_ce: 0.0574377104640007 (0.0593535549600016) | > loss_mel_ce: 3.490417957305908 (3.4744529481461868) | > loss: 0.4434819519519806 (0.4417258130585252) | > current_lr: 5e-06 | > step_time: 0.4377 (0.46478120682267804) | > loader_time: 0.0303 (0.02980099388733212)  --> TIME: 2024-12-22 13:35:09 -- STEP: 1062/2322 -- GLOBAL_STEP: 10350 | > loss_text_ce: 0.06095879524946213 (0.05930311587444471) | > loss_mel_ce: 3.4952096939086914 (3.4742802754184843) | > loss: 0.44452106952667236 (0.44169792409446057) | > current_lr: 5e-06 | > step_time: 0.4538 (0.46467730846333183) | > loader_time: 0.0277 (0.029807700051201716)  --> TIME: 2024-12-22 13:35:44 -- STEP: 1112/2322 -- GLOBAL_STEP: 10400 | > loss_text_ce: 0.059589337557554245 (0.059282503412406665) | > loss_mel_ce: 3.5606889724731445 (3.472698710590815) | > loss: 0.4525347948074341 (0.44149765200752156) | > current_lr: 5e-06 | > step_time: 0.4805 (0.46457628144634705) | > loader_time: 0.0315 (0.02979001295652321)  --> TIME: 2024-12-22 13:36:20 -- STEP: 1162/2322 -- GLOBAL_STEP: 10450 | > loss_text_ce: 0.0592946857213974 (0.05927624135388771) | > loss_mel_ce: 3.4275381565093994 (3.4721652415040842) | > loss: 0.43585410714149475 (0.44143018554799957) | > current_lr: 5e-06 | > step_time: 0.4866 (0.46448912165045936) | > loader_time: 0.0303 (0.0297454895127866)  --> TIME: 2024-12-22 13:36:55 -- STEP: 1212/2322 -- GLOBAL_STEP: 10500 | > loss_text_ce: 0.05694606527686119 (0.05926790922917058) | > loss_mel_ce: 3.4054439067840576 (3.4714232736294806) | > loss: 0.43279874324798584 (0.4413363980774834) | > current_lr: 5e-06 | > step_time: 0.4358 (0.46456862302503166) | > loader_time: 0.0316 (0.029808685331061336)  --> TIME: 2024-12-22 13:37:31 -- STEP: 1262/2322 -- GLOBAL_STEP: 10550 | > loss_text_ce: 0.060757748782634735 (0.059246196191633946) | > loss_mel_ce: 3.5460000038146973 (3.4711593210035945) | > loss: 0.4508447051048279 (0.44130068986710597) | > current_lr: 5e-06 | > step_time: 0.4935 (0.4645224259885857) | > loader_time: 0.0326 (0.02985764211028956)  --> TIME: 2024-12-22 13:38:06 -- STEP: 1312/2322 -- GLOBAL_STEP: 10600 | > loss_text_ce: 0.05991643667221069 (0.059220955735526805) | > loss_mel_ce: 3.437612295150757 (3.4705166217030543) | > loss: 0.43719109892845154 (0.4412171974233013) | > current_lr: 5e-06 | > step_time: 0.3581 (0.4644884714266148) | > loader_time: 0.0291 (0.029923694344555458)  --> TIME: 2024-12-22 13:38:43 -- STEP: 1362/2322 -- GLOBAL_STEP: 10650 | > loss_text_ce: 0.059095680713653564 (0.05919898485712894) | > loss_mel_ce: 3.4131197929382324 (3.4700364908982997) | > loss: 0.43402692675590515 (0.4411544346861904) | > current_lr: 5e-06 | > step_time: 0.4243 (0.4647544373849764) | > loader_time: 0.031 (0.029999175785921744)  --> TIME: 2024-12-22 13:39:18 -- STEP: 1412/2322 -- GLOBAL_STEP: 10700 | > loss_text_ce: 0.059106893837451935 (0.059161251492629484) | > loss_mel_ce: 3.4701361656188965 (3.469015414248782) | > loss: 0.4411553740501404 (0.4410220834798585) | > current_lr: 5e-06 | > step_time: 0.4869 (0.4646486185765468) | > loader_time: 0.0339 (0.030053231770188545)  --> TIME: 2024-12-22 13:39:53 -- STEP: 1462/2322 -- GLOBAL_STEP: 10750 | > loss_text_ce: 0.05682835355401039 (0.059135766427265805) | > loss_mel_ce: 3.473522663116455 (3.467775141328532) | > loss: 0.441293865442276 (0.4408638636733212) | > current_lr: 5e-06 | > step_time: 0.4344 (0.46454775414943034) | > loader_time: 0.0312 (0.03010696327637387)  --> TIME: 2024-12-22 13:40:29 -- STEP: 1512/2322 -- GLOBAL_STEP: 10800 | > loss_text_ce: 0.058202192187309265 (0.05911087685525813) | > loss_mel_ce: 3.5115652084350586 (3.46701966565122) | > loss: 0.44622093439102173 (0.44076631801626687) | > current_lr: 5e-06 | > step_time: 0.4063 (0.4646856251847806) | > loader_time: 0.031 (0.030161998417011643)  --> TIME: 2024-12-22 13:41:04 -- STEP: 1562/2322 -- GLOBAL_STEP: 10850 | > loss_text_ce: 0.05823924392461777 (0.059076566268211755) | > loss_mel_ce: 3.5587234497070312 (3.4663619102192285) | > loss: 0.4521203339099884 (0.440679809748745) | > current_lr: 5e-06 | > step_time: 0.4405 (0.46437767480002773) | > loader_time: 0.0302 (0.030203937721008222)  --> TIME: 2024-12-22 13:41:39 -- STEP: 1612/2322 -- GLOBAL_STEP: 10900 | > loss_text_ce: 0.05856705084443092 (0.059054622657726485) | > loss_mel_ce: 3.463893413543701 (3.4655606811750608) | > loss: 0.4403075575828552 (0.44057691317264275) | > current_lr: 5e-06 | > step_time: 0.4863 (0.4640775810991859) | > loader_time: 0.0324 (0.030245408674623477)  --> TIME: 2024-12-22 13:42:15 -- STEP: 1662/2322 -- GLOBAL_STEP: 10950 | > loss_text_ce: 0.055706605315208435 (0.059017475039914495) | > loss_mel_ce: 3.3823976516723633 (3.4648695993366077) | > loss: 0.4297630190849304 (0.4404858844948734) | > current_lr: 5e-06 | > step_time: 0.4895 (0.4640789331798805) | > loader_time: 0.0334 (0.030297340468809494)  --> TIME: 2024-12-22 13:42:50 -- STEP: 1712/2322 -- GLOBAL_STEP: 11000 | > loss_text_ce: 0.05792582780122757 (0.05899409460617561) | > loss_mel_ce: 3.3833515644073486 (3.4639923858029813) | > loss: 0.43015968799591064 (0.4403733103144393) | > current_lr: 5e-06 | > step_time: 0.3969 (0.4639268702714242) | > loader_time: 0.0307 (0.030337040947976512)  --> TIME: 2024-12-22 13:43:25 -- STEP: 1762/2322 -- GLOBAL_STEP: 11050 | > loss_text_ce: 0.05629318207502365 (0.058969441606799546) | > loss_mel_ce: 3.3706183433532715 (3.463131511251988) | > loss: 0.42836394906044006 (0.44026261941867045) | > current_lr: 5e-06 | > step_time: 0.4542 (0.46391109778851297) | > loader_time: 0.0315 (0.030382733068996606)  --> TIME: 2024-12-22 13:44:01 -- STEP: 1812/2322 -- GLOBAL_STEP: 11100 | > loss_text_ce: 0.05631483346223831 (0.058939213512946446) | > loss_mel_ce: 3.3508691787719727 (3.462454587944822) | > loss: 0.425898015499115 (0.44017422544640433) | > current_lr: 5e-06 | > step_time: 0.4244 (0.4639745312547578) | > loader_time: 0.0323 (0.030423800676863715)  --> TIME: 2024-12-22 13:44:36 -- STEP: 1862/2322 -- GLOBAL_STEP: 11150 | > loss_text_ce: 0.0563114732503891 (0.05891415319344476) | > loss_mel_ce: 3.444282293319702 (3.4617383186850454) | > loss: 0.43757420778274536 (0.44008155927366155) | > current_lr: 5e-06 | > step_time: 0.4526 (0.46374924712995447) | > loader_time: 0.0319 (0.030455693138401182)  --> TIME: 2024-12-22 13:45:12 -- STEP: 1912/2322 -- GLOBAL_STEP: 11200 | > loss_text_ce: 0.055813439190387726 (0.05889519725859976) | > loss_mel_ce: 3.423868417739868 (3.4609747583896042) | > loss: 0.4349602460861206 (0.4399837447665477) | > current_lr: 5e-06 | > step_time: 0.4181 (0.46374312517034455) | > loader_time: 0.0314 (0.030488876368710185)  --> TIME: 2024-12-22 13:45:47 -- STEP: 1962/2322 -- GLOBAL_STEP: 11250 | > loss_text_ce: 0.059178102761507034 (0.05888238045881587) | > loss_mel_ce: 3.433323621749878 (3.459829929893291) | > loss: 0.436562716960907 (0.43983903903966054) | > current_lr: 5e-06 | > step_time: 0.4144 (0.4636202888994284) | > loader_time: 0.0298 (0.0305158793014853)  --> TIME: 2024-12-22 13:46:22 -- STEP: 2012/2322 -- GLOBAL_STEP: 11300 | > loss_text_ce: 0.0569966696202755 (0.058855860523701786) | > loss_mel_ce: 3.2871227264404297 (3.4594050984733378) | > loss: 0.41801491379737854 (0.43978262008362223) | > current_lr: 5e-06 | > step_time: 0.487 (0.4636485443911542) | > loader_time: 0.0321 (0.03054378106153272)  --> TIME: 2024-12-22 13:46:57 -- STEP: 2062/2322 -- GLOBAL_STEP: 11350 | > loss_text_ce: 0.05874228477478027 (0.0588322969010799) | > loss_mel_ce: 3.36934757232666 (3.4586825363851075) | > loss: 0.42851123213768005 (0.4396893543658272) | > current_lr: 5e-06 | > step_time: 0.4402 (0.46343536716890377) | > loader_time: 0.0303 (0.030569810640684734)  --> TIME: 2024-12-22 13:47:33 -- STEP: 2112/2322 -- GLOBAL_STEP: 11400 | > loss_text_ce: 0.05667899176478386 (0.05881082465357119) | > loss_mel_ce: 3.3569679260253906 (3.4579716756036785) | > loss: 0.42670586705207825 (0.43959781273522175) | > current_lr: 5e-06 | > step_time: 0.3621 (0.4636496080819404) | > loader_time: 0.029 (0.03061613846908916)  --> TIME: 2024-12-22 13:48:09 -- STEP: 2162/2322 -- GLOBAL_STEP: 11450 | > loss_text_ce: 0.057710181921720505 (0.05878631795423104) | > loss_mel_ce: 3.3351664543151855 (3.457515349330778) | > loss: 0.4241095781326294 (0.4395377085812109) | > current_lr: 5e-06 | > step_time: 0.4272 (0.463620159716434) | > loader_time: 0.0305 (0.03065616096422476)  --> TIME: 2024-12-22 13:48:44 -- STEP: 2212/2322 -- GLOBAL_STEP: 11500 | > loss_text_ce: 0.06019604578614235 (0.05876600643144971) | > loss_mel_ce: 3.356213092803955 (3.4567745045555) | > loss: 0.4270511567592621 (0.43944256407820104) | > current_lr: 5e-06 | > step_time: 0.4357 (0.4635920776812121) | > loader_time: 0.0306 (0.030674265155309362)  --> TIME: 2024-12-22 13:49:20 -- STEP: 2262/2322 -- GLOBAL_STEP: 11550 | > loss_text_ce: 0.05769709125161171 (0.0587443840433864) | > loss_mel_ce: 3.3947904109954834 (3.455698754595612) | > loss: 0.4315609335899353 (0.43930539250321154) | > current_lr: 5e-06 | > step_time: 0.4815 (0.4635825132923143) | > loader_time: 0.0315 (0.03069024366366979)  --> TIME: 2024-12-22 13:49:55 -- STEP: 2312/2322 -- GLOBAL_STEP: 11600 | > loss_text_ce: 0.055086616426706314 (0.058716035475406575) | > loss_mel_ce: 3.426546573638916 (3.4553184861955324) | > loss: 0.4352041482925415 (0.4392543153573073) | > current_lr: 5e-06 | > step_time: 0.4183 (0.46341605974316186) | > loader_time: 0.0311 (0.030717967084534854)  > EVALUATION  --> EVAL PERFORMANCE | > avg_loader_time: 0.19052975827997382 (-0.00032908025414052355) | > avg_loss_text_ce: 0.05501443089334049 (-0.002109225688859677) | > avg_loss_mel_ce: 3.348767486485568 (-0.06839428646395929) | > avg_loss: 3.4037819149518254 (-0.07050351903896157) > BEST MODEL : /checkpoints/GPT_XTTS_FT-December-22-2024_11+26AM-0000000/best_model_11610.pth  > EPOCH: 5/10 --> /checkpoints/GPT_XTTS_FT-December-22-2024_11+26AM-0000000  > TRAINING (2024-12-22 13:51:28)   --> TIME: 2024-12-22 13:51:58 -- STEP: 40/2322 -- GLOBAL_STEP: 11650 | > loss_text_ce: 0.059111401438713074 (0.05776696419343352) | > loss_mel_ce: 3.427788496017456 (3.404183381795883) | > loss: 0.4358624815940857 (0.4327437922358513) | > current_lr: 5e-06 | > step_time: 0.4313 (0.4636858880519867) | > loader_time: 0.0357 (0.03582853674888611)  --> TIME: 2024-12-22 13:52:33 -- STEP: 90/2322 -- GLOBAL_STEP: 11700 | > loss_text_ce: 0.05683823302388191 (0.0574896790087223) | > loss_mel_ce: 3.395373821258545 (3.4118890470928616) | > loss: 0.4315265119075775 (0.43367234037982094) | > current_lr: 5e-06 | > step_time: 0.4866 (0.4568853537241618) | > loader_time: 0.0325 (0.03488535351223415)  --> TIME: 2024-12-22 13:53:09 -- STEP: 140/2322 -- GLOBAL_STEP: 11750 | > loss_text_ce: 0.056105345487594604 (0.057422201308820926) | > loss_mel_ce: 3.3306148052215576 (3.410437182017735) | > loss: 0.4233400225639343 (0.4334824229989733) | > current_lr: 5e-06 | > step_time: 0.5734 (0.46072266101837156) | > loader_time: 0.0363 (0.03440804992403304)  --> TIME: 2024-12-22 13:53:45 -- STEP: 190/2322 -- GLOBAL_STEP: 11800 | > loss_text_ce: 0.05686768516898155 (0.057508736417481776) | > loss_mel_ce: 3.4133055210113525 (3.4111183229245636) | > loss: 0.43377164006233215 (0.4335783823540336) | > current_lr: 5e-06 | > step_time: 0.4319 (0.4622577152754131) | > loader_time: 0.0304 (0.03404086765490082)  --> TIME: 2024-12-22 13:54:20 -- STEP: 240/2322 -- GLOBAL_STEP: 11850 | > loss_text_ce: 0.05498127639293671 (0.057487397408112886) | > loss_mel_ce: 3.425912618637085 (3.4128191649913786) | > loss: 0.43511173129081726 (0.4337883200496435) | > current_lr: 5e-06 | > step_time: 0.4194 (0.460936372478803) | > loader_time: 0.0326 (0.03373313943545025)  --> TIME: 2024-12-22 13:54:56 -- STEP: 290/2322 -- GLOBAL_STEP: 11900 | > loss_text_ce: 0.053684599697589874 (0.057443868317480745) | > loss_mel_ce: 3.3601326942443848 (3.4132748661370123) | > loss: 0.42672717571258545 (0.4338398416494501) | > current_lr: 5e-06 | > step_time: 0.495 (0.4614284087871683) | > loader_time: 0.035 (0.03359409365160714)  --> TIME: 2024-12-22 13:55:32 -- STEP: 340/2322 -- GLOBAL_STEP: 11950 | > loss_text_ce: 0.058677565306425095 (0.057511774680632004) | > loss_mel_ce: 3.441671848297119 (3.4125332846361047) | > loss: 0.43754369020462036 (0.4337556325337466) | > current_lr: 5e-06 | > step_time: 0.4382 (0.46219628979178035) | > loader_time: 0.0358 (0.033555442445418464)  --> TIME: 2024-12-22 13:56:08 -- STEP: 390/2322 -- GLOBAL_STEP: 12000 | > loss_text_ce: 0.05708717182278633 (0.057518262110459496) | > loss_mel_ce: 3.3940398693084717 (3.412412782204457) | > loss: 0.4313908815383911 (0.43374138046533633) | > current_lr: 5e-06 | > step_time: 0.5411 (0.463387009425041) | > loader_time: 0.0339 (0.033465178196246864)  --> TIME: 2024-12-22 13:56:44 -- STEP: 440/2322 -- GLOBAL_STEP: 12050 | > loss_text_ce: 0.05813072994351387 (0.0575018882158805) | > loss_mel_ce: 3.3011717796325684 (3.4114858947016975) | > loss: 0.41991281509399414 (0.43362347293983805) | > current_lr: 5e-06 | > step_time: 0.4847 (0.4637982747771523) | > loader_time: 0.0334 (0.03333141532811252)  --> TIME: 2024-12-22 13:57:20 -- STEP: 490/2322 -- GLOBAL_STEP: 12100 | > loss_text_ce: 0.05711169168353081 (0.057458197888062924) | > loss_mel_ce: 3.341585874557495 (3.410831901978473) | > loss: 0.424837201833725 (0.4335362624757144) | > current_lr: 5e-06 | > step_time: 0.4527 (0.4643586134424015) | > loader_time: 0.0331 (0.033204079647453456)  --> TIME: 2024-12-22 13:57:55 -- STEP: 540/2322 -- GLOBAL_STEP: 12150 | > loss_text_ce: 0.06020263954997063 (0.057455433498102206) | > loss_mel_ce: 3.333272933959961 (3.409271108221125) | > loss: 0.4241844415664673 (0.4333408179106536) | > current_lr: 5e-06 | > step_time: 0.4932 (0.46449103576165657) | > loader_time: 0.0341 (0.033266066180335147)  --> TIME: 2024-12-22 13:58:31 -- STEP: 590/2322 -- GLOBAL_STEP: 12200 | > loss_text_ce: 0.05776055157184601 (0.05742172888653763) | > loss_mel_ce: 3.451760768890381 (3.4088822041527704) | > loss: 0.4386901557445526 (0.4332879918611656) | > current_lr: 5e-06 | > step_time: 0.4178 (0.46456838300672626) | > loader_time: 0.0298 (0.033261019900693724)  --> TIME: 2024-12-22 13:59:07 -- STEP: 640/2322 -- GLOBAL_STEP: 12250 | > loss_text_ce: 0.056413959711790085 (0.05744157133740373) | > loss_mel_ce: 3.3978750705718994 (3.4079722858965398) | > loss: 0.43178611993789673 (0.4331767323426902) | > current_lr: 5e-06 | > step_time: 0.4173 (0.46427544616162775) | > loader_time: 0.0339 (0.03325710184872151)  --> TIME: 2024-12-22 13:59:42 -- STEP: 690/2322 -- GLOBAL_STEP: 12300 | > loss_text_ce: 0.058883413672447205 (0.0574067137217608) | > loss_mel_ce: 3.404334545135498 (3.4073953479960344) | > loss: 0.4329022467136383 (0.43310025787871814) | > current_lr: 5e-06 | > step_time: 0.4351 (0.4640740888706152) | > loader_time: 0.032 (0.03330202448195305)  --> TIME: 2024-12-22 14:00:18 -- STEP: 740/2322 -- GLOBAL_STEP: 12350 | > loss_text_ce: 0.05691131576895714 (0.05736731128716791) | > loss_mel_ce: 3.4108529090881348 (3.4071844178277093) | > loss: 0.4334705173969269 (0.4330689661406182) | > current_lr: 5e-06 | > step_time: 0.4697 (0.46384108517621014) | > loader_time: 0.0399 (0.033397010854772605)  --> TIME: 2024-12-22 14:00:54 -- STEP: 790/2322 -- GLOBAL_STEP: 12400 | > loss_text_ce: 0.05885474011301994 (0.057379786778665794) | > loss_mel_ce: 3.296797752380371 (3.406755204743977) | > loss: 0.4194565713405609 (0.43301687387725973) | > current_lr: 5e-06 | > step_time: 0.4366 (0.4639869152745114) | > loader_time: 0.0339 (0.03350627935385399)  --> TIME: 2024-12-22 14:01:29 -- STEP: 840/2322 -- GLOBAL_STEP: 12450 | > loss_text_ce: 0.05671809986233711 (0.057337763311252704) | > loss_mel_ce: 3.320280075073242 (3.405323811372121) | > loss: 0.4221247732639313 (0.4328326968919663) | > current_lr: 5e-06 | > step_time: 0.3324 (0.4637592009135655) | > loader_time: 0.0318 (0.03357253159795484)  --> TIME: 2024-12-22 14:02:05 -- STEP: 890/2322 -- GLOBAL_STEP: 12500 | > loss_text_ce: 0.05829297751188278 (0.05731719382776973) | > loss_mel_ce: 3.2775707244873047 (3.4041995313730133) | > loss: 0.4169829487800598 (0.43268959053446737) | > current_lr: 5e-06 | > step_time: 0.437 (0.4636907239978233) | > loader_time: 0.035 (0.03364518278100513)  --> TIME: 2024-12-22 14:02:41 -- STEP: 940/2322 -- GLOBAL_STEP: 12550 | > loss_text_ce: 0.055114373564720154 (0.057303515564095464) | > loss_mel_ce: 3.3531787395477295 (3.4035934143878044) | > loss: 0.42603662610054016 (0.4326121160007538) | > current_lr: 5e-06 | > step_time: 0.5411 (0.4642182809241275) | > loader_time: 0.036 (0.03373665302357772)  --> TIME: 2024-12-22 14:03:17 -- STEP: 990/2322 -- GLOBAL_STEP: 12600 | > loss_text_ce: 0.05610473081469536 (0.05729643404483795) | > loss_mel_ce: 3.3441195487976074 (3.402979591157701) | > loss: 0.4250280261039734 (0.4325345029734602) | > current_lr: 5e-06 | > step_time: 0.6056 (0.4644855641355418) | > loader_time: 0.0378 (0.03381952035306679)  --> TIME: 2024-12-22 14:03:52 -- STEP: 1040/2322 -- GLOBAL_STEP: 12650 | > loss_text_ce: 0.05898106098175049 (0.057250344473868606) | > loss_mel_ce: 3.4505138397216797 (3.4021617389642276) | > loss: 0.4386868476867676 (0.43242651029275014) | > current_lr: 5e-06 | > step_time: 0.3987 (0.4640322790696071) | > loader_time: 0.0349 (0.033863450242922845)  --> TIME: 2024-12-22 14:04:29 -- STEP: 1090/2322 -- GLOBAL_STEP: 12700 | > loss_text_ce: 0.05605948343873024 (0.057211308526473305) | > loss_mel_ce: 3.344714641571045 (3.401145189180286) | > loss: 0.4250967800617218 (0.43229456210355155) | > current_lr: 5e-06 | > step_time: 0.5447 (0.4646294014169536) | > loader_time: 0.0356 (0.03393428500639188)  --> TIME: 2024-12-22 14:05:05 -- STEP: 1140/2322 -- GLOBAL_STEP: 12750 | > loss_text_ce: 0.05710591748356819 (0.057185556670944944) | > loss_mel_ce: 3.4087400436401367 (3.4005359214648863) | > loss: 0.43323075771331787 (0.43221518470529935) | > current_lr: 5e-06 | > step_time: 0.4438 (0.46444726931421393) | > loader_time: 0.0358 (0.033984634332489536)  --> TIME: 2024-12-22 14:05:40 -- STEP: 1190/2322 -- GLOBAL_STEP: 12800 | > loss_text_ce: 0.057090647518634796 (0.05716267705214124) | > loss_mel_ce: 3.3681790828704834 (3.39961037054783) | > loss: 0.4281587302684784 (0.4320966308858216) | > current_lr: 5e-06 | > step_time: 0.4542 (0.4644458277886656) | > loader_time: 0.035 (0.03405609190964898)  --> TIME: 2024-12-22 14:06:16 -- STEP: 1240/2322 -- GLOBAL_STEP: 12850 | > loss_text_ce: 0.056378357112407684 (0.057148901934945776) | > loss_mel_ce: 3.541835308074951 (3.3991947152922215) | > loss: 0.44977670907974243 (0.4320429520501246) | > current_lr: 5e-06 | > step_time: 0.4187 (0.4640511280105961) | > loader_time: 0.0367 (0.03410523937594504)  --> TIME: 2024-12-22 14:06:51 -- STEP: 1290/2322 -- GLOBAL_STEP: 12900 | > loss_text_ce: 0.05645120143890381 (0.057138996351827946) | > loss_mel_ce: 3.334303140640259 (3.3988189240758717) | > loss: 0.42384427785873413 (0.4319947400296383) | > current_lr: 5e-06 | > step_time: 0.4494 (0.46402018994323974) | > loader_time: 0.0329 (0.034161897777586936)  --> TIME: 2024-12-22 14:07:27 -- STEP: 1340/2322 -- GLOBAL_STEP: 12950 | > loss_text_ce: 0.058268435299396515 (0.05710698607753017) | > loss_mel_ce: 3.4172422885894775 (3.398991823730183) | > loss: 0.4344388544559479 (0.4320123512353472) | > current_lr: 5e-06 | > step_time: 0.4432 (0.46405637513345754) | > loader_time: 0.0355 (0.03421830294737173)  --> TIME: 2024-12-22 14:08:03 -- STEP: 1390/2322 -- GLOBAL_STEP: 13000 | > loss_text_ce: 0.05785388499498367 (0.05708079773584287) | > loss_mel_ce: 3.423856496810913 (3.398403769602877) | > loss: 0.4352138042449951 (0.43193557093040563) | > current_lr: 5e-06 | > step_time: 0.3697 (0.4640662882825454) | > loader_time: 0.0308 (0.03428319769797563)  --> TIME: 2024-12-22 14:08:39 -- STEP: 1440/2322 -- GLOBAL_STEP: 13050 | > loss_text_ce: 0.05577696114778519 (0.057060866735668646) | > loss_mel_ce: 3.4184675216674805 (3.3981253488196255) | > loss: 0.4342805743217468 (0.4318982769631679) | > current_lr: 5e-06 | > step_time: 0.4189 (0.4639430368940036) | > loader_time: 0.0344 (0.034354886578189)  --> TIME: 2024-12-22 14:09:15 -- STEP: 1490/2322 -- GLOBAL_STEP: 13100 | > loss_text_ce: 0.05562716722488403 (0.05704338806837597) | > loss_mel_ce: 3.254814386367798 (3.3973087965242) | > loss: 0.41380518674850464 (0.4317940231137629) | > current_lr: 5e-06 | > step_time: 0.391 (0.46430622891291684) | > loader_time: 0.0323 (0.034439907458004536)  --> TIME: 2024-12-22 14:09:51 -- STEP: 1540/2322 -- GLOBAL_STEP: 13150 | > loss_text_ce: 0.05382959172129631 (0.05702588779779224) | > loss_mel_ce: 3.3155784606933594 (3.3964621186256396) | > loss: 0.421176016330719 (0.4316860008936425) | > current_lr: 5e-06 | > step_time: 0.4833 (0.4644386582560354) | > loader_time: 0.0391 (0.03451398162098675)  --> TIME: 2024-12-22 14:10:27 -- STEP: 1590/2322 -- GLOBAL_STEP: 13200 | > loss_text_ce: 0.0561944916844368 (0.05700634011776192) | > loss_mel_ce: 3.350593328475952 (3.3956782318511087) | > loss: 0.42584848403930664 (0.4315855715447253) | > current_lr: 5e-06 | > step_time: 0.4897 (0.46459013096191604) | > loader_time: 0.0383 (0.03458514963305972)  --> TIME: 2024-12-22 14:11:04 -- STEP: 1640/2322 -- GLOBAL_STEP: 13250 | > loss_text_ce: 0.05697016417980194 (0.0569840506468786) | > loss_mel_ce: 3.4366354942321777 (3.395131543496759) | > loss: 0.436700701713562 (0.43151444934490263) | > current_lr: 5e-06 | > step_time: 0.4397 (0.46470923758134614) | > loader_time: 0.0389 (0.03465385902218704)  --> TIME: 2024-12-22 14:11:39 -- STEP: 1690/2322 -- GLOBAL_STEP: 13300 | > loss_text_ce: 0.05504821240901947 (0.05696582896249181) | > loss_mel_ce: 3.2928590774536133 (3.3943898385798428) | > loss: 0.41848841309547424 (0.43141945849156255) | > current_lr: 5e-06 | > step_time: 0.3766 (0.46456124782562264) | > loader_time: 0.0337 (0.0347184573404888)  --> TIME: 2024-12-22 14:12:16 -- STEP: 1740/2322 -- GLOBAL_STEP: 13350 | > loss_text_ce: 0.052312202751636505 (0.056937855128841156) | > loss_mel_ce: 3.4334938526153564 (3.3940827208003768) | > loss: 0.43572574853897095 (0.4313775720610017) | > current_lr: 5e-06 | > step_time: 0.4143 (0.46484612897894856) | > loader_time: 0.0371 (0.03480637128325717)  --> TIME: 2024-12-22 14:12:52 -- STEP: 1790/2322 -- GLOBAL_STEP: 13400 | > loss_text_ce: 0.057630497962236404 (0.0569143691042948) | > loss_mel_ce: 3.4514310359954834 (3.3932628383849575) | > loss: 0.43863269686698914 (0.43127215101732236) | > current_lr: 5e-06 | > step_time: 0.4913 (0.46490261368245395) | > loader_time: 0.0389 (0.0348843963452558)  --> TIME: 2024-12-22 14:13:28 -- STEP: 1840/2322 -- GLOBAL_STEP: 13450 | > loss_text_ce: 0.0553569495677948 (0.05689057350644599) | > loss_mel_ce: 3.297841787338257 (3.393147273944771) | > loss: 0.41914984583854675 (0.4312547310538915) | > current_lr: 5e-06 | > step_time: 0.5055 (0.46509931722412945) | > loader_time: 0.0417 (0.03496672847996589)  --> TIME: 2024-12-22 14:14:05 -- STEP: 1890/2322 -- GLOBAL_STEP: 13500 | > loss_text_ce: 0.05611246079206467 (0.056883922915058165) | > loss_mel_ce: 3.4313857555389404 (3.3929851217875395) | > loss: 0.4359372854232788 (0.4312336307827128) | > current_lr: 5e-06 | > step_time: 0.4538 (0.4652234667823429) | > loader_time: 0.0352 (0.03502306711106075)  --> TIME: 2024-12-22 14:14:41 -- STEP: 1940/2322 -- GLOBAL_STEP: 13550 | > loss_text_ce: 0.056028205901384354 (0.05685304188428773) | > loss_mel_ce: 3.3111050128936768 (3.392371757743284) | > loss: 0.4208916425704956 (0.4311531001145079) | > current_lr: 5e-06 | > step_time: 0.4965 (0.46534775470949946) | > loader_time: 0.0409 (0.03508704482894584)  --> TIME: 2024-12-22 14:15:16 -- STEP: 1990/2322 -- GLOBAL_STEP: 13600 | > loss_text_ce: 0.058609966188669205 (0.05682682487271239) | > loss_mel_ce: 3.366556167602539 (3.3919336910822873) | > loss: 0.42814576625823975 (0.43109506458493346) | > current_lr: 5e-06 | > step_time: 0.436 (0.46521996145871425) | > loader_time: 0.0347 (0.035143307465404734)  --> TIME: 2024-12-22 14:15:52 -- STEP: 2040/2322 -- GLOBAL_STEP: 13650 | > loss_text_ce: 0.0565619170665741 (0.05681930388159612) | > loss_mel_ce: 3.369460105895996 (3.391561967251347) | > loss: 0.4282527565956116 (0.43104765898748953) | > current_lr: 5e-06 | > step_time: 0.432 (0.4650104243381351) | > loader_time: 0.0379 (0.03520295023918153)  --> TIME: 2024-12-22 14:16:27 -- STEP: 2090/2322 -- GLOBAL_STEP: 13700 | > loss_text_ce: 0.05136154964566231 (0.056801787483991624) | > loss_mel_ce: 3.3682849407196045 (3.3908061660647952) | > loss: 0.4274558126926422 (0.4309509942833888) | > current_lr: 5e-06 | > step_time: 0.4942 (0.46495015233327325) | > loader_time: 0.0389 (0.03524696678636178)  --> TIME: 2024-12-22 14:17:04 -- STEP: 2140/2322 -- GLOBAL_STEP: 13750 | > loss_text_ce: 0.05699479579925537 (0.05677987542003392) | > loss_mel_ce: 3.3367128372192383 (3.3905131442524548) | > loss: 0.4242134690284729 (0.4309116275928846) | > current_lr: 5e-06 | > step_time: 0.5403 (0.46499530901418673) | > loader_time: 0.0374 (0.035297186798024405)  --> TIME: 2024-12-22 14:17:40 -- STEP: 2190/2322 -- GLOBAL_STEP: 13800 | > loss_text_ce: 0.056207962334156036 (0.05676238187950222) | > loss_mel_ce: 3.273129940032959 (3.3898390520653208) | > loss: 0.4161672294139862 (0.43082517940704146) | > current_lr: 5e-06 | > step_time: 0.4641 (0.4651396147192341) | > loader_time: 0.0358 (0.035339029738892164)  --> TIME: 2024-12-22 14:18:16 -- STEP: 2240/2322 -- GLOBAL_STEP: 13850 | > loss_text_ce: 0.05517818406224251 (0.05674272266915067) | > loss_mel_ce: 3.3284692764282227 (3.3891860802258766) | > loss: 0.4229559302330017 (0.43074110054544046) | > current_lr: 5e-06 | > step_time: 0.3888 (0.46534313900130136) | > loader_time: 0.0326 (0.03536055002893723)  --> TIME: 2024-12-22 14:18:52 -- STEP: 2290/2322 -- GLOBAL_STEP: 13900 | > loss_text_ce: 0.05837025120854378 (0.056724260495284215) | > loss_mel_ce: 3.2600369453430176 (3.388640721083729) | > loss: 0.4148009121417999 (0.43067062288913166) | > current_lr: 5e-06 | > step_time: 0.4909 (0.4651141745554828) | > loader_time: 0.0337 (0.03539813085414441)  > EVALUATION  --> EVAL PERFORMANCE | > avg_loader_time: 0.19675787771591025 (+0.00622811943593643) | > avg_loss_text_ce: 0.0533320013847616 (-0.0016824295085788865) | > avg_loss_mel_ce: 3.294915063212616 (-0.05385242327295181) | > avg_loss: 3.3482470656886245 (-0.05553484926320085) > BEST MODEL : /checkpoints/GPT_XTTS_FT-December-22-2024_11+26AM-0000000/best_model_13932.pth  > EPOCH: 6/10 --> /checkpoints/GPT_XTTS_FT-December-22-2024_11+26AM-0000000  > TRAINING (2024-12-22 14:20:45)   --> TIME: 2024-12-22 14:20:59 -- STEP: 18/2322 -- GLOBAL_STEP: 13950 | > loss_text_ce: 0.05511258542537689 (0.0551488364322318) | > loss_mel_ce: 3.427117109298706 (3.369334101676941) | > loss: 0.4352787137031555 (0.428060371014807) | > current_lr: 5e-06 | > step_time: 0.6229 (0.46188444561428493) | > loader_time: 0.0326 (0.03408477041456434)  --> TIME: 2024-12-22 14:21:34 -- STEP: 68/2322 -- GLOBAL_STEP: 14000 | > loss_text_ce: 0.05454476550221443 (0.055402691969100165) | > loss_mel_ce: 3.457061767578125 (3.355925514417536) | > loss: 0.4389508068561554 (0.4264160271953134) | > current_lr: 5e-06 | > step_time: 0.4817 (0.45654235517277436) | > loader_time: 0.0338 (0.032835259157068586)  --> TIME: 2024-12-22 14:22:10 -- STEP: 118/2322 -- GLOBAL_STEP: 14050 | > loss_text_ce: 0.05457153543829918 (0.05567869465103594) | > loss_mel_ce: 3.2884721755981445 (3.3549378605212197) | > loss: 0.41788047552108765 (0.4263270717051069) | > current_lr: 5e-06 | > step_time: 0.5681 (0.4615923085455167) | > loader_time: 0.0326 (0.032524719076641534)  --> TIME: 2024-12-22 14:22:46 -- STEP: 168/2322 -- GLOBAL_STEP: 14100 | > loss_text_ce: 0.05786797031760216 (0.05580570628600461) | > loss_mel_ce: 3.4922549724578857 (3.357994733821778) | > loss: 0.4437653720378876 (0.4267250561998004) | > current_lr: 5e-06 | > step_time: 0.3682 (0.4629859583718436) | > loader_time: 0.027 (0.0323089233466557)  --> TIME: 2024-12-22 14:23:21 -- STEP: 218/2322 -- GLOBAL_STEP: 14150 | > loss_text_ce: 0.05463910102844238 (0.05586287659516028) | > loss_mel_ce: 3.304473400115967 (3.3581792488010653) | > loss: 0.41988906264305115 (0.4267552665887623) | > current_lr: 5e-06 | > step_time: 0.4839 (0.462605172341023) | > loader_time: 0.033 (0.03230696752530718)  --> TIME: 2024-12-22 14:23:56 -- STEP: 268/2322 -- GLOBAL_STEP: 14200 | > loss_text_ce: 0.05791747570037842 (0.05584019126453951) | > loss_mel_ce: 3.3395373821258545 (3.3586216373230093) | > loss: 0.4246818423271179 (0.42680772927714816) | > current_lr: 5e-06 | > step_time: 0.4161 (0.46173974026494946) | > loader_time: 0.0308 (0.0325577374714524)  --> TIME: 2024-12-22 14:24:32 -- STEP: 318/2322 -- GLOBAL_STEP: 14250 | > loss_text_ce: 0.05663691833615303 (0.055825347256548) | > loss_mel_ce: 3.228719472885132 (3.358033959970535) | > loss: 0.4106695353984833 (0.42673241398619405) | > current_lr: 5e-06 | > step_time: 0.4539 (0.46161762123587746) | > loader_time: 0.0294 (0.03276198090247386)  --> TIME: 2024-12-22 14:25:08 -- STEP: 368/2322 -- GLOBAL_STEP: 14300 | > loss_text_ce: 0.05455949530005455 (0.05579393969484321) | > loss_mel_ce: 3.3553476333618164 (3.358205914497376) | > loss: 0.42623838782310486 (0.4267499823447155) | > current_lr: 5e-06 | > step_time: 0.3956 (0.4623924519704736) | > loader_time: 0.0335 (0.032896468172902614)  --> TIME: 2024-12-22 14:25:43 -- STEP: 418/2322 -- GLOBAL_STEP: 14350 | > loss_text_ce: 0.05281222239136696 (0.055766924306679) | > loss_mel_ce: 3.292203664779663 (3.358233000673176) | > loss: 0.41812700033187866 (0.42674999110151135) | > current_lr: 5e-06 | > step_time: 0.4944 (0.4623816138819644) | > loader_time: 0.0349 (0.032967481886941236)  --> TIME: 2024-12-22 14:26:20 -- STEP: 468/2322 -- GLOBAL_STEP: 14400 | > loss_text_ce: 0.05509205162525177 (0.05572434323720443) | > loss_mel_ce: 3.3365705013275146 (3.356849606729981) | > loss: 0.42395782470703125 (0.4265717442473795) | > current_lr: 5e-06 | > step_time: 0.4405 (0.46323638135551387) | > loader_time: 0.0308 (0.03306917298553331)  --> TIME: 2024-12-22 14:26:55 -- STEP: 518/2322 -- GLOBAL_STEP: 14450 | > loss_text_ce: 0.05369885265827179 (0.05567955793848829) | > loss_mel_ce: 3.384530544281006 (3.35812127682233) | > loss: 0.42977866530418396 (0.4267251050840474) | > current_lr: 5e-06 | > step_time: 0.4911 (0.46268526191416853) | > loader_time: 0.0336 (0.03312509814744744)  --> TIME: 2024-12-22 14:27:30 -- STEP: 568/2322 -- GLOBAL_STEP: 14500 | > loss_text_ce: 0.05585191026329994 (0.05570398450789737) | > loss_mel_ce: 3.393056631088257 (3.3568222854338905) | > loss: 0.4311135709285736 (0.4265657845412342) | > current_lr: 5e-06 | > step_time: 0.4374 (0.4619118096962781) | > loader_time: 0.03 (0.03321448807985006)  --> TIME: 2024-12-22 14:28:05 -- STEP: 618/2322 -- GLOBAL_STEP: 14550 | > loss_text_ce: 0.056798018515110016 (0.055681429700895804) | > loss_mel_ce: 3.407184600830078 (3.356313405299263) | > loss: 0.43299782276153564 (0.4264993552829841) | > current_lr: 5e-06 | > step_time: 0.3861 (0.46151409488665635) | > loader_time: 0.0334 (0.03336052292758974)  --> TIME: 2024-12-22 14:28:41 -- STEP: 668/2322 -- GLOBAL_STEP: 14600 | > loss_text_ce: 0.0567203089594841 (0.05565602933530679) | > loss_mel_ce: 3.3884453773498535 (3.355350486175742) | > loss: 0.4306457042694092 (0.42637581534371405) | > current_lr: 5e-06 | > step_time: 0.4183 (0.4619363967530028) | > loader_time: 0.0346 (0.03347175064201122)  --> TIME: 2024-12-22 14:29:18 -- STEP: 718/2322 -- GLOBAL_STEP: 14650 | > loss_text_ce: 0.05168299004435539 (0.05562711230538848) | > loss_mel_ce: 3.240053176879883 (3.355410282990394) | > loss: 0.4114670157432556 (0.42637967523758125) | > current_lr: 5e-06 | > step_time: 0.462 (0.4628971688926718) | > loader_time: 0.0351 (0.03357395122974361)  --> TIME: 2024-12-22 14:29:54 -- STEP: 768/2322 -- GLOBAL_STEP: 14700 | > loss_text_ce: 0.05736495181918144 (0.05563337995651333) | > loss_mel_ce: 3.362647771835327 (3.3544776979833837) | > loss: 0.4275015890598297 (0.4262638856113578) | > current_lr: 5e-06 | > step_time: 0.4826 (0.46287382549295825) | > loader_time: 0.0436 (0.033785289153456674)  --> TIME: 2024-12-22 14:30:30 -- STEP: 818/2322 -- GLOBAL_STEP: 14750 | > loss_text_ce: 0.053960155695676804 (0.0556056359532337) | > loss_mel_ce: 3.2662246227264404 (3.354095443536716) | > loss: 0.4150230884552002 (0.4262126357019093) | > current_lr: 5e-06 | > step_time: 0.5437 (0.46320491198514085) | > loader_time: 0.0375 (0.03391315738845865)  --> TIME: 2024-12-22 14:31:06 -- STEP: 868/2322 -- GLOBAL_STEP: 14800 | > loss_text_ce: 0.05329437553882599 (0.055588668023454975) | > loss_mel_ce: 3.31180477142334 (3.3537701134857487) | > loss: 0.4206373989582062 (0.42616984831847354) | > current_lr: 5e-06 | > step_time: 0.4559 (0.46350494672625847) | > loader_time: 0.0367 (0.03408563301859915)  --> TIME: 2024-12-22 14:31:41 -- STEP: 918/2322 -- GLOBAL_STEP: 14850 | > loss_text_ce: 0.056662630289793015 (0.05556279016265033) | > loss_mel_ce: 3.43902850151062 (3.3533503913152187) | > loss: 0.4369613826274872 (0.4261141482391648) | > current_lr: 5e-06 | > step_time: 0.4633 (0.4632063104176573) | > loader_time: 0.0371 (0.03421435299002788)  --> TIME: 2024-12-22 14:32:17 -- STEP: 968/2322 -- GLOBAL_STEP: 14900 | > loss_text_ce: 0.056917741894721985 (0.05556682915203581) | > loss_mel_ce: 3.3537979125976562 (3.3533392555950097) | > loss: 0.42633944749832153 (0.4261132610484588) | > current_lr: 5e-06 | > step_time: 0.3996 (0.4630889695537977) | > loader_time: 0.04 (0.03434704305711857)  --> TIME: 2024-12-22 14:32:53 -- STEP: 1018/2322 -- GLOBAL_STEP: 14950 | > loss_text_ce: 0.05659564211964607 (0.055537806637219224) | > loss_mel_ce: 3.4504988193511963 (3.3525255592960734) | > loss: 0.43838679790496826 (0.42600792122379033) | > current_lr: 5e-06 | > step_time: 0.4868 (0.4630744890520287) | > loader_time: 0.036 (0.03445199828719343)  --> TIME: 2024-12-22 14:33:29 -- STEP: 1068/2322 -- GLOBAL_STEP: 15000 | > loss_text_ce: 0.05150763690471649 (0.05551484805158575) | > loss_mel_ce: 3.3674607276916504 (3.3518107984396397) | > loss: 0.4273710548877716 (0.42591570635859893) | > current_lr: 5e-06 | > step_time: 0.4376 (0.46337070826734056) | > loader_time: 0.0344 (0.03453310107470451)  --> TIME: 2024-12-22 14:34:05 -- STEP: 1118/2322 -- GLOBAL_STEP: 15050 | > loss_text_ce: 0.05098075792193413 (0.05548390084361136) | > loss_mel_ce: 3.2232158184051514 (3.350305642552793) | > loss: 0.4092745780944824 (0.42572369342519895) | > current_lr: 5e-06 | > step_time: 0.4525 (0.4632116863254144) | > loader_time: 0.0341 (0.03457079633190721)  --> TIME: 2024-12-22 14:34:39 -- STEP: 1168/2322 -- GLOBAL_STEP: 15100 | > loss_text_ce: 0.056083764880895615 (0.0554733347013746) | > loss_mel_ce: 3.2480080127716064 (3.349640445962343) | > loss: 0.41301146149635315 (0.4256392231032457) | > current_lr: 5e-06 | > step_time: 0.4093 (0.462771179741376) | > loader_time: 0.0372 (0.03461198365851623)  --> TIME: 2024-12-22 14:35:16 -- STEP: 1218/2322 -- GLOBAL_STEP: 15150 | > loss_text_ce: 0.05630217492580414 (0.05544200473218816) | > loss_mel_ce: 3.303457736968994 (3.349261219865581) | > loss: 0.41996997594833374 (0.42558790346965414) | > current_lr: 5e-06 | > step_time: 0.4635 (0.4629945077723861) | > loader_time: 0.0362 (0.03466770664615974)  --> TIME: 2024-12-22 14:35:51 -- STEP: 1268/2322 -- GLOBAL_STEP: 15200 | > loss_text_ce: 0.052986305207014084 (0.05540814076194818) | > loss_mel_ce: 3.355560779571533 (3.3488165405270407) | > loss: 0.42606839537620544 (0.42552808561723693) | > current_lr: 5e-06 | > step_time: 0.4539 (0.4631045075245083) | > loader_time: 0.0367 (0.0347205124066831)  --> TIME: 2024-12-22 14:36:28 -- STEP: 1318/2322 -- GLOBAL_STEP: 15250 | > loss_text_ce: 0.05495776981115341 (0.05538700351686599) | > loss_mel_ce: 3.2867491245269775 (3.3482610835652773) | > loss: 0.41771337389945984 (0.42545601139933276) | > current_lr: 5e-06 | > step_time: 0.4552 (0.46358943654843265) | > loader_time: 0.0408 (0.03479544580977673)  --> TIME: 2024-12-22 14:37:04 -- STEP: 1368/2322 -- GLOBAL_STEP: 15300 | > loss_text_ce: 0.0550200417637825 (0.055377815577762536) | > loss_mel_ce: 3.346097946166992 (3.3478815494573584) | > loss: 0.42513975501060486 (0.42540742103990753) | > current_lr: 5e-06 | > step_time: 0.3816 (0.46359148081283114) | > loader_time: 0.0405 (0.03484983750951215)  --> TIME: 2024-12-22 14:37:40 -- STEP: 1418/2322 -- GLOBAL_STEP: 15350 | > loss_text_ce: 0.05078783258795738 (0.05535596207425274) | > loss_mel_ce: 3.340367555618286 (3.3471424559443874) | > loss: 0.4238944351673126 (0.42531230263884884) | > current_lr: 5e-06 | > step_time: 0.4857 (0.46364734186272016) | > loader_time: 0.0421 (0.034968537066988235)  --> TIME: 2024-12-22 14:38:16 -- STEP: 1468/2322 -- GLOBAL_STEP: 15400 | > loss_text_ce: 0.05620192736387253 (0.05532930152394306) | > loss_mel_ce: 3.3345627784729004 (3.3455330625541833) | > loss: 0.4238455891609192 (0.42510779585679154) | > current_lr: 5e-06 | > step_time: 0.4686 (0.46354841633778493) | > loader_time: 0.0405 (0.035071850310229434)  --> TIME: 2024-12-22 14:38:52 -- STEP: 1518/2322 -- GLOBAL_STEP: 15450 | > loss_text_ce: 0.05608947202563286 (0.0553194837441008) | > loss_mel_ce: 3.3198063373565674 (3.344631408200118) | > loss: 0.42198696732521057 (0.42499386186420685) | > current_lr: 5e-06 | > step_time: 0.4687 (0.4637234196832528) | > loader_time: 0.0397 (0.03518240866453748)  --> TIME: 2024-12-22 14:39:28 -- STEP: 1568/2322 -- GLOBAL_STEP: 15500 | > loss_text_ce: 0.05350302532315254 (0.055297568903722796) | > loss_mel_ce: 3.3375396728515625 (3.3435499678765006) | > loss: 0.42388033866882324 (0.42485594251478204) | > current_lr: 5e-06 | > step_time: 0.397 (0.4638194601450647) | > loader_time: 0.0373 (0.035269684937535434)  --> TIME: 2024-12-22 14:40:04 -- STEP: 1618/2322 -- GLOBAL_STEP: 15550 | > loss_text_ce: 0.056617848575115204 (0.05528984659746273) | > loss_mel_ce: 3.4390361309051514 (3.3430946210700867) | > loss: 0.4369567334651947 (0.42479805889618855) | > current_lr: 5e-06 | > step_time: 0.4414 (0.4640857955286617) | > loader_time: 0.0358 (0.03536622824863384)  --> TIME: 2024-12-22 14:40:41 -- STEP: 1668/2322 -- GLOBAL_STEP: 15600 | > loss_text_ce: 0.05208100751042366 (0.05527100847180872) | > loss_mel_ce: 3.338667631149292 (3.3426461322702075) | > loss: 0.4238435924053192 (0.42473964302016676) | > current_lr: 5e-06 | > step_time: 0.4924 (0.4642660855103453) | > loader_time: 0.0389 (0.03544519673720244)  --> TIME: 2024-12-22 14:41:17 -- STEP: 1718/2322 -- GLOBAL_STEP: 15650 | > loss_text_ce: 0.05372011661529541 (0.05524105586467163) | > loss_mel_ce: 3.3665313720703125 (3.3420870613579963) | > loss: 0.4275314211845398 (0.4246660151255422) | > current_lr: 5e-06 | > step_time: 0.4215 (0.4643487112902373) | > loader_time: 0.0374 (0.035513057003753914)  --> TIME: 2024-12-22 14:41:53 -- STEP: 1768/2322 -- GLOBAL_STEP: 15700 | > loss_text_ce: 0.05257637798786163 (0.055228023591759) | > loss_mel_ce: 3.3322160243988037 (3.3418467720439518) | > loss: 0.4230990409851074 (0.42463434991591115) | > current_lr: 5e-06 | > step_time: 0.4045 (0.46435350476346937) | > loader_time: 0.038 (0.03555424073163193)  --> TIME: 2024-12-22 14:42:29 -- STEP: 1818/2322 -- GLOBAL_STEP: 15750 | > loss_text_ce: 0.0544012151658535 (0.055193783451031556) | > loss_mel_ce: 3.278142213821411 (3.3411413079703456) | > loss: 0.41656792163848877 (0.42454188688360034) | > current_lr: 5e-06 | > step_time: 0.4883 (0.4645670387479993) | > loader_time: 0.0363 (0.03559299952650744)  --> TIME: 2024-12-22 14:43:04 -- STEP: 1868/2322 -- GLOBAL_STEP: 15800 | > loss_text_ce: 0.05387354642152786 (0.05517118250675963) | > loss_mel_ce: 3.287691116333008 (3.3407686447178255) | > loss: 0.4176955819129944 (0.42449247886524466) | > current_lr: 5e-06 | > step_time: 0.4334 (0.4644252495796317) | > loader_time: 0.0382 (0.03562096495189292)  --> TIME: 2024-12-22 14:43:40 -- STEP: 1918/2322 -- GLOBAL_STEP: 15850 | > loss_text_ce: 0.055955931544303894 (0.05516328381780416) | > loss_mel_ce: 3.2872049808502197 (3.3405133973072902) | > loss: 0.41789510846138 (0.4244595856344613) | > current_lr: 5e-06 | > step_time: 0.4498 (0.46433011694919074) | > loader_time: 0.0348 (0.035633670898373784)  --> TIME: 2024-12-22 14:44:16 -- STEP: 1968/2322 -- GLOBAL_STEP: 15900 | > loss_text_ce: 0.05639415606856346 (0.05513873393268788) | > loss_mel_ce: 3.260554552078247 (3.3393917029223776) | > loss: 0.414618581533432 (0.42431630510685403) | > current_lr: 5e-06 | > step_time: 0.3782 (0.46430064059369924) | > loader_time: 0.037 (0.03567130306387328)  --> TIME: 2024-12-22 14:44:51 -- STEP: 2018/2322 -- GLOBAL_STEP: 15950 | > loss_text_ce: 0.05511810630559921 (0.05512811313129454) | > loss_mel_ce: 3.367969274520874 (3.3390010590595804) | > loss: 0.42788591980934143 (0.4242661470700539) | > current_lr: 5e-06 | > step_time: 0.408 (0.4641834048497074) | > loader_time: 0.0334 (0.035701817870730734)  --> TIME: 2024-12-22 14:45:27 -- STEP: 2068/2322 -- GLOBAL_STEP: 16000 | > loss_text_ce: 0.05634339526295662 (0.05511229686849757) | > loss_mel_ce: 3.3113811016082764 (3.338878821012359) | > loss: 0.4209655523300171 (0.42424889031358104) | > current_lr: 5e-06 | > step_time: 0.4867 (0.4643051330310002) | > loader_time: 0.0412 (0.03575957190367878)  --> TIME: 2024-12-22 14:46:04 -- STEP: 2118/2322 -- GLOBAL_STEP: 16050 | > loss_text_ce: 0.05518234521150589 (0.055103625708221846) | > loss_mel_ce: 3.476349115371704 (3.3383484028554156) | > loss: 0.44144144654273987 (0.42418150415220157) | > current_lr: 5e-06 | > step_time: 0.4891 (0.464661817600189) | > loader_time: 0.0405 (0.035826090037316086)  --> TIME: 2024-12-22 14:46:40 -- STEP: 2168/2322 -- GLOBAL_STEP: 16100 | > loss_text_ce: 0.053121134638786316 (0.055086770120705765) | > loss_mel_ce: 3.3127365112304688 (3.3380200324023344) | > loss: 0.42073220014572144 (0.4241383509002489) | > current_lr: 5e-06 | > step_time: 0.4189 (0.46461977224068446) | > loader_time: 0.0419 (0.03590336123075864)  --> TIME: 2024-12-22 14:47:17 -- STEP: 2218/2322 -- GLOBAL_STEP: 16150 | > loss_text_ce: 0.05607370659708977 (0.055072174107738195) | > loss_mel_ce: 3.3280601501464844 (3.3373492129543427) | > loss: 0.4230167269706726 (0.42405267393030055) | > current_lr: 5e-06 | > step_time: 0.4943 (0.46479181495198696) | > loader_time: 0.0395 (0.03597414418315966)  --> TIME: 2024-12-22 14:47:52 -- STEP: 2268/2322 -- GLOBAL_STEP: 16200 | > loss_text_ce: 0.05421321094036102 (0.055065664730479906) | > loss_mel_ce: 3.2879586219787598 (3.336469327751713) | > loss: 0.41777148842811584 (0.4239418745776752) | > current_lr: 5e-06 | > step_time: 0.4817 (0.4646695185800919) | > loader_time: 0.0405 (0.036036751257679384)  --> TIME: 2024-12-22 14:48:28 -- STEP: 2318/2322 -- GLOBAL_STEP: 16250 | > loss_text_ce: 0.054321516305208206 (0.055043720939968885) | > loss_mel_ce: 3.264679193496704 (3.3359228428115735) | > loss: 0.4148750901222229 (0.423870820953889) | > current_lr: 5e-06 | > step_time: 0.4174 (0.4646969160404156) | > loader_time: 0.0364 (0.03610606878558753)  > EVALUATION  --> EVAL PERFORMANCE | > avg_loader_time: 0.20146811730933917 (+0.004710239593428922) | > avg_loss_text_ce: 0.051986461881585795 (-0.0013455395031758063) | > avg_loss_mel_ce: 3.2522894637753264 (-0.04262559943728972) | > avg_loss: 3.3042759317340273 (-0.043971133954597175) > BEST MODEL : /checkpoints/GPT_XTTS_FT-December-22-2024_11+26AM-0000000/best_model_16254.pth  > EPOCH: 7/10 --> /checkpoints/GPT_XTTS_FT-December-22-2024_11+26AM-0000000  > TRAINING (2024-12-22 14:50:02)   --> TIME: 2024-12-22 14:50:36 -- STEP: 46/2322 -- GLOBAL_STEP: 16300 | > loss_text_ce: 0.05437628924846649 (0.05428630316063114) | > loss_mel_ce: 3.2432727813720703 (3.314544169799141) | > loss: 0.41220614314079285 (0.4211038072472033) | > current_lr: 5e-06 | > step_time: 0.3862 (0.4581815885460895) | > loader_time: 0.029 (0.034103010011755905)  --> TIME: 2024-12-22 14:51:12 -- STEP: 96/2322 -- GLOBAL_STEP: 16350 | > loss_text_ce: 0.054521579295396805 (0.05442339926958084) | > loss_mel_ce: 3.432483673095703 (3.314355497558912) | > loss: 0.43587565422058105 (0.4210973608617981) | > current_lr: 5e-06 | > step_time: 0.4301 (0.4646621122956276) | > loader_time: 0.0321 (0.034071221947670004)  --> TIME: 2024-12-22 14:51:48 -- STEP: 146/2322 -- GLOBAL_STEP: 16400 | > loss_text_ce: 0.05370848998427391 (0.05427203087569916) | > loss_mel_ce: 3.301046848297119 (3.3153004434010755) | > loss: 0.419344425201416 (0.4211965584999894) | > current_lr: 5e-06 | > step_time: 0.4519 (0.46647089801422537) | > loader_time: 0.0294 (0.0340301076026812)  --> TIME: 2024-12-22 14:52:24 -- STEP: 196/2322 -- GLOBAL_STEP: 16450 | > loss_text_ce: 0.05516756325960159 (0.05417296109835104) | > loss_mel_ce: 3.322343111038208 (3.3147804469478372) | > loss: 0.4221888482570648 (0.42111917600339765) | > current_lr: 5e-06 | > step_time: 0.5497 (0.4664691005434309) | > loader_time: 0.033 (0.03381899424961635)  --> TIME: 2024-12-22 14:52:59 -- STEP: 246/2322 -- GLOBAL_STEP: 16500 | > loss_text_ce: 0.05538717657327652 (0.05416343760926549) | > loss_mel_ce: 3.3004744052886963 (3.308896362296934) | > loss: 0.4194827079772949 (0.4203824751018508) | > current_lr: 5e-06 | > step_time: 0.4494 (0.46536812065093497) | > loader_time: 0.0317 (0.03374499227942493)  --> TIME: 2024-12-22 14:53:34 -- STEP: 296/2322 -- GLOBAL_STEP: 16550 | > loss_text_ce: 0.05563812702894211 (0.05426002988541449) | > loss_mel_ce: 3.3157424926757812 (3.3076708212092116) | > loss: 0.4214225709438324 (0.4202413565000972) | > current_lr: 5e-06 | > step_time: 0.3754 (0.4638636724368946) | > loader_time: 0.0312 (0.033706457228273985)  --> TIME: 2024-12-22 14:54:09 -- STEP: 346/2322 -- GLOBAL_STEP: 16600 | > loss_text_ce: 0.05429835245013237 (0.05424172528131161) | > loss_mel_ce: 3.349855661392212 (3.3073640358930376) | > loss: 0.42551925778388977 (0.42020072008488496) | > current_lr: 5e-06 | > step_time: 0.4854 (0.46194572049069266) | > loader_time: 0.0335 (0.03372972824669989)  --> TIME: 2024-12-22 14:54:44 -- STEP: 396/2322 -- GLOBAL_STEP: 16650 | > loss_text_ce: 0.053739070892333984 (0.054216195546993716) | > loss_mel_ce: 3.3109400272369385 (3.306829474189065) | > loss: 0.42058488726615906 (0.420130708828719) | > current_lr: 5e-06 | > step_time: 0.4819 (0.4610475247556513) | > loader_time: 0.0325 (0.03374530450262203)  --> TIME: 2024-12-22 14:55:18 -- STEP: 446/2322 -- GLOBAL_STEP: 16700 | > loss_text_ce: 0.05387955904006958 (0.05417688335438214) | > loss_mel_ce: 3.3876655101776123 (3.307349703771651) | > loss: 0.43019312620162964 (0.4201908233855337) | > current_lr: 5e-06 | > step_time: 0.4895 (0.45871193580028724) | > loader_time: 0.0329 (0.03378362987073544)  --> TIME: 2024-12-22 14:55:54 -- STEP: 496/2322 -- GLOBAL_STEP: 16750 | > loss_text_ce: 0.053089480847120285 (0.05417368046548819) | > loss_mel_ce: 3.2756245136260986 (3.3066412705567574) | > loss: 0.4160892367362976 (0.4201018688899855) | > current_lr: 5e-06 | > step_time: 0.3966 (0.45947413482973654) | > loader_time: 0.0312 (0.03386769467784508)  --> TIME: 2024-12-22 14:56:30 -- STEP: 546/2322 -- GLOBAL_STEP: 16800 | > loss_text_ce: 0.05455425754189491 (0.05415944862196516) | > loss_mel_ce: 3.280803680419922 (3.3072281722184056) | > loss: 0.4169197380542755 (0.4201734525598449) | > current_lr: 5e-06 | > step_time: 0.4826 (0.45982519916562364) | > loader_time: 0.033 (0.03394934720608774)  --> TIME: 2024-12-22 14:57:05 -- STEP: 596/2322 -- GLOBAL_STEP: 16850 | > loss_text_ce: 0.05367245152592659 (0.05413603812656147) | > loss_mel_ce: 3.3214550018310547 (3.3070466174375266) | > loss: 0.4218909442424774 (0.42014783210802426) | > current_lr: 5e-06 | > step_time: 0.4941 (0.4599551726507661) | > loader_time: 0.0337 (0.033970277581438925)  --> TIME: 2024-12-22 14:57:41 -- STEP: 646/2322 -- GLOBAL_STEP: 16900 | > loss_text_ce: 0.054619789123535156 (0.05412066914717849) | > loss_mel_ce: 3.2917680740356445 (3.3066171994519293) | > loss: 0.41829848289489746 (0.4200922338401572) | > current_lr: 5e-06 | > step_time: 0.4135 (0.45990545055814575) | > loader_time: 0.0318 (0.03400819035875541)  --> TIME: 2024-12-22 14:58:16 -- STEP: 696/2322 -- GLOBAL_STEP: 16950 | > loss_text_ce: 0.05205575376749039 (0.05409554007259765) | > loss_mel_ce: 3.3003182411193848 (3.305683519648408) | > loss: 0.4190467596054077 (0.41997238287124156) | > current_lr: 5e-06 | > step_time: 0.4388 (0.4602903100265854) | > loader_time: 0.0354 (0.03405413853711099)  --> TIME: 2024-12-22 14:58:52 -- STEP: 746/2322 -- GLOBAL_STEP: 17000 | > loss_text_ce: 0.05458232760429382 (0.054060640837248146) | > loss_mel_ce: 3.187991142272949 (3.3049628338289634) | > loss: 0.4053216874599457 (0.41987793479144747) | > current_lr: 5e-06 | > step_time: 0.4677 (0.460452669427478) | > loader_time: 0.0322 (0.034082888598096925)  --> TIME: 2024-12-22 14:59:28 -- STEP: 796/2322 -- GLOBAL_STEP: 17050 | > loss_text_ce: 0.05349748581647873 (0.05404117130604222) | > loss_mel_ce: 3.1410939693450928 (3.305154643166603) | > loss: 0.3993239402770996 (0.41989947731920235) | > current_lr: 5e-06 | > step_time: 0.4922 (0.4605379392154253) | > loader_time: 0.0334 (0.03410653013679852)  --> TIME: 2024-12-22 15:00:04 -- STEP: 846/2322 -- GLOBAL_STEP: 17100 | > loss_text_ce: 0.053661100566387177 (0.05402238579383274) | > loss_mel_ce: 3.356447696685791 (3.3042186385914496) | > loss: 0.42626360058784485 (0.41978012853198593) | > current_lr: 5e-06 | > step_time: 0.4903 (0.4612628215875468) | > loader_time: 0.0342 (0.034164631338547906)  --> TIME: 2024-12-22 15:00:40 -- STEP: 896/2322 -- GLOBAL_STEP: 17150 | > loss_text_ce: 0.05573967844247818 (0.05401150681011911) | > loss_mel_ce: 3.3796842098236084 (3.3039979415812653) | > loss: 0.42942798137664795 (0.4197511815332942) | > current_lr: 5e-06 | > step_time: 0.5052 (0.46125408820807934) | > loader_time: 0.0361 (0.03418246230908805)  --> TIME: 2024-12-22 15:01:15 -- STEP: 946/2322 -- GLOBAL_STEP: 17200 | > loss_text_ce: 0.05229974165558815 (0.054008240494522686) | > loss_mel_ce: 3.260026454925537 (3.303220133700783) | > loss: 0.41404077410697937 (0.4196535473961156) | > current_lr: 5e-06 | > step_time: 0.4661 (0.4613066805845587) | > loader_time: 0.0323 (0.03422470349842097)  --> TIME: 2024-12-22 15:01:51 -- STEP: 996/2322 -- GLOBAL_STEP: 17250 | > loss_text_ce: 0.053548362106084824 (0.05399344790068616) | > loss_mel_ce: 3.2483341693878174 (3.302364592331958) | > loss: 0.41273531317710876 (0.419544755634534) | > current_lr: 5e-06 | > step_time: 0.485 (0.4612699155826645) | > loader_time: 0.0338 (0.03425646809689014)  --> TIME: 2024-12-22 15:02:27 -- STEP: 1046/2322 -- GLOBAL_STEP: 17300 | > loss_text_ce: 0.05559787526726723 (0.05396952998626756) | > loss_mel_ce: 3.32124924659729 (3.301456806992481) | > loss: 0.4221058785915375 (0.4194282926690283) | > current_lr: 5e-06 | > step_time: 0.427 (0.46170841940958235) | > loader_time: 0.0332 (0.03431823012021943)  --> TIME: 2024-12-22 15:03:03 -- STEP: 1096/2322 -- GLOBAL_STEP: 17350 | > loss_text_ce: 0.05372606962919235 (0.05396435544044323) | > loss_mel_ce: 3.330223560333252 (3.3017208787211527) | > loss: 0.4229936897754669 (0.4194606548569499) | > current_lr: 5e-06 | > step_time: 0.4094 (0.4620401023948281) | > loader_time: 0.0324 (0.03436248711425893)  --> TIME: 2024-12-22 15:03:38 -- STEP: 1146/2322 -- GLOBAL_STEP: 17400 | > loss_text_ce: 0.053068164736032486 (0.05394019078248771) | > loss_mel_ce: 3.274860382080078 (3.3010678174816075) | > loss: 0.41599106788635254 (0.4193760015941624) | > current_lr: 5e-06 | > step_time: 0.4641 (0.4615632842764598) | > loader_time: 0.0342 (0.03438555840630392)  --> TIME: 2024-12-22 15:04:13 -- STEP: 1196/2322 -- GLOBAL_STEP: 17450 | > loss_text_ce: 0.0551486536860466 (0.05393199055739071) | > loss_mel_ce: 3.289862871170044 (3.3008571039872807) | > loss: 0.4181264340877533 (0.419348637395878) | > current_lr: 5e-06 | > step_time: 0.4943 (0.461581657762113) | > loader_time: 0.0343 (0.034414484748074854)  --> TIME: 2024-12-22 15:04:49 -- STEP: 1246/2322 -- GLOBAL_STEP: 17500 | > loss_text_ce: 0.050612542778253555 (0.053918751303471305) | > loss_mel_ce: 3.2442994117736816 (3.300495969349843) | > loss: 0.4118639826774597 (0.4193018406007686) | > current_lr: 5e-06 | > step_time: 0.4671 (0.4615781565539146) | > loader_time: 0.0328 (0.03444673678274136)  --> TIME: 2024-12-22 15:05:24 -- STEP: 1296/2322 -- GLOBAL_STEP: 17550 | > loss_text_ce: 0.05363862216472626 (0.05390754984519272) | > loss_mel_ce: 3.2696011066436768 (3.300138747618521) | > loss: 0.4154049754142761 (0.41925578764467347) | > current_lr: 5e-06 | > step_time: 0.4177 (0.4614142427841824) | > loader_time: 0.0334 (0.03445713479577758)  --> TIME: 2024-12-22 15:06:00 -- STEP: 1346/2322 -- GLOBAL_STEP: 17600 | > loss_text_ce: 0.053937241435050964 (0.05389394270972989) | > loss_mel_ce: 3.3271994590759277 (3.2999497866382557) | > loss: 0.4226420819759369 (0.41923046667809666) | > current_lr: 5e-06 | > step_time: 0.4633 (0.46139449793374926) | > loader_time: 0.0334 (0.034490684520613706)  --> TIME: 2024-12-22 15:06:35 -- STEP: 1396/2322 -- GLOBAL_STEP: 17650 | > loss_text_ce: 0.055912669748067856 (0.05388225209939275) | > loss_mel_ce: 3.4008049964904785 (3.299613616869578) | > loss: 0.4320897161960602 (0.4191869841434896) | > current_lr: 5e-06 | > step_time: 0.4815 (0.46146292860665106) | > loader_time: 0.033 (0.034515395547052505)  --> TIME: 2024-12-22 15:07:11 -- STEP: 1446/2322 -- GLOBAL_STEP: 17700 | > loss_text_ce: 0.05397505685687065 (0.05386613315051192) | > loss_mel_ce: 3.2954976558685303 (3.2990707239834256) | > loss: 0.41868409514427185 (0.4191171076370309) | > current_lr: 5e-06 | > step_time: 0.4641 (0.4614322272903528) | > loader_time: 0.0334 (0.03453672377400378)  --> TIME: 2024-12-22 15:07:46 -- STEP: 1496/2322 -- GLOBAL_STEP: 17750 | > loss_text_ce: 0.05159766227006912 (0.05385960950292049) | > loss_mel_ce: 3.184189796447754 (3.2983980821096948) | > loss: 0.4044734239578247 (0.4190322119483656) | > current_lr: 5e-06 | > step_time: 0.418 (0.46129499686593056) | > loader_time: 0.0336 (0.0345599836206691)  --> TIME: 2024-12-22 15:08:22 -- STEP: 1546/2322 -- GLOBAL_STEP: 17800 | > loss_text_ce: 0.053559619933366776 (0.05384040372578709) | > loss_mel_ce: 3.2677547931671143 (3.298152096829777) | > loss: 0.4151642918586731 (0.41899906308962503) | > current_lr: 5e-06 | > step_time: 0.4814 (0.4614849052022069) | > loader_time: 0.0339 (0.03459387547294351)  --> TIME: 2024-12-22 15:08:58 -- STEP: 1596/2322 -- GLOBAL_STEP: 17850 | > loss_text_ce: 0.053250983357429504 (0.05383511311269568) | > loss_mel_ce: 3.3599307537078857 (3.297765036274615) | > loss: 0.42664772272109985 (0.4189500191942195) | > current_lr: 5e-06 | > step_time: 0.4954 (0.4616321026531976) | > loader_time: 0.0367 (0.034620776511075216)  --> TIME: 2024-12-22 15:09:34 -- STEP: 1646/2322 -- GLOBAL_STEP: 17900 | > loss_text_ce: 0.05163511633872986 (0.05381520154273742) | > loss_mel_ce: 3.245025396347046 (3.296989234655479) | > loss: 0.4120825529098511 (0.41885055505635543) | > current_lr: 5e-06 | > step_time: 0.4928 (0.46187848700063355) | > loader_time: 0.0347 (0.03465367797513202)  --> TIME: 2024-12-22 15:10:10 -- STEP: 1696/2322 -- GLOBAL_STEP: 17950 | > loss_text_ce: 0.05391615629196167 (0.053809274280145064) | > loss_mel_ce: 3.327894449234009 (3.2966927337758936) | > loss: 0.4227263331413269 (0.4188127515064378) | > current_lr: 5e-06 | > step_time: 0.4379 (0.4617812092292985) | > loader_time: 0.0346 (0.03466712613150759)  --> TIME: 2024-12-22 15:10:45 -- STEP: 1746/2322 -- GLOBAL_STEP: 18000 | > loss_text_ce: 0.054573334753513336 (0.05379809131728483) | > loss_mel_ce: 3.3653812408447266 (3.2963315640391615) | > loss: 0.4274943172931671 (0.4187662074212221) | > current_lr: 5e-06 | > step_time: 0.4366 (0.4618001221791167) | > loader_time: 0.0336 (0.03468133275314978)  --> TIME: 2024-12-22 15:11:21 -- STEP: 1796/2322 -- GLOBAL_STEP: 18050 | > loss_text_ce: 0.053153879940509796 (0.05377642942057354) | > loss_mel_ce: 3.2612149715423584 (3.295645130503681) | > loss: 0.41429612040519714 (0.4186776954771948) | > current_lr: 5e-06 | > step_time: 0.4427 (0.46191300833411114) | > loader_time: 0.0321 (0.03469132182327308)  --> TIME: 2024-12-22 15:11:57 -- STEP: 1846/2322 -- GLOBAL_STEP: 18100 | > loss_text_ce: 0.05299749597907066 (0.053766123599343546) | > loss_mel_ce: 3.2349281311035156 (3.29533982109016) | > loss: 0.41099071502685547 (0.4186382435770749) | > current_lr: 5e-06 | > step_time: 0.4835 (0.46212153083454116) | > loader_time: 0.0345 (0.0347034709037707)  --> TIME: 2024-12-22 15:12:32 -- STEP: 1896/2322 -- GLOBAL_STEP: 18150 | > loss_text_ce: 0.050575923174619675 (0.053761361155045935) | > loss_mel_ce: 3.365447998046875 (3.2949341012455733) | > loss: 0.42700299620628357 (0.4185869332701598) | > current_lr: 5e-06 | > step_time: 0.4167 (0.46200266191225026) | > loader_time: 0.032 (0.03470136306959874)  --> TIME: 2024-12-22 15:13:09 -- STEP: 1946/2322 -- GLOBAL_STEP: 18200 | > loss_text_ce: 0.05489610880613327 (0.05375176575704873) | > loss_mel_ce: 3.364194393157959 (3.2946735591094507) | > loss: 0.4273863136768341 (0.4185531660072116) | > current_lr: 5e-06 | > step_time: 0.4546 (0.46232314296028487) | > loader_time: 0.0334 (0.03472483635928875)  --> TIME: 2024-12-22 15:13:45 -- STEP: 1996/2322 -- GLOBAL_STEP: 18250 | > loss_text_ce: 0.0564076267182827 (0.05373425586690346) | > loss_mel_ce: 3.2129950523376465 (3.293963335439532) | > loss: 0.40867534279823303 (0.4184621992952122) | > current_lr: 5e-06 | > step_time: 0.4638 (0.46245264827846777) | > loader_time: 0.0328 (0.034736535711613406)  --> TIME: 2024-12-22 15:14:20 -- STEP: 2046/2322 -- GLOBAL_STEP: 18300 | > loss_text_ce: 0.0543268658220768 (0.053729150642732836) | > loss_mel_ce: 3.2973108291625977 (3.293601418869935) | > loss: 0.4189547002315521 (0.41841632151067676) | > current_lr: 5e-06 | > step_time: 0.4355 (0.4622848291434385) | > loader_time: 0.0329 (0.03473297335418677)  --> TIME: 2024-12-22 15:14:56 -- STEP: 2096/2322 -- GLOBAL_STEP: 18350 | > loss_text_ce: 0.05272369831800461 (0.05372159972339015) | > loss_mel_ce: 3.2994887828826904 (3.2932170510064545) | > loss: 0.41902655363082886 (0.41836733162004996) | > current_lr: 5e-06 | > step_time: 0.4347 (0.46223953707527576) | > loader_time: 0.0339 (0.034736273625424856)  --> TIME: 2024-12-22 15:15:31 -- STEP: 2146/2322 -- GLOBAL_STEP: 18400 | > loss_text_ce: 0.05090920254588127 (0.053696278913184396) | > loss_mel_ce: 3.313992977142334 (3.2931216305255435) | > loss: 0.42061278223991394 (0.4183522389658345) | > current_lr: 5e-06 | > step_time: 0.4854 (0.46229603861607016) | > loader_time: 0.034 (0.03476145194161199)  --> TIME: 2024-12-22 15:16:07 -- STEP: 2196/2322 -- GLOBAL_STEP: 18450 | > loss_text_ce: 0.05379687249660492 (0.05368080149609969) | > loss_mel_ce: 3.3419570922851562 (3.292526520449389) | > loss: 0.4244692325592041 (0.4182759155341187) | > current_lr: 5e-06 | > step_time: 0.4686 (0.4623498334693561) | > loader_time: 0.034 (0.0347763968730017)  --> TIME: 2024-12-22 15:16:43 -- STEP: 2246/2322 -- GLOBAL_STEP: 18500 | > loss_text_ce: 0.05273546651005745 (0.053664029764139205) | > loss_mel_ce: 3.2486495971679688 (3.2921406483926194) | > loss: 0.41267314553260803 (0.4182255851139688) | > current_lr: 5e-06 | > step_time: 0.4883 (0.4624782713629364) | > loader_time: 0.0344 (0.03479415491448917)  --> TIME: 2024-12-22 15:17:19 -- STEP: 2296/2322 -- GLOBAL_STEP: 18550 | > loss_text_ce: 0.051617641001939774 (0.05364644316670837) | > loss_mel_ce: 3.2899813652038574 (3.2913618561282805) | > loss: 0.4176998734474182 (0.41812603775321006) | > current_lr: 5e-06 | > step_time: 0.4089 (0.46235022135727905) | > loader_time: 0.033 (0.03480167816740304)  > EVALUATION  --> EVAL PERFORMANCE | > avg_loader_time: 0.19802158047454518 (-0.003446536834793984) | > avg_loss_text_ce: 0.050754816450103366 (-0.0012316454314824296) | > avg_loss_mel_ce: 3.2154497281469485 (-0.036839735628377834) | > avg_loss: 3.2662045449921577 (-0.038071386741869606) > BEST MODEL : /checkpoints/GPT_XTTS_FT-December-22-2024_11+26AM-0000000/best_model_18576.pth  > EPOCH: 8/10 --> /checkpoints/GPT_XTTS_FT-December-22-2024_11+26AM-0000000  > TRAINING (2024-12-22 15:19:08)   --> TIME: 2024-12-22 15:19:28 -- STEP: 24/2322 -- GLOBAL_STEP: 18600 | > loss_text_ce: 0.054374728351831436 (0.053325761730472244) | > loss_mel_ce: 3.3761072158813477 (3.282568554083506) | > loss: 0.4288102388381958 (0.4169867883125941) | > current_lr: 5e-06 | > step_time: 0.4425 (0.5011607607205709) | > loader_time: 0.0341 (0.033620695273081466)  --> TIME: 2024-12-22 15:20:04 -- STEP: 74/2322 -- GLOBAL_STEP: 18650 | > loss_text_ce: 0.051130879670381546 (0.05291233367815211) | > loss_mel_ce: 3.264615535736084 (3.27514944205413) | > loss: 0.41446828842163086 (0.41600772094082195) | > current_lr: 5e-06 | > step_time: 0.4532 (0.47779901607616526) | > loader_time: 0.0298 (0.033877308304245415)  --> TIME: 2024-12-22 15:20:39 -- STEP: 124/2322 -- GLOBAL_STEP: 18700 | > loss_text_ce: 0.052621278911828995 (0.05284019839018583) | > loss_mel_ce: 3.2533843517303467 (3.269635519673747) | > loss: 0.41325071454048157 (0.4153094649795563) | > current_lr: 5e-06 | > step_time: 0.4699 (0.4713555593644419) | > loader_time: 0.032 (0.034293351634856195)  --> TIME: 2024-12-22 15:21:15 -- STEP: 174/2322 -- GLOBAL_STEP: 18750 | > loss_text_ce: 0.05238686501979828 (0.05299896233040711) | > loss_mel_ce: 3.2697834968566895 (3.2701455382094986) | > loss: 0.4152712821960449 (0.41539306253537367) | > current_lr: 5e-06 | > step_time: 0.5698 (0.46898603302308883) | > loader_time: 0.0332 (0.034686331091255976)  --> TIME: 2024-12-22 15:21:51 -- STEP: 224/2322 -- GLOBAL_STEP: 18800 | > loss_text_ce: 0.054435014724731445 (0.05304223007988185) | > loss_mel_ce: 3.2722678184509277 (3.267374080206667) | > loss: 0.4158378541469574 (0.4150520387504782) | > current_lr: 5e-06 | > step_time: 0.4206 (0.46952660168920246) | > loader_time: 0.0316 (0.03506377126489364)  --> TIME: 2024-12-22 15:22:26 -- STEP: 274/2322 -- GLOBAL_STEP: 18850 | > loss_text_ce: 0.05170970782637596 (0.05301588658161842) | > loss_mel_ce: 3.339629650115967 (3.2681983935571934) | > loss: 0.42391741275787354 (0.4151517848898895) | > current_lr: 5e-06 | > step_time: 0.4291 (0.4656958936774818) | > loader_time: 0.0297 (0.03519544201175661)  --> TIME: 2024-12-22 15:23:01 -- STEP: 324/2322 -- GLOBAL_STEP: 18900 | > loss_text_ce: 0.053262487053871155 (0.0529908308023472) | > loss_mel_ce: 3.154419183731079 (3.2684642341401844) | > loss: 0.40096020698547363 (0.41518188313937493) | > current_lr: 5e-06 | > step_time: 0.3521 (0.4639458523856269) | > loader_time: 0.0337 (0.03537247283959095)  --> TIME: 2024-12-22 15:23:38 -- STEP: 374/2322 -- GLOBAL_STEP: 18950 | > loss_text_ce: 0.05238860100507736 (0.05294010746367476) | > loss_mel_ce: 3.2834465503692627 (3.2682761075024938) | > loss: 0.4169794023036957 (0.41515202708741566) | > current_lr: 5e-06 | > step_time: 0.4636 (0.4645801591363183) | > loader_time: 0.0328 (0.03560702877248671)  --> TIME: 2024-12-22 15:24:14 -- STEP: 424/2322 -- GLOBAL_STEP: 19000 | > loss_text_ce: 0.05053858458995819 (0.05286751300061369) | > loss_mel_ce: 3.3351690769195557 (3.26834100766002) | > loss: 0.4232134521007538 (0.41515106525061274) | > current_lr: 5e-06 | > step_time: 0.4146 (0.464913768588372) | > loader_time: 0.0332 (0.03577346509357668)  --> TIME: 2024-12-22 15:24:49 -- STEP: 474/2322 -- GLOBAL_STEP: 19050 | > loss_text_ce: 0.05526845157146454 (0.05284355387468882) | > loss_mel_ce: 3.389570474624634 (3.2684084916416603) | > loss: 0.43060487508773804 (0.41515650603338644) | > current_lr: 5e-06 | > step_time: 0.3764 (0.4645470913955431) | > loader_time: 0.0295 (0.03564164608339722)  --> TIME: 2024-12-22 15:25:25 -- STEP: 524/2322 -- GLOBAL_STEP: 19100 | > loss_text_ce: 0.05452447757124901 (0.0528621806599598) | > loss_mel_ce: 3.377793073654175 (3.2691080060623983) | > loss: 0.42903968691825867 (0.41524627372508743) | > current_lr: 5e-06 | > step_time: 0.4531 (0.4640152176827875) | > loader_time: 0.0314 (0.03550379558373955)  --> TIME: 2024-12-22 15:26:01 -- STEP: 574/2322 -- GLOBAL_STEP: 19150 | > loss_text_ce: 0.051459696143865585 (0.0528356641959334) | > loss_mel_ce: 3.2120165824890137 (3.268299615341611) | > loss: 0.4079345464706421 (0.41514191031456016) | > current_lr: 5e-06 | > step_time: 0.4831 (0.4651517506675853) | > loader_time: 0.0329 (0.03547342936751736)  --> TIME: 2024-12-22 15:26:37 -- STEP: 624/2322 -- GLOBAL_STEP: 19200 | > loss_text_ce: 0.05314190313220024 (0.05283089661493133) | > loss_mel_ce: 3.262092113494873 (3.2668667087952286) | > loss: 0.4144042432308197 (0.4149622010687987) | > current_lr: 5e-06 | > step_time: 0.4346 (0.46488684301192945) | > loader_time: 0.0329 (0.03538004557291668)  --> TIME: 2024-12-22 15:27:12 -- STEP: 674/2322 -- GLOBAL_STEP: 19250 | > loss_text_ce: 0.052387651056051254 (0.052817259591835544) | > loss_mel_ce: 3.20135760307312 (3.265488214591843) | > loss: 0.4067181646823883 (0.414788184516154) | > current_lr: 5e-06 | > step_time: 0.481 (0.4646612419926448) | > loader_time: 0.033 (0.035314065766263794)  --> TIME: 2024-12-22 15:27:48 -- STEP: 724/2322 -- GLOBAL_STEP: 19300 | > loss_text_ce: 0.05286349356174469 (0.052821132925580876) | > loss_mel_ce: 3.2065863609313965 (3.2652429520095896) | > loss: 0.4074312448501587 (0.4147580107931274) | > current_lr: 5e-06 | > step_time: 0.4556 (0.46446460617181345) | > loader_time: 0.0317 (0.03523626083827147)  --> TIME: 2024-12-22 15:28:24 -- STEP: 774/2322 -- GLOBAL_STEP: 19350 | > loss_text_ce: 0.05409528315067291 (0.052808700086072434) | > loss_mel_ce: 3.1929495334625244 (3.2652886385141406) | > loss: 0.4058806002140045 (0.4147621675825242) | > current_lr: 5e-06 | > step_time: 0.4907 (0.4645585841294715) | > loader_time: 0.0333 (0.03517901527789206)  --> TIME: 2024-12-22 15:28:59 -- STEP: 824/2322 -- GLOBAL_STEP: 19400 | > loss_text_ce: 0.05045788735151291 (0.05278696578213023) | > loss_mel_ce: 3.1504151821136475 (3.2652815513819156) | > loss: 0.4001091420650482 (0.41475856488624824) | > current_lr: 5e-06 | > step_time: 0.4396 (0.4642927577194658) | > loader_time: 0.0334 (0.03516335221170214)  --> TIME: 2024-12-22 15:29:35 -- STEP: 874/2322 -- GLOBAL_STEP: 19450 | > loss_text_ce: 0.05309520289301872 (0.05277491648184898) | > loss_mel_ce: 3.2626447677612305 (3.26557561734721) | > loss: 0.4144674837589264 (0.41479381704084933) | > current_lr: 5e-06 | > step_time: 0.4499 (0.4641950610573286) | > loader_time: 0.0318 (0.03515603204068106)  --> TIME: 2024-12-22 15:30:10 -- STEP: 924/2322 -- GLOBAL_STEP: 19500 | > loss_text_ce: 0.05311570689082146 (0.05276618880578579) | > loss_mel_ce: 3.229471206665039 (3.2651535042952657) | > loss: 0.4103233516216278 (0.4147399619737745) | > current_lr: 5e-06 | > step_time: 0.4821 (0.46412173339298796) | > loader_time: 0.0336 (0.035156171301226516)  --> TIME: 2024-12-22 15:30:46 -- STEP: 974/2322 -- GLOBAL_STEP: 19550 | > loss_text_ce: 0.05155607685446739 (0.05274719616409689) | > loss_mel_ce: 3.2973833084106445 (3.2649633901564727) | > loss: 0.4186174273490906 (0.4147138235444161) | > current_lr: 5e-06 | > step_time: 0.3794 (0.46443953724612447) | > loader_time: 0.0306 (0.03517114797901561)  --> TIME: 2024-12-22 15:31:23 -- STEP: 1024/2322 -- GLOBAL_STEP: 19600 | > loss_text_ce: 0.051980216056108475 (0.05272491353753139) | > loss_mel_ce: 3.314504623413086 (3.2642065049149087) | > loss: 0.42081061005592346 (0.4146164275298361) | > current_lr: 5e-06 | > step_time: 0.4083 (0.4649511680472642) | > loader_time: 0.0321 (0.035192461451515486)  --> TIME: 2024-12-22 15:31:59 -- STEP: 1074/2322 -- GLOBAL_STEP: 19650 | > loss_text_ce: 0.05267588049173355 (0.052717146510518446) | > loss_mel_ce: 3.287787437438965 (3.2640801812461406) | > loss: 0.4175579249858856 (0.414599666188105) | > current_lr: 5e-06 | > step_time: 0.4571 (0.4648995608146851) | > loader_time: 0.0316 (0.035208870800735724)  --> TIME: 2024-12-22 15:32:34 -- STEP: 1124/2322 -- GLOBAL_STEP: 19700 | > loss_text_ce: 0.05399163439869881 (0.05269777821542636) | > loss_mel_ce: 3.2454562187194824 (3.2632583702162057) | > loss: 0.4124309718608856 (0.4144945187871991) | > current_lr: 5e-06 | > step_time: 0.3575 (0.46476252159614156) | > loader_time: 0.0289 (0.035204343100035264)  --> TIME: 2024-12-22 15:33:10 -- STEP: 1174/2322 -- GLOBAL_STEP: 19750 | > loss_text_ce: 0.05348566919565201 (0.05268890239311037) | > loss_mel_ce: 3.2347359657287598 (3.262632647811654) | > loss: 0.4110276997089386 (0.41441519403579485) | > current_lr: 5e-06 | > step_time: 0.491 (0.46478614368471216) | > loader_time: 0.0337 (0.035240333571750763)  --> TIME: 2024-12-22 15:33:46 -- STEP: 1224/2322 -- GLOBAL_STEP: 19800 | > loss_text_ce: 0.049594830721616745 (0.052693964569567646) | > loss_mel_ce: 3.221466541290283 (3.2622391330260845) | > loss: 0.40888267755508423 (0.4143666374478853) | > current_lr: 5e-06 | > step_time: 0.4195 (0.46467017075594735) | > loader_time: 0.0341 (0.03524786603996172)  --> TIME: 2024-12-22 15:34:22 -- STEP: 1274/2322 -- GLOBAL_STEP: 19850 | > loss_text_ce: 0.052100732922554016 (0.05267707982175109) | > loss_mel_ce: 3.243044376373291 (3.261892285414353) | > loss: 0.4118931293487549 (0.41432117101161775) | > current_lr: 5e-06 | > step_time: 0.4385 (0.46483742835196074) | > loader_time: 0.0332 (0.035283148756581124)  --> TIME: 2024-12-22 15:34:57 -- STEP: 1324/2322 -- GLOBAL_STEP: 19900 | > loss_text_ce: 0.05185244604945183 (0.05266925706345238) | > loss_mel_ce: 3.2763960361480713 (3.2618579947336177) | > loss: 0.4160310626029968 (0.41431590678378527) | > current_lr: 5e-06 | > step_time: 0.3803 (0.4645209809444462) | > loader_time: 0.0306 (0.035280135282937095)  --> TIME: 2024-12-22 15:35:32 -- STEP: 1374/2322 -- GLOBAL_STEP: 19950 | > loss_text_ce: 0.05255991220474243 (0.05266055607899827) | > loss_mel_ce: 3.231215000152588 (3.2609640035393257) | > loss: 0.4104718565940857 (0.41420307026679853) | > current_lr: 5e-06 | > step_time: 0.4816 (0.46404125232363375) | > loader_time: 0.0337 (0.03527400708788519)  --> TIME: 2024-12-22 15:36:07 -- STEP: 1424/2322 -- GLOBAL_STEP: 20000 | > loss_text_ce: 0.053218815475702286 (0.05265565352053956) | > loss_mel_ce: 3.1786015033721924 (3.260575038328597) | > loss: 0.40397754311561584 (0.41415383683496637) | > current_lr: 5e-06 | > step_time: 0.3431 (0.46368515709143004) | > loader_time: 0.0307 (0.035253418630428544) > CHECKPOINT : /checkpoints/GPT_XTTS_FT-December-22-2024_11+26AM-0000000/checkpoint_20000.pth  --> TIME: 2024-12-22 15:36:51 -- STEP: 1474/2322 -- GLOBAL_STEP: 20050 | > loss_text_ce: 0.053171005100011826 (0.052643772207069096) | > loss_mel_ce: 3.240384340286255 (3.2602056010930776) | > loss: 0.41169440746307373 (0.4141061720078156) | > current_lr: 5e-06 | > step_time: 0.4077 (0.4640396441986312) | > loader_time: 0.0307 (0.03526382077500489)  --> TIME: 2024-12-22 15:37:26 -- STEP: 1524/2322 -- GLOBAL_STEP: 20100 | > loss_text_ce: 0.05309147387742996 (0.05263826791245949) | > loss_mel_ce: 3.1767120361328125 (3.2594644755829014) | > loss: 0.40372544527053833 (0.41401284322963916) | > current_lr: 5e-06 | > step_time: 0.4432 (0.46372825548717667) | > loader_time: 0.0316 (0.03523644249583171)  --> TIME: 2024-12-22 15:38:01 -- STEP: 1574/2322 -- GLOBAL_STEP: 20150 | > loss_text_ce: 0.0523064024746418 (0.052619959257325336) | > loss_mel_ce: 3.24433970451355 (3.2590277240418697) | > loss: 0.4120807647705078 (0.4139559607114997) | > current_lr: 5e-06 | > step_time: 0.4666 (0.46344252144669335) | > loader_time: 0.0365 (0.03522083977429052)  --> TIME: 2024-12-22 15:38:37 -- STEP: 1624/2322 -- GLOBAL_STEP: 20200 | > loss_text_ce: 0.05089070275425911 (0.05260553350672125) | > loss_mel_ce: 3.1917083263397217 (3.2588052193225874) | > loss: 0.40532487630844116 (0.4139263444382862) | > current_lr: 5e-06 | > step_time: 0.391 (0.4637413447713617) | > loader_time: 0.0318 (0.03519036631866041)  --> TIME: 2024-12-22 15:39:12 -- STEP: 1674/2322 -- GLOBAL_STEP: 20250 | > loss_text_ce: 0.05384154990315437 (0.05259315544692632) | > loss_mel_ce: 3.322089433670044 (3.2587847768049776) | > loss: 0.42199137806892395 (0.4139222419212083) | > current_lr: 5e-06 | > step_time: 0.5467 (0.4635456809006284) | > loader_time: 0.0342 (0.03518812616523734)  --> TIME: 2024-12-22 15:39:48 -- STEP: 1724/2322 -- GLOBAL_STEP: 20300 | > loss_text_ce: 0.05258473381400108 (0.05258536378997799) | > loss_mel_ce: 3.1110756397247314 (3.2585403717310943) | > loss: 0.39545753598213196 (0.41389071727020277) | > current_lr: 5e-06 | > step_time: 0.4367 (0.4634450519167907) | > loader_time: 0.0314 (0.03518757770343613)  --> TIME: 2024-12-22 15:40:24 -- STEP: 1774/2322 -- GLOBAL_STEP: 20350 | > loss_text_ce: 0.051728542894124985 (0.052572778082770846) | > loss_mel_ce: 3.231196641921997 (3.257968206013201) | > loss: 0.41036564111709595 (0.4138176233214751) | > current_lr: 5e-06 | > step_time: 0.4655 (0.46360600989190137) | > loader_time: 0.0325 (0.03518481104054067)  --> TIME: 2024-12-22 15:41:00 -- STEP: 1824/2322 -- GLOBAL_STEP: 20400 | > loss_text_ce: 0.05046413838863373 (0.052550431099932696) | > loss_mel_ce: 3.1168346405029297 (3.2571864223532487) | > loss: 0.3959123492240906 (0.4137171069486883) | > current_lr: 5e-06 | > step_time: 0.4419 (0.4637268662714122) | > loader_time: 0.043 (0.03520576407512026)  --> TIME: 2024-12-22 15:41:35 -- STEP: 1874/2322 -- GLOBAL_STEP: 20450 | > loss_text_ce: 0.049329642206430435 (0.05253430282182219) | > loss_mel_ce: 3.3122498989105225 (3.257172027672366) | > loss: 0.420197457075119 (0.4137132916054832) | > current_lr: 5e-06 | > step_time: 0.4836 (0.4637051121020648) | > loader_time: 0.0334 (0.03520483955375155)  --> TIME: 2024-12-22 15:42:11 -- STEP: 1924/2322 -- GLOBAL_STEP: 20500 | > loss_text_ce: 0.05364948511123657 (0.0525135750555106) | > loss_mel_ce: 3.278804063796997 (3.257046036065986) | > loss: 0.4165566861629486 (0.41369495170651743) | > current_lr: 5e-06 | > step_time: 0.497 (0.4635246757905845) | > loader_time: 0.0365 (0.03518203749726068)  --> TIME: 2024-12-22 15:42:46 -- STEP: 1974/2322 -- GLOBAL_STEP: 20550 | > loss_text_ce: 0.05100930482149124 (0.05250061963134744) | > loss_mel_ce: 3.274113416671753 (3.256845556856287) | > loss: 0.41564035415649414 (0.4136682723732825) | > current_lr: 5e-06 | > step_time: 0.4646 (0.4633625347201223) | > loader_time: 0.0369 (0.03515632101830013)  --> TIME: 2024-12-22 15:43:22 -- STEP: 2024/2322 -- GLOBAL_STEP: 20600 | > loss_text_ce: 0.05364576727151871 (0.05248870548935746) | > loss_mel_ce: 3.263312816619873 (3.2561424750348777) | > loss: 0.4146198332309723 (0.413578897876584) | > current_lr: 5e-06 | > step_time: 0.3908 (0.4634202447804538) | > loader_time: 0.0313 (0.03514891945326278)  --> TIME: 2024-12-22 15:43:58 -- STEP: 2074/2322 -- GLOBAL_STEP: 20650 | > loss_text_ce: 0.05424322932958603 (0.05248284987070693) | > loss_mel_ce: 3.276017904281616 (3.255605210333687) | > loss: 0.41628265380859375 (0.4135110077799343) | > current_lr: 5e-06 | > step_time: 0.4816 (0.4635627974424666) | > loader_time: 0.0334 (0.03514842138685851)  --> TIME: 2024-12-22 15:44:34 -- STEP: 2124/2322 -- GLOBAL_STEP: 20700 | > loss_text_ce: 0.05166415125131607 (0.052462358199579104) | > loss_mel_ce: 3.228520393371582 (3.2550921827386303) | > loss: 0.4100230634212494 (0.41344431787729263) | > current_lr: 5e-06 | > step_time: 0.4662 (0.4637086086129512) | > loader_time: 0.0347 (0.035161512944208904)  --> TIME: 2024-12-22 15:45:10 -- STEP: 2174/2322 -- GLOBAL_STEP: 20750 | > loss_text_ce: 0.05247848853468895 (0.052451329064155346) | > loss_mel_ce: 3.2059247493743896 (3.2543183199944767) | > loss: 0.4073004126548767 (0.41334620645919196) | > current_lr: 5e-06 | > step_time: 0.487 (0.4636987839253976) | > loader_time: 0.0336 (0.03517096538333136)  --> TIME: 2024-12-22 15:45:45 -- STEP: 2224/2322 -- GLOBAL_STEP: 20800 | > loss_text_ce: 0.05329363793134689 (0.05244615881723894) | > loss_mel_ce: 3.2607266902923584 (3.2536956179056213) | > loss: 0.41425254940986633 (0.41326772239354037) | > current_lr: 5e-06 | > step_time: 0.3758 (0.46374019894668506) | > loader_time: 0.0316 (0.035171625639894864)  --> TIME: 2024-12-22 15:46:21 -- STEP: 2274/2322 -- GLOBAL_STEP: 20850 | > loss_text_ce: 0.05089893564581871 (0.05242364596421507) | > loss_mel_ce: 3.26478910446167 (3.2537916760331385) | > loss: 0.41446101665496826 (0.4132769155523293) | > current_lr: 5e-06 | > step_time: 0.4135 (0.4636362340225916) | > loader_time: 0.0315 (0.035159053462790905)  > EVALUATION  --> EVAL PERFORMANCE | > avg_loader_time: 0.19695501014439742 (-0.0010665703301477591) | > avg_loss_text_ce: 0.04966469824013082 (-0.0010901182099725473) | > avg_loss_mel_ce: 3.184743151520238 (-0.030706576626710724) | > avg_loss: 3.234407837944802 (-0.03179670704735571) > BEST MODEL : /checkpoints/GPT_XTTS_FT-December-22-2024_11+26AM-0000000/best_model_20898.pth  > EPOCH: 9/10 --> /checkpoints/GPT_XTTS_FT-December-22-2024_11+26AM-0000000  > TRAINING (2024-12-22 15:48:25)   --> TIME: 2024-12-22 15:48:28 -- STEP: 2/2322 -- GLOBAL_STEP: 20900 | > loss_text_ce: 0.050804998725652695 (0.05205718241631985) | > loss_mel_ce: 3.2151503562927246 (3.209911584854126) | > loss: 0.40824443101882935 (0.4077461063861847) | > current_lr: 5e-06 | > step_time: 0.4651 (0.4770277738571167) | > loader_time: 0.0421 (0.037558555603027344)  --> TIME: 2024-12-22 15:49:04 -- STEP: 52/2322 -- GLOBAL_STEP: 20950 | > loss_text_ce: 0.05438758432865143 (0.05182147986040665) | > loss_mel_ce: 3.3680460453033447 (3.24841675391564) | > loss: 0.42780420184135437 (0.41252977687578934) | > current_lr: 5e-06 | > step_time: 0.4664 (0.46961698623803944) | > loader_time: 0.0301 (0.03609408323581402)  --> TIME: 2024-12-22 15:49:40 -- STEP: 102/2322 -- GLOBAL_STEP: 21000 | > loss_text_ce: 0.05250132828950882 (0.05184151571901406) | > loss_mel_ce: 3.2500109672546387 (3.243569628865111) | > loss: 0.41281405091285706 (0.41192639195451547) | > current_lr: 5e-06 | > step_time: 0.3567 (0.46761225719077915) | > loader_time: 0.0371 (0.03639314922631955)  --> TIME: 2024-12-22 15:50:16 -- STEP: 152/2322 -- GLOBAL_STEP: 21050 | > loss_text_ce: 0.05217558145523071 (0.051926255765322005) | > loss_mel_ce: 3.2213973999023438 (3.241143447788139) | > loss: 0.4091966152191162 (0.4116337118964446) | > current_lr: 5e-06 | > step_time: 0.4319 (0.4661641669900794) | > loader_time: 0.0306 (0.03644328682046188)  --> TIME: 2024-12-22 15:50:51 -- STEP: 202/2322 -- GLOBAL_STEP: 21100 | > loss_text_ce: 0.0503290556371212 (0.0518929297196688) | > loss_mel_ce: 3.185814380645752 (3.240081106082049) | > loss: 0.40451791882514954 (0.4114967535923023) | > current_lr: 5e-06 | > step_time: 0.4189 (0.4631567756728371) | > loader_time: 0.0415 (0.03646346838167398)  --> TIME: 2024-12-22 15:51:27 -- STEP: 252/2322 -- GLOBAL_STEP: 21150 | > loss_text_ce: 0.053901951760053635 (0.051900155724041046) | > loss_mel_ce: 3.1475605964660645 (3.2367798241357963) | > loss: 0.4001828134059906 (0.41108499680246624) | > current_lr: 5e-06 | > step_time: 0.4821 (0.4634153464483836) | > loader_time: 0.0313 (0.036428570747375495)  --> TIME: 2024-12-22 15:52:03 -- STEP: 302/2322 -- GLOBAL_STEP: 21200 | > loss_text_ce: 0.05245089530944824 (0.05186411644646664) | > loss_mel_ce: 3.3162736892700195 (3.2346565407633014) | > loss: 0.42109057307243347 (0.4108150817503203) | > current_lr: 5e-06 | > step_time: 0.4659 (0.4634370014367513) | > loader_time: 0.0423 (0.036488474599572995)  --> TIME: 2024-12-22 15:52:38 -- STEP: 352/2322 -- GLOBAL_STEP: 21250 | > loss_text_ce: 0.052357371896505356 (0.05179706190458753) | > loss_mel_ce: 3.1986606121063232 (3.234878731722184) | > loss: 0.40637725591659546 (0.410834473896433) | > current_lr: 5e-06 | > step_time: 0.4142 (0.46355329724875355) | > loader_time: 0.0301 (0.036141421307216974)  --> TIME: 2024-12-22 15:53:14 -- STEP: 402/2322 -- GLOBAL_STEP: 21300 | > loss_text_ce: 0.052720073610544205 (0.051809133044374525) | > loss_mel_ce: 3.148677349090576 (3.2333520716102586) | > loss: 0.40017467737197876 (0.4106451503524733) | > current_lr: 5e-06 | > step_time: 0.411 (0.4630982063302946) | > loader_time: 0.0388 (0.035848857751533174)  --> TIME: 2024-12-22 15:53:50 -- STEP: 452/2322 -- GLOBAL_STEP: 21350 | > loss_text_ce: 0.05020890757441521 (0.05175808822093284) | > loss_mel_ce: 3.2516045570373535 (3.2321219238559777) | > loss: 0.41272667050361633 (0.4104850013303546) | > current_lr: 5e-06 | > step_time: 0.413 (0.46378563410412943) | > loader_time: 0.0297 (0.03565858634172288)  --> TIME: 2024-12-22 15:54:25 -- STEP: 502/2322 -- GLOBAL_STEP: 21400 | > loss_text_ce: 0.048738669604063034 (0.05173766330270416) | > loss_mel_ce: 3.2459609508514404 (3.2303399379509874) | > loss: 0.41183745861053467 (0.41025969997582684) | > current_lr: 5e-06 | > step_time: 0.3403 (0.4638124248421049) | > loader_time: 0.0364 (0.03550784663850093)  --> TIME: 2024-12-22 15:55:01 -- STEP: 552/2322 -- GLOBAL_STEP: 21450 | > loss_text_ce: 0.0501297228038311 (0.05169622917943028) | > loss_mel_ce: 3.355116605758667 (3.2292968367320922) | > loss: 0.4256557822227478 (0.41012413303057355) | > current_lr: 5e-06 | > step_time: 0.4332 (0.4639998868755672) | > loader_time: 0.0309 (0.03536168215931326)  --> TIME: 2024-12-22 15:55:37 -- STEP: 602/2322 -- GLOBAL_STEP: 21500 | > loss_text_ce: 0.05023272708058357 (0.051694567671101345) | > loss_mel_ce: 3.2929909229278564 (3.2296624290586706) | > loss: 0.41790294647216797 (0.41016962431197945) | > current_lr: 5e-06 | > step_time: 0.4888 (0.4637131504838253) | > loader_time: 0.043 (0.035235817250223275)  --> TIME: 2024-12-22 15:56:11 -- STEP: 652/2322 -- GLOBAL_STEP: 21550 | > loss_text_ce: 0.054908256977796555 (0.05169687685813824) | > loss_mel_ce: 3.3013925552368164 (3.2288102624606516) | > loss: 0.41953760385513306 (0.4100633920427481) | > current_lr: 5e-06 | > step_time: 0.4434 (0.46290033982575307) | > loader_time: 0.0301 (0.03510021578314849)  --> TIME: 2024-12-22 15:56:47 -- STEP: 702/2322 -- GLOBAL_STEP: 21600 | > loss_text_ce: 0.051257066428661346 (0.05170592764907243) | > loss_mel_ce: 3.1921656131744385 (3.2291683746538964) | > loss: 0.40542784333229065 (0.4101092873560398) | > current_lr: 5e-06 | > step_time: 0.3695 (0.46255751281042723) | > loader_time: 0.0275 (0.034946769051402406)  --> TIME: 2024-12-22 15:57:22 -- STEP: 752/2322 -- GLOBAL_STEP: 21650 | > loss_text_ce: 0.05174877494573593 (0.0516722715618287) | > loss_mel_ce: 3.161973237991333 (3.228298809934171) | > loss: 0.4017152488231659 (0.4099963848736693) | > current_lr: 5e-06 | > step_time: 0.4297 (0.46280632849703446) | > loader_time: 0.0317 (0.034710018875751106)  --> TIME: 2024-12-22 15:57:58 -- STEP: 802/2322 -- GLOBAL_STEP: 21700 | > loss_text_ce: 0.04925311356782913 (0.05165327687345984) | > loss_mel_ce: 3.2220332622528076 (3.228450555753828) | > loss: 0.4089108109474182 (0.4100129787538415) | > current_lr: 5e-06 | > step_time: 0.4816 (0.4625618243752572) | > loader_time: 0.0321 (0.03447684028796723)  --> TIME: 2024-12-22 15:58:33 -- STEP: 852/2322 -- GLOBAL_STEP: 21750 | > loss_text_ce: 0.05066647753119469 (0.05165524785122681) | > loss_mel_ce: 3.250622034072876 (3.228021026776991) | > loss: 0.412661075592041 (0.40995953392954504) | > current_lr: 5e-06 | > step_time: 0.4674 (0.4629072768027794) | > loader_time: 0.0309 (0.034319874546337586)  --> TIME: 2024-12-22 15:59:09 -- STEP: 902/2322 -- GLOBAL_STEP: 21800 | > loss_text_ce: 0.0516439750790596 (0.0516267443682891) | > loss_mel_ce: 3.1423614025115967 (3.227316593912384) | > loss: 0.39925068616867065 (0.4098679168922146) | > current_lr: 5e-06 | > step_time: 0.4535 (0.4626780135139922) | > loader_time: 0.0313 (0.034143725678556)  --> TIME: 2024-12-22 15:59:44 -- STEP: 952/2322 -- GLOBAL_STEP: 21850 | > loss_text_ce: 0.050660390406847 (0.05160890219482679) | > loss_mel_ce: 3.1547160148620605 (3.2271698345156286) | > loss: 0.400672048330307 (0.4098473416970057) | > current_lr: 5e-06 | > step_time: 0.4155 (0.46233639521759096) | > loader_time: 0.031 (0.033995777869424905)  --> TIME: 2024-12-22 16:00:19 -- STEP: 1002/2322 -- GLOBAL_STEP: 21900 | > loss_text_ce: 0.05044860392808914 (0.05158391930237264) | > loss_mel_ce: 3.1442482471466064 (3.2263006609594997) | > loss: 0.39933711290359497 (0.4097355722548244) | > current_lr: 5e-06 | > step_time: 0.4533 (0.462188676445784) | > loader_time: 0.031 (0.033872256022013596)  --> TIME: 2024-12-22 16:00:54 -- STEP: 1052/2322 -- GLOBAL_STEP: 21950 | > loss_text_ce: 0.04962867125868797 (0.05157375249997518) | > loss_mel_ce: 3.207176685333252 (3.2261868608768456) | > loss: 0.4071006774902344 (0.4097200764959303) | > current_lr: 5e-06 | > step_time: 0.4813 (0.4620448545811294) | > loader_time: 0.0318 (0.03375022334291002)  --> TIME: 2024-12-22 16:01:28 -- STEP: 1102/2322 -- GLOBAL_STEP: 22000 | > loss_text_ce: 0.05010264366865158 (0.05157677738668697) | > loss_mel_ce: 3.142890691757202 (3.22566035373674) | > loss: 0.3991241753101349 (0.409654641297465) | > current_lr: 5e-06 | > step_time: 0.3142 (0.46119635745531407) | > loader_time: 0.0362 (0.033638626607489897)  --> TIME: 2024-12-22 16:02:04 -- STEP: 1152/2322 -- GLOBAL_STEP: 22050 | > loss_text_ce: 0.05348723381757736 (0.05155576242315066) | > loss_mel_ce: 3.306159257888794 (3.225333521763485) | > loss: 0.4199558198451996 (0.40961116045299506) | > current_lr: 5e-06 | > step_time: 0.4171 (0.4614995484136872) | > loader_time: 0.0307 (0.03355779540207653)  --> TIME: 2024-12-22 16:02:39 -- STEP: 1202/2322 -- GLOBAL_STEP: 22100 | > loss_text_ce: 0.05035225674510002 (0.05154264907038054) | > loss_mel_ce: 3.2060556411743164 (3.22458414626796) | > loss: 0.4070509970188141 (0.40951584936576757) | > current_lr: 5e-06 | > step_time: 0.4913 (0.4614323603730034) | > loader_time: 0.0391 (0.0334896267749704)  --> TIME: 2024-12-22 16:03:15 -- STEP: 1252/2322 -- GLOBAL_STEP: 22150 | > loss_text_ce: 0.05320418253540993 (0.051533607658915265) | > loss_mel_ce: 3.2276840209960938 (3.224096415713191) | > loss: 0.41011103987693787 (0.4094537528939902) | > current_lr: 5e-06 | > step_time: 0.4237 (0.4614007444427416) | > loader_time: 0.0314 (0.03341484317383447)  --> TIME: 2024-12-22 16:03:50 -- STEP: 1302/2322 -- GLOBAL_STEP: 22200 | > loss_text_ce: 0.04996548220515251 (0.0515293429209386) | > loss_mel_ce: 3.1588103771209717 (3.2234667096452956) | > loss: 0.40109696984291077 (0.4093745064945997) | > current_lr: 5e-06 | > step_time: 0.4189 (0.4614099474729663) | > loader_time: 0.0309 (0.03334715619065245)  --> TIME: 2024-12-22 16:04:25 -- STEP: 1352/2322 -- GLOBAL_STEP: 22250 | > loss_text_ce: 0.05590624734759331 (0.051525068932251485) | > loss_mel_ce: 3.247877359390259 (3.223186976105503) | > loss: 0.41297295689582825 (0.40933900555739033) | > current_lr: 5e-06 | > step_time: 0.4174 (0.46133142586290476) | > loader_time: 0.0312 (0.03328080748665263)  --> TIME: 2024-12-22 16:05:00 -- STEP: 1402/2322 -- GLOBAL_STEP: 22300 | > loss_text_ce: 0.05162215232849121 (0.051523624203259545) | > loss_mel_ce: 3.086456060409546 (3.2228822592491766) | > loss: 0.39225977659225464 (0.4093007353079982) | > current_lr: 5e-06 | > step_time: 0.4648 (0.4610338020596796) | > loader_time: 0.0315 (0.03322072393033715)  --> TIME: 2024-12-22 16:05:36 -- STEP: 1452/2322 -- GLOBAL_STEP: 22350 | > loss_text_ce: 0.05149070546030998 (0.05149266622529544) | > loss_mel_ce: 3.1964621543884277 (3.223051142265645) | > loss: 0.40599411725997925 (0.4093179760023582) | > current_lr: 5e-06 | > step_time: 0.4901 (0.46158157153563056) | > loader_time: 0.0333 (0.033181516920567894)  --> TIME: 2024-12-22 16:06:11 -- STEP: 1502/2322 -- GLOBAL_STEP: 22400 | > loss_text_ce: 0.050555188208818436 (0.0514833875293143) | > loss_mel_ce: 3.2414190769195557 (3.222575640868886) | > loss: 0.4114967882633209 (0.40925737854326455) | > current_lr: 5e-06 | > step_time: 0.453 (0.46137762815752287) | > loader_time: 0.0326 (0.033133727732733334)  --> TIME: 2024-12-22 16:06:47 -- STEP: 1552/2322 -- GLOBAL_STEP: 22450 | > loss_text_ce: 0.052291128784418106 (0.05147584652787403) | > loss_mel_ce: 3.238281011581421 (3.2222602900463277) | > loss: 0.4113215208053589 (0.40921701711708125) | > current_lr: 5e-06 | > step_time: 0.4171 (0.46162457364736137) | > loader_time: 0.0321 (0.033099488960098976)  --> TIME: 2024-12-22 16:07:23 -- STEP: 1602/2322 -- GLOBAL_STEP: 22500 | > loss_text_ce: 0.05027490481734276 (0.05146998103089474) | > loss_mel_ce: 3.2416367530822754 (3.2216448210896025) | > loss: 0.41148895025253296 (0.4091393503729026) | > current_lr: 5e-06 | > step_time: 0.489 (0.46163801962367895) | > loader_time: 0.0333 (0.03306590796409919)  --> TIME: 2024-12-22 16:07:57 -- STEP: 1652/2322 -- GLOBAL_STEP: 22550 | > loss_text_ce: 0.05093976482748985 (0.051456704262202085) | > loss_mel_ce: 3.102099657058716 (3.221266325824774) | > loss: 0.3941299319267273 (0.4090903788877169) | > current_lr: 5e-06 | > step_time: 0.4469 (0.46134896428475364) | > loader_time: 0.0337 (0.03302234916363729)  --> TIME: 2024-12-22 16:08:33 -- STEP: 1702/2322 -- GLOBAL_STEP: 22600 | > loss_text_ce: 0.049553126096725464 (0.0514509296077539) | > loss_mel_ce: 3.235522747039795 (3.221543463921014) | > loss: 0.41063448786735535 (0.40912429934102695) | > current_lr: 5e-06 | > step_time: 0.4966 (0.46147309038809964) | > loader_time: 0.0332 (0.03298243120330201)  --> TIME: 2024-12-22 16:09:08 -- STEP: 1752/2322 -- GLOBAL_STEP: 22650 | > loss_text_ce: 0.05012717470526695 (0.05144026202732299) | > loss_mel_ce: 3.182446241378784 (3.221051409500374) | > loss: 0.4040716886520386 (0.4090614591014984) | > current_lr: 5e-06 | > step_time: 0.3996 (0.46129872469597205) | > loader_time: 0.0316 (0.03294663083607747)  --> TIME: 2024-12-22 16:09:44 -- STEP: 1802/2322 -- GLOBAL_STEP: 22700 | > loss_text_ce: 0.052105821669101715 (0.051431568786005744) | > loss_mel_ce: 3.2272708415985107 (3.220725421106378) | > loss: 0.4099220931529999 (0.4090196239233811) | > current_lr: 5e-06 | > step_time: 0.436 (0.46154381855743437) | > loader_time: 0.0305 (0.032919426472417246)  --> TIME: 2024-12-22 16:10:20 -- STEP: 1852/2322 -- GLOBAL_STEP: 22750 | > loss_text_ce: 0.05172811448574066 (0.05142831830529107) | > loss_mel_ce: 3.216547966003418 (3.220648997803228) | > loss: 0.4085344970226288 (0.4090096646714674) | > current_lr: 5e-06 | > step_time: 0.4518 (0.46196611589283454) | > loader_time: 0.0298 (0.03289777632665942)  --> TIME: 2024-12-22 16:10:56 -- STEP: 1902/2322 -- GLOBAL_STEP: 22800 | > loss_text_ce: 0.0498540960252285 (0.05141257576558243) | > loss_mel_ce: 3.1921615600585938 (3.2201410400378587) | > loss: 0.40525195002555847 (0.4089442021776574) | > current_lr: 5e-06 | > step_time: 0.4526 (0.46212888566226734) | > loader_time: 0.0312 (0.032867485040369786)  --> TIME: 2024-12-22 16:11:32 -- STEP: 1952/2322 -- GLOBAL_STEP: 22850 | > loss_text_ce: 0.04830285906791687 (0.05139890359714629) | > loss_mel_ce: 3.1731345653533936 (3.219894520205552) | > loss: 0.4026796817779541 (0.4089116781766786) | > current_lr: 5e-06 | > step_time: 0.4161 (0.46229390042727103) | > loader_time: 0.0303 (0.032841050111856576)  --> TIME: 2024-12-22 16:12:08 -- STEP: 2002/2322 -- GLOBAL_STEP: 22900 | > loss_text_ce: 0.05001617968082428 (0.0513870341184137) | > loss_mel_ce: 3.178396463394165 (3.219670825428538) | > loss: 0.4035515785217285 (0.4088822326192132) | > current_lr: 5e-06 | > step_time: 0.4874 (0.4624552451647244) | > loader_time: 0.0337 (0.03282292358406055)  --> TIME: 2024-12-22 16:12:44 -- STEP: 2052/2322 -- GLOBAL_STEP: 22950 | > loss_text_ce: 0.05194700136780739 (0.05137734563175234) | > loss_mel_ce: 3.248899459838867 (3.219503664017653) | > loss: 0.41260582208633423 (0.4088601263613961) | > current_lr: 5e-06 | > step_time: 0.4846 (0.46251775728099287) | > loader_time: 0.034 (0.03280579927604329)  --> TIME: 2024-12-22 16:13:18 -- STEP: 2102/2322 -- GLOBAL_STEP: 23000 | > loss_text_ce: 0.05036110803484917 (0.05136287681666249) | > loss_mel_ce: 3.194291830062866 (3.2189151898210775) | > loss: 0.40558162331581116 (0.40878475846618156) | > current_lr: 5e-06 | > step_time: 0.4688 (0.4621276570772919) | > loader_time: 0.0324 (0.03277975054268147)  --> TIME: 2024-12-22 16:13:53 -- STEP: 2152/2322 -- GLOBAL_STEP: 23050 | > loss_text_ce: 0.049294326454401016 (0.05134526879758643) | > loss_mel_ce: 3.2311747074127197 (3.219075834884076) | > loss: 0.4100586175918579 (0.4088026380311822) | > current_lr: 5e-06 | > step_time: 0.4365 (0.46194787118514663) | > loader_time: 0.0345 (0.03275856863167202)  --> TIME: 2024-12-22 16:14:28 -- STEP: 2202/2322 -- GLOBAL_STEP: 23100 | > loss_text_ce: 0.05075183883309364 (0.051332426508660246) | > loss_mel_ce: 3.1858839988708496 (3.2185532866988154) | > loss: 0.4045794904232025 (0.4087357142370035) | > current_lr: 5e-06 | > step_time: 0.4888 (0.46165300985556323) | > loader_time: 0.0345 (0.03273626558354067)  --> TIME: 2024-12-22 16:15:03 -- STEP: 2252/2322 -- GLOBAL_STEP: 23150 | > loss_text_ce: 0.0520978681743145 (0.05131983934350805) | > loss_mel_ce: 3.164848804473877 (3.2178559409153396) | > loss: 0.4021183252334595 (0.4086469726018332) | > current_lr: 5e-06 | > step_time: 0.3962 (0.4615607130379279) | > loader_time: 0.0291 (0.032722497388694004)  --> TIME: 2024-12-22 16:15:39 -- STEP: 2302/2322 -- GLOBAL_STEP: 23200 | > loss_text_ce: 0.050974491983652115 (0.051312916275343665) | > loss_mel_ce: 3.3411266803741455 (3.2175623569977376) | > loss: 0.4240126609802246 (0.4086094092250804) | > current_lr: 5e-06 | > step_time: 0.4914 (0.4617877369026429) | > loader_time: 0.0334 (0.03271669858854606)  > EVALUATION  --> EVAL PERFORMANCE | > avg_loader_time: 0.1959538796935419 (-0.0010011304508555363) | > avg_loss_text_ce: 0.0486608703216218 (-0.0010038279185090176) | > avg_loss_mel_ce: 3.1579192708237 (-0.02682388069653774) | > avg_loss: 3.2065801403739234 (-0.027827697570878662) > BEST MODEL : /checkpoints/GPT_XTTS_FT-December-22-2024_11+26AM-0000000/best_model_23220.pth