{"cells":[{"cell_type":"markdown","metadata":{"id":"-1_HUut4YYm5"},"source":["# This is the official training Illustration of PuzzleTuning\n","* Use google colab pro+ (high RAM+GPU) to run 24 hours\n","* we use the Python3.7 Pytorch 1.9.0+cu111 torchvision 0.10.0+cu111\n","* we use the A100 GPU for the data-flow illustration with Colab\n","\n","The code and Training process along with all record are Open-Source:\n","* PuzzleTuning official github page: https://github.com/sagizty/PuzzleTuning\n","* The dataset CPIA is publicly aviliable at: https://github.com/zhanglab2021/CPIA_Dataset\n"]},{"cell_type":"markdown","metadata":{"id":"dzCoT1IxZ-1B"},"source":["## Check Colab GPU"]},{"cell_type":"code","execution_count":1,"metadata":{"colab":{"base_uri":"https://localhost:8080/"},"executionInfo":{"elapsed":751,"status":"ok","timestamp":1700807513684,"user":{"displayName":"Tianyi Zhang","userId":"06202607434029765461"},"user_tz":-480},"id":"ZnbrNSoSXFm5","outputId":"0aa1b390-69f7-4e80-c03e-e1a12a35d2f2"},"outputs":[{"name":"stdout","output_type":"stream","text":["Fri Nov 24 06:31:52 2023 \n","+-----------------------------------------------------------------------------+\n","| NVIDIA-SMI 525.105.17 Driver Version: 525.105.17 CUDA Version: 12.0 |\n","|-------------------------------+----------------------+----------------------+\n","| GPU Name Persistence-M| Bus-Id Disp.A | Volatile Uncorr. ECC |\n","| Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. |\n","| | | MIG M. |\n","|===============================+======================+======================|\n","| 0 NVIDIA A100-SXM... Off | 00000000:00:04.0 Off | 0 |\n","| N/A 34C P0 55W / 400W | 0MiB / 40960MiB | 0% Default |\n","| | | Disabled |\n","+-------------------------------+----------------------+----------------------+\n"," \n","+-----------------------------------------------------------------------------+\n","| Processes: |\n","| GPU GI CI PID Type Process name GPU Memory |\n","| ID ID Usage |\n","|=============================================================================|\n","| No running processes found |\n","+-----------------------------------------------------------------------------+\n"]}],"source":["# check GPU\n","!nvidia-smi"]},{"cell_type":"code","execution_count":2,"metadata":{"colab":{"base_uri":"https://localhost:8080/"},"executionInfo":{"elapsed":10,"status":"ok","timestamp":1700807513684,"user":{"displayName":"Tianyi Zhang","userId":"06202607434029765461"},"user_tz":-480},"id":"n9GPOn5gcykA","outputId":"45658563-b504-449a-e204-5f2a1f14b959"},"outputs":[{"name":"stdout","output_type":"stream","text":["Fri Nov 24 02:31:52 PM UTC 2023\n"]}],"source":["!date --date='+8 hour' # CST time zone"]},{"cell_type":"markdown","metadata":{"id":"fbnpeHYUgsJz"},"source":["## Mount Google Drive"]},{"cell_type":"markdown","metadata":{"id":"ixynw_V1ZqqI"},"source":["This will save output images to your google drive, you can remove this line and the last part if you don't want the output"]},{"cell_type":"code","execution_count":null,"metadata":{"id":"3obRNrIaffjK"},"outputs":[],"source":["from google.colab import drive\n","drive.mount('/content/drive')"]},{"cell_type":"markdown","metadata":{"id":"BYevYeMFYmlx"},"source":["## Build file-system enviroment"]},{"cell_type":"code","execution_count":null,"metadata":{"id":"ePtQFcQCEPlu"},"outputs":[],"source":["# create file-system enviroment\n","# mount the google drive first\n","# https://drive.google.com/drive/u/1/my-drive\n","\n","# clear colab path\n","!rm -rf /data\n","!rm -rf /home/Pathology_Experiment\n","\n","# create path\n","!mkdir /home/Pathology_Experiment\n","!mkdir /home/Pathology_Experiment/runs\n","!mkdir /home/Pathology_Experiment/code\n","!mkdir /home/Pathology_Experiment/saved_models\n","!mkdir /home/Pathology_Experiment/imaging_results\n","\n","!mkdir /data\n","!mkdir /data/Pathology_Experiment\n","!mkdir /data/Pathology_Experiment/dataset\n","\n","print('Folder Tree Creation completed!')\n","\n","# get latest code from Github pancreatic-cancer-diagnosis-tansformer page\n","!git clone https://github.com/sagizty/PuzzleTuning.git /home/Pathology_Experiment/code\n","print('code transfer from github completed!')\n","\n","# get the CLS dataset by its zip\n","!mv /home/Pathology_Experiment/code/Archive/* /data/Pathology_Experiment/dataset/\n","# unzip\n","!unzip -q /data/Pathology_Experiment/dataset/PuzzleTuning_demoset.zip -d /data/Pathology_Experiment/dataset/\n","!unzip -q /data/Pathology_Experiment/dataset/warwick_CLS.zip -d /data/Pathology_Experiment/dataset/\n","# alter the path\n","!rm -f /data/Pathology_Experiment/dataset/PuzzleTuning_demoset.zip\n","!rm -f /data/Pathology_Experiment/dataset/warwick_CLS.zip\n","print('data transfer completed!')"]},{"cell_type":"markdown","metadata":{"id":"xLxxHGq_wwwL"},"source":["## Arrange the working enviorment"]},{"cell_type":"code","execution_count":null,"metadata":{"colab":{"background_save":true},"id":"K1Yb2b6TGF4r"},"outputs":[{"name":"stdout","output_type":"stream","text":["Requirement already satisfied: tqdm in /usr/local/lib/python3.10/dist-packages (4.66.1)\n","Collecting timm==0.5.4\n"," Downloading timm-0.5.4-py3-none-any.whl (431 kB)\n","\u001b[2K \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m431.5/431.5 kB\u001b[0m \u001b[31m7.2 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n","\u001b[?25hRequirement already satisfied: torch\u003e=1.4 in /usr/local/lib/python3.10/dist-packages (from timm==0.5.4) (2.1.0+cu118)\n","Requirement already satisfied: torchvision in /usr/local/lib/python3.10/dist-packages (from timm==0.5.4) (0.16.0+cu118)\n","Requirement already satisfied: filelock in /usr/local/lib/python3.10/dist-packages (from torch\u003e=1.4-\u003etimm==0.5.4) (3.13.1)\n","Requirement already satisfied: typing-extensions in /usr/local/lib/python3.10/dist-packages (from torch\u003e=1.4-\u003etimm==0.5.4) (4.5.0)\n","Requirement already satisfied: sympy in /usr/local/lib/python3.10/dist-packages (from torch\u003e=1.4-\u003etimm==0.5.4) (1.12)\n","Requirement already satisfied: networkx in /usr/local/lib/python3.10/dist-packages (from torch\u003e=1.4-\u003etimm==0.5.4) (3.2.1)\n","Requirement already satisfied: jinja2 in /usr/local/lib/python3.10/dist-packages (from torch\u003e=1.4-\u003etimm==0.5.4) (3.1.2)\n","Requirement already satisfied: fsspec in /usr/local/lib/python3.10/dist-packages (from torch\u003e=1.4-\u003etimm==0.5.4) (2023.6.0)\n","Requirement already satisfied: triton==2.1.0 in /usr/local/lib/python3.10/dist-packages (from torch\u003e=1.4-\u003etimm==0.5.4) (2.1.0)\n","Requirement already satisfied: numpy in /usr/local/lib/python3.10/dist-packages (from torchvision-\u003etimm==0.5.4) (1.23.5)\n","Requirement already satisfied: requests in /usr/local/lib/python3.10/dist-packages (from torchvision-\u003etimm==0.5.4) (2.31.0)\n","Requirement already satisfied: pillow!=8.3.*,\u003e=5.3.0 in /usr/local/lib/python3.10/dist-packages (from torchvision-\u003etimm==0.5.4) (9.4.0)\n","Requirement already satisfied: MarkupSafe\u003e=2.0 in /usr/local/lib/python3.10/dist-packages (from jinja2-\u003etorch\u003e=1.4-\u003etimm==0.5.4) (2.1.3)\n","Requirement already satisfied: charset-normalizer\u003c4,\u003e=2 in /usr/local/lib/python3.10/dist-packages (from requests-\u003etorchvision-\u003etimm==0.5.4) (3.3.2)\n","Requirement already satisfied: idna\u003c4,\u003e=2.5 in /usr/local/lib/python3.10/dist-packages (from requests-\u003etorchvision-\u003etimm==0.5.4) (3.4)\n","Requirement already satisfied: urllib3\u003c3,\u003e=1.21.1 in /usr/local/lib/python3.10/dist-packages (from requests-\u003etorchvision-\u003etimm==0.5.4) (2.0.7)\n","Requirement already satisfied: certifi\u003e=2017.4.17 in /usr/local/lib/python3.10/dist-packages (from requests-\u003etorchvision-\u003etimm==0.5.4) (2023.7.22)\n","Requirement already satisfied: mpmath\u003e=0.19 in /usr/local/lib/python3.10/dist-packages (from sympy-\u003etorch\u003e=1.4-\u003etimm==0.5.4) (1.3.0)\n","Installing collected packages: timm\n","Successfully installed timm-0.5.4\n","Collecting einops\n"," Downloading einops-0.7.0-py3-none-any.whl (44 kB)\n","\u001b[2K \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m44.6/44.6 kB\u001b[0m \u001b[31m1.5 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n","\u001b[?25hInstalling collected packages: einops\n","Successfully installed einops-0.7.0\n","Collecting ml_collections\n"," Downloading ml_collections-0.1.1.tar.gz (77 kB)\n","\u001b[2K \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m77.9/77.9 kB\u001b[0m \u001b[31m2.2 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n","\u001b[?25h Preparing metadata (setup.py) ... \u001b[?25l\u001b[?25hdone\n","Requirement already satisfied: absl-py in /usr/local/lib/python3.10/dist-packages (from ml_collections) (1.4.0)\n","Requirement already satisfied: PyYAML in /usr/local/lib/python3.10/dist-packages (from ml_collections) (6.0.1)\n","Requirement already satisfied: six in /usr/local/lib/python3.10/dist-packages (from ml_collections) (1.16.0)\n","Requirement already satisfied: contextlib2 in /usr/local/lib/python3.10/dist-packages (from ml_collections) (21.6.0)\n","Building wheels for collected packages: ml_collections\n"," Building wheel for ml_collections (setup.py) ... \u001b[?25l\u001b[?25hdone\n"," Created wheel for ml_collections: filename=ml_collections-0.1.1-py3-none-any.whl size=94507 sha256=b01d6551e051eb94b398f73bab7144889d7ee2a44f392da831939d3029f7119a\n"," Stored in directory: /root/.cache/pip/wheels/7b/89/c9/a9b87790789e94aadcfc393c283e3ecd5ab916aed0a31be8fe\n","Successfully built ml_collections\n","Installing collected packages: ml_collections\n","Successfully installed ml_collections-0.1.1\n","Collecting ttach\n"," Downloading ttach-0.0.3-py3-none-any.whl (9.8 kB)\n","Installing collected packages: ttach\n","Successfully installed ttach-0.0.3\n","Collecting notifyemail\n"," Downloading notifyemail-1.1.1-py3-none-any.whl (19 kB)\n","Installing collected packages: notifyemail\n","Successfully installed notifyemail-1.1.1\n","Requirement already satisfied: psutil in /usr/local/lib/python3.10/dist-packages (5.9.5)\n","Requirement already satisfied: scipy in /usr/local/lib/python3.10/dist-packages (1.11.3)\n","Requirement already satisfied: numpy\u003c1.28.0,\u003e=1.21.6 in /usr/local/lib/python3.10/dist-packages (from scipy) (1.23.5)\n","Requirement already satisfied: torchsummary in /usr/local/lib/python3.10/dist-packages (1.5.1)\n","Collecting tensorboardX\n"," Downloading tensorboardX-2.6.2.2-py2.py3-none-any.whl (101 kB)\n","\u001b[2K \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m101.7/101.7 kB\u001b[0m \u001b[31m2.6 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n","\u001b[?25hRequirement already satisfied: numpy in /usr/local/lib/python3.10/dist-packages (from tensorboardX) (1.23.5)\n","Requirement already satisfied: packaging in /usr/local/lib/python3.10/dist-packages (from tensorboardX) (23.2)\n","Requirement already satisfied: protobuf\u003e=3.20 in /usr/local/lib/python3.10/dist-packages (from tensorboardX) (3.20.3)\n","Installing collected packages: tensorboardX\n","Successfully installed tensorboardX-2.6.2.2\n","Requirement already satisfied: opencv_contrib_python in /usr/local/lib/python3.10/dist-packages (4.8.0.76)\n","Requirement already satisfied: numpy\u003e=1.21.2 in /usr/local/lib/python3.10/dist-packages (from opencv_contrib_python) (1.23.5)\n","Requirement already satisfied: matplotlib in /usr/local/lib/python3.10/dist-packages (3.7.1)\n","Requirement already satisfied: contourpy\u003e=1.0.1 in /usr/local/lib/python3.10/dist-packages (from matplotlib) (1.2.0)\n","Requirement already satisfied: cycler\u003e=0.10 in /usr/local/lib/python3.10/dist-packages (from matplotlib) (0.12.1)\n","Requirement already satisfied: fonttools\u003e=4.22.0 in /usr/local/lib/python3.10/dist-packages (from matplotlib) (4.44.3)\n","Requirement already satisfied: kiwisolver\u003e=1.0.1 in /usr/local/lib/python3.10/dist-packages (from matplotlib) (1.4.5)\n","Requirement already satisfied: numpy\u003e=1.20 in /usr/local/lib/python3.10/dist-packages (from matplotlib) (1.23.5)\n","Requirement already satisfied: packaging\u003e=20.0 in /usr/local/lib/python3.10/dist-packages (from matplotlib) (23.2)\n","Requirement already satisfied: pillow\u003e=6.2.0 in /usr/local/lib/python3.10/dist-packages (from matplotlib) (9.4.0)\n","Requirement already satisfied: pyparsing\u003e=2.3.1 in /usr/local/lib/python3.10/dist-packages (from matplotlib) (3.1.1)\n","Requirement already satisfied: python-dateutil\u003e=2.7 in /usr/local/lib/python3.10/dist-packages (from matplotlib) (2.8.2)\n","Requirement already satisfied: six\u003e=1.5 in /usr/local/lib/python3.10/dist-packages (from python-dateutil\u003e=2.7-\u003ematplotlib) (1.16.0)\n","Requirement already satisfied: ipykernel in /usr/local/lib/python3.10/dist-packages (5.5.6)\n","Requirement already satisfied: ipython-genutils in /usr/local/lib/python3.10/dist-packages (from ipykernel) (0.2.0)\n","Requirement already satisfied: ipython\u003e=5.0.0 in /usr/local/lib/python3.10/dist-packages (from ipykernel) (7.34.0)\n","Requirement already satisfied: traitlets\u003e=4.1.0 in /usr/local/lib/python3.10/dist-packages (from ipykernel) (5.7.1)\n","Requirement already satisfied: jupyter-client in /usr/local/lib/python3.10/dist-packages (from ipykernel) (6.1.12)\n","Requirement already satisfied: tornado\u003e=4.2 in /usr/local/lib/python3.10/dist-packages (from ipykernel) (6.3.2)\n","Requirement already satisfied: setuptools\u003e=18.5 in /usr/local/lib/python3.10/dist-packages (from ipython\u003e=5.0.0-\u003eipykernel) (67.7.2)\n","Collecting jedi\u003e=0.16 (from ipython\u003e=5.0.0-\u003eipykernel)\n"," Downloading jedi-0.19.1-py2.py3-none-any.whl (1.6 MB)\n","\u001b[2K \u001b[90m━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━\u001b[0m \u001b[32m1.6/1.6 MB\u001b[0m \u001b[31m24.2 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m\n","\u001b[?25hRequirement already satisfied: decorator in /usr/local/lib/python3.10/dist-packages (from ipython\u003e=5.0.0-\u003eipykernel) (4.4.2)\n","Requirement already satisfied: pickleshare in /usr/local/lib/python3.10/dist-packages (from ipython\u003e=5.0.0-\u003eipykernel) (0.7.5)\n","Requirement already satisfied: prompt-toolkit!=3.0.0,!=3.0.1,\u003c3.1.0,\u003e=2.0.0 in /usr/local/lib/python3.10/dist-packages (from ipython\u003e=5.0.0-\u003eipykernel) (3.0.41)\n","Requirement already satisfied: pygments in /usr/local/lib/python3.10/dist-packages (from ipython\u003e=5.0.0-\u003eipykernel) (2.16.1)\n","Requirement already satisfied: backcall in /usr/local/lib/python3.10/dist-packages (from ipython\u003e=5.0.0-\u003eipykernel) (0.2.0)\n","Requirement already satisfied: matplotlib-inline in /usr/local/lib/python3.10/dist-packages (from ipython\u003e=5.0.0-\u003eipykernel) (0.1.6)\n","Requirement already satisfied: pexpect\u003e4.3 in /usr/local/lib/python3.10/dist-packages (from ipython\u003e=5.0.0-\u003eipykernel) (4.8.0)\n","Requirement already satisfied: jupyter-core\u003e=4.6.0 in /usr/local/lib/python3.10/dist-packages (from jupyter-client-\u003eipykernel) (5.5.0)\n","Requirement already satisfied: pyzmq\u003e=13 in /usr/local/lib/python3.10/dist-packages (from jupyter-client-\u003eipykernel) (23.2.1)\n","Requirement already satisfied: python-dateutil\u003e=2.1 in /usr/local/lib/python3.10/dist-packages (from jupyter-client-\u003eipykernel) (2.8.2)\n","Requirement already satisfied: parso\u003c0.9.0,\u003e=0.8.3 in /usr/local/lib/python3.10/dist-packages (from jedi\u003e=0.16-\u003eipython\u003e=5.0.0-\u003eipykernel) (0.8.3)\n","Requirement already satisfied: platformdirs\u003e=2.5 in /usr/local/lib/python3.10/dist-packages (from jupyter-core\u003e=4.6.0-\u003ejupyter-client-\u003eipykernel) (4.0.0)\n","Requirement already satisfied: ptyprocess\u003e=0.5 in /usr/local/lib/python3.10/dist-packages (from pexpect\u003e4.3-\u003eipython\u003e=5.0.0-\u003eipykernel) (0.7.0)\n","Requirement already satisfied: wcwidth in /usr/local/lib/python3.10/dist-packages (from prompt-toolkit!=3.0.0,!=3.0.1,\u003c3.1.0,\u003e=2.0.0-\u003eipython\u003e=5.0.0-\u003eipykernel) (0.2.10)\n","Requirement already satisfied: six\u003e=1.5 in /usr/local/lib/python3.10/dist-packages (from python-dateutil\u003e=2.1-\u003ejupyter-client-\u003eipykernel) (1.16.0)\n","Installing collected packages: jedi\n","Successfully installed jedi-0.19.1\n"]}],"source":["# get packages\n","!pip install tqdm\n","!pip install timm==0.5.4\n","!pip install einops\n","!pip install ml_collections\n","!pip install ttach\n","!pip install notifyemail\n","!pip install psutil\n","!pip install scipy\n","!pip install torchsummary\n","!pip install tensorboardX\n","!pip install opencv_contrib_python\n","!pip install matplotlib\n","!pip install ipykernel"]},{"cell_type":"code","execution_count":null,"metadata":{"colab":{"background_save":true},"id":"87Owjg_pN2yD"},"outputs":[{"name":"stdout","output_type":"stream","text":["Python 3.10.12\n"]}],"source":["!python --version"]},{"cell_type":"code","execution_count":null,"metadata":{"colab":{"background_save":true},"id":"GpEVUWwqK79D"},"outputs":[{"name":"stdout","output_type":"stream","text":["Package Version\n","-------------------------------- ---------------------\n","absl-py 1.4.0\n","aiohttp 3.8.6\n","aiosignal 1.3.1\n","alabaster 0.7.13\n","albumentations 1.3.1\n","altair 4.2.2\n","anyio 3.7.1\n","appdirs 1.4.4\n","argon2-cffi 23.1.0\n","argon2-cffi-bindings 21.2.0\n","array-record 0.5.0\n","arviz 0.15.1\n","astropy 5.3.4\n","astunparse 1.6.3\n","async-timeout 4.0.3\n","atpublic 4.0\n","attrs 23.1.0\n","audioread 3.0.1\n","autograd 1.6.2\n","Babel 2.13.1\n","backcall 0.2.0\n","beautifulsoup4 4.11.2\n","bidict 0.22.1\n","bigframes 0.13.0\n","bleach 6.1.0\n","blinker 1.4\n","blis 0.7.11\n","blosc2 2.0.0\n","bokeh 3.3.1\n","bqplot 0.12.42\n","branca 0.7.0\n","build 1.0.3\n","CacheControl 0.13.1\n","cachetools 5.3.2\n","catalogue 2.0.10\n","certifi 2023.7.22\n","cffi 1.16.0\n","chardet 5.2.0\n","charset-normalizer 3.3.2\n","chex 0.1.7\n","click 8.1.7\n","click-plugins 1.1.1\n","cligj 0.7.2\n","cloudpickle 2.2.1\n","cmake 3.27.7\n","cmdstanpy 1.2.0\n","colorcet 3.0.1\n","colorlover 0.3.0\n","colour 0.1.5\n","community 1.0.0b1\n","confection 0.1.3\n","cons 0.4.6\n","contextlib2 21.6.0\n","contourpy 1.2.0\n","cryptography 41.0.5\n","cufflinks 0.17.3\n","cupy-cuda11x 11.0.0\n","cvxopt 1.3.2\n","cvxpy 1.3.2\n","cycler 0.12.1\n","cymem 2.0.8\n","Cython 3.0.5\n","dask 2023.8.1\n","datascience 0.17.6\n","db-dtypes 1.1.1\n","dbus-python 1.2.18\n","debugpy 1.6.6\n","decorator 4.4.2\n","defusedxml 0.7.1\n","diskcache 5.6.3\n","distributed 2023.8.1\n","distro 1.7.0\n","dlib 19.24.2\n","dm-tree 0.1.8\n","docutils 0.18.1\n","dopamine-rl 4.0.6\n","duckdb 0.9.2\n","earthengine-api 0.1.379\n","easydict 1.11\n","ecos 2.0.12\n","editdistance 0.6.2\n","eerepr 0.0.4\n","einops 0.7.0\n","en-core-web-sm 3.6.0\n","entrypoints 0.4\n","et-xmlfile 1.1.0\n","etils 1.5.2\n","etuples 0.3.9\n","exceptiongroup 1.1.3\n","fastai 2.7.13\n","fastcore 1.5.29\n","fastdownload 0.0.7\n","fastjsonschema 2.19.0\n","fastprogress 1.0.3\n","fastrlock 0.8.2\n","filelock 3.13.1\n","fiona 1.9.5\n","firebase-admin 5.3.0\n","Flask 2.2.5\n","flatbuffers 23.5.26\n","flax 0.7.5\n","folium 0.14.0\n","fonttools 4.44.3\n","frozendict 2.3.8\n","frozenlist 1.4.0\n","fsspec 2023.6.0\n","future 0.18.3\n","gast 0.5.4\n","gcsfs 2023.6.0\n","GDAL 3.4.3\n","gdown 4.6.6\n","geemap 0.28.2\n","gensim 4.3.2\n","geocoder 1.38.1\n","geographiclib 2.0\n","geopandas 0.13.2\n","geopy 2.3.0\n","gin-config 0.5.0\n","glob2 0.7\n","google 2.0.3\n","google-ai-generativelanguage 0.3.3\n","google-api-core 2.11.1\n","google-api-python-client 2.84.0\n","google-auth 2.17.3\n","google-auth-httplib2 0.1.1\n","google-auth-oauthlib 1.0.0\n","google-cloud-bigquery 3.12.0\n","google-cloud-bigquery-connection 1.12.1\n","google-cloud-bigquery-storage 2.22.0\n","google-cloud-core 2.3.3\n","google-cloud-datastore 2.15.2\n","google-cloud-firestore 2.11.1\n","google-cloud-functions 1.13.3\n","google-cloud-iam 2.12.2\n","google-cloud-language 2.9.1\n","google-cloud-resource-manager 1.10.4\n","google-cloud-storage 2.8.0\n","google-cloud-translate 3.11.3\n","google-colab 1.0.0\n","google-crc32c 1.5.0\n","google-generativeai 0.2.2\n","google-pasta 0.2.0\n","google-resumable-media 2.6.0\n","googleapis-common-protos 1.61.0\n","googledrivedownloader 0.4\n","graphviz 0.20.1\n","greenlet 3.0.1\n","grpc-google-iam-v1 0.12.7\n","grpcio 1.59.2\n","grpcio-status 1.48.2\n","gspread 3.4.2\n","gspread-dataframe 3.3.1\n","gym 0.25.2\n","gym-notices 0.0.8\n","h5netcdf 1.3.0\n","h5py 3.9.0\n","holidays 0.36\n","holoviews 1.17.1\n","html5lib 1.1\n","httpimport 1.3.1\n","httplib2 0.22.0\n","huggingface-hub 0.19.4\n","humanize 4.7.0\n","hyperopt 0.2.7\n","ibis-framework 6.2.0\n","idna 3.4\n","imageio 2.31.6\n","imageio-ffmpeg 0.4.9\n","imagesize 1.4.1\n","imbalanced-learn 0.10.1\n","imgaug 0.4.0\n","importlib-metadata 6.8.0\n","importlib-resources 6.1.1\n","imutils 0.5.4\n","inflect 7.0.0\n","iniconfig 2.0.0\n","install 1.3.5\n","intel-openmp 2023.2.0\n","ipyevents 2.0.2\n","ipyfilechooser 0.6.0\n","ipykernel 5.5.6\n","ipyleaflet 0.17.4\n","ipython 7.34.0\n","ipython-genutils 0.2.0\n","ipython-sql 0.5.0\n","ipytree 0.2.2\n","ipywidgets 7.7.1\n","itsdangerous 2.1.2\n","jax 0.4.20\n","jaxlib 0.4.20+cuda11.cudnn86\n","jedi 0.19.1\n","jeepney 0.7.1\n","jieba 0.42.1\n","Jinja2 3.1.2\n","joblib 1.3.2\n","jsonpickle 3.0.2\n","jsonschema 4.19.2\n","jsonschema-specifications 2023.11.1\n","jupyter-client 6.1.12\n","jupyter-console 6.1.0\n","jupyter_core 5.5.0\n","jupyter-server 1.24.0\n","jupyterlab-pygments 0.2.2\n","jupyterlab-widgets 3.0.9\n","kaggle 1.5.16\n","keras 2.14.0\n","keyring 23.5.0\n","kiwisolver 1.4.5\n","langcodes 3.3.0\n","launchpadlib 1.10.16\n","lazr.restfulclient 0.14.4\n","lazr.uri 1.0.6\n","lazy_loader 0.3\n","libclang 16.0.6\n","librosa 0.10.1\n","lida 0.0.10\n","lightgbm 4.1.0\n","linkify-it-py 2.0.2\n","llmx 0.0.15a0\n","llvmlite 0.41.1\n","locket 1.0.0\n","logical-unification 0.4.6\n","lxml 4.9.3\n","malloy 2023.1064\n","Markdown 3.5.1\n","markdown-it-py 3.0.0\n","MarkupSafe 2.1.3\n","matplotlib 3.7.1\n","matplotlib-inline 0.1.6\n","matplotlib-venn 0.11.9\n","mdit-py-plugins 0.4.0\n","mdurl 0.1.2\n","miniKanren 1.0.3\n","missingno 0.5.2\n","mistune 0.8.4\n","mizani 0.9.3\n","mkl 2023.2.0\n","ml-collections 0.1.1\n","ml-dtypes 0.2.0\n","mlxtend 0.22.0\n","more-itertools 10.1.0\n","moviepy 1.0.3\n","mpmath 1.3.0\n","msgpack 1.0.7\n","multidict 6.0.4\n","multipledispatch 1.0.0\n","multitasking 0.0.11\n","murmurhash 1.0.10\n","music21 9.1.0\n","natsort 8.4.0\n","nbclassic 1.0.0\n","nbclient 0.9.0\n","nbconvert 6.5.4\n","nbformat 5.9.2\n","nest-asyncio 1.5.8\n","networkx 3.2.1\n","nibabel 4.0.2\n","nltk 3.8.1\n","notebook 6.5.5\n","notebook_shim 0.2.3\n","notifyemail 1.1.1\n","numba 0.58.1\n","numexpr 2.8.7\n","numpy 1.23.5\n","oauth2client 4.1.3\n","oauthlib 3.2.2\n","opencv-contrib-python 4.8.0.76\n","opencv-python 4.8.0.76\n","opencv-python-headless 4.8.1.78\n","openpyxl 3.1.2\n","opt-einsum 3.3.0\n","optax 0.1.7\n","orbax-checkpoint 0.4.2\n","osqp 0.6.2.post8\n","packaging 23.2\n","pandas 1.5.3\n","pandas-datareader 0.10.0\n","pandas-gbq 0.17.9\n","pandas-stubs 1.5.3.230304\n","pandocfilters 1.5.0\n","panel 1.3.1\n","param 2.0.1\n","parso 0.8.3\n","parsy 2.1\n","partd 1.4.1\n","pathlib 1.0.1\n","pathy 0.10.3\n","patsy 0.5.3\n","peewee 3.17.0\n","pexpect 4.8.0\n","pickleshare 0.7.5\n","Pillow 9.4.0\n","pip 23.1.2\n","pip-tools 6.13.0\n","platformdirs 4.0.0\n","plotly 5.15.0\n","plotnine 0.12.4\n","pluggy 1.3.0\n","polars 0.17.3\n","pooch 1.8.0\n","portpicker 1.5.2\n","prefetch-generator 1.0.3\n","preshed 3.0.9\n","prettytable 3.9.0\n","proglog 0.1.10\n","progressbar2 4.2.0\n","prometheus-client 0.18.0\n","promise 2.3\n","prompt-toolkit 3.0.41\n","prophet 1.1.5\n","proto-plus 1.22.3\n","protobuf 3.20.3\n","psutil 5.9.5\n","psycopg2 2.9.9\n","ptyprocess 0.7.0\n","py-cpuinfo 9.0.0\n","py4j 0.10.9.7\n","pyarrow 9.0.0\n","pyasn1 0.5.0\n","pyasn1-modules 0.3.0\n","pycocotools 2.0.7\n","pycparser 2.21\n","pyct 0.5.0\n","pydantic 1.10.13\n","pydata-google-auth 1.8.2\n","pydot 1.4.2\n","pydot-ng 2.0.0\n","pydotplus 2.0.2\n","PyDrive 1.3.1\n","PyDrive2 1.6.3\n","pyerfa 2.0.1.1\n","pygame 2.5.2\n","Pygments 2.16.1\n","PyGObject 3.42.1\n","PyJWT 2.3.0\n","pymc 5.7.2\n","pymystem3 0.2.0\n","PyOpenGL 3.1.7\n","pyOpenSSL 23.3.0\n","pyparsing 3.1.1\n","pyperclip 1.8.2\n","pyproj 3.6.1\n","pyproject_hooks 1.0.0\n","pyshp 2.3.1\n","PySocks 1.7.1\n","pytensor 2.14.2\n","pytest 7.4.3\n","python-apt 0.0.0\n","python-box 7.1.1\n","python-dateutil 2.8.2\n","python-louvain 0.16\n","python-slugify 8.0.1\n","python-utils 3.8.1\n","pytz 2023.3.post1\n","pyviz_comms 3.0.0\n","PyWavelets 1.4.1\n","PyYAML 6.0.1\n","pyzmq 23.2.1\n","qdldl 0.1.7.post0\n","qudida 0.0.4\n","ratelim 0.1.6\n","referencing 0.31.0\n","regex 2023.6.3\n","requests 2.31.0\n","requests-oauthlib 1.3.1\n","requirements-parser 0.5.0\n","rich 13.7.0\n","rpds-py 0.13.0\n","rpy2 3.4.2\n","rsa 4.9\n","safetensors 0.4.0\n","scikit-image 0.19.3\n","scikit-learn 1.2.2\n","scipy 1.11.3\n","scooby 0.9.2\n","scs 3.2.4\n","seaborn 0.12.2\n","SecretStorage 3.3.1\n","Send2Trash 1.8.2\n","setuptools 67.7.2\n","shapely 2.0.2\n","six 1.16.0\n","sklearn-pandas 2.2.0\n","smart-open 6.4.0\n","sniffio 1.3.0\n","snowballstemmer 2.2.0\n","sortedcontainers 2.4.0\n","soundfile 0.12.1\n","soupsieve 2.5\n","soxr 0.3.7\n","spacy 3.6.1\n","spacy-legacy 3.0.12\n","spacy-loggers 1.0.5\n","Sphinx 5.0.2\n","sphinxcontrib-applehelp 1.0.7\n","sphinxcontrib-devhelp 1.0.5\n","sphinxcontrib-htmlhelp 2.0.4\n","sphinxcontrib-jsmath 1.0.1\n","sphinxcontrib-qthelp 1.0.6\n","sphinxcontrib-serializinghtml 1.1.9\n","SQLAlchemy 2.0.23\n","sqlglot 17.16.2\n","sqlparse 0.4.4\n","srsly 2.4.8\n","stanio 0.3.0\n","statsmodels 0.14.0\n","sympy 1.12\n","tables 3.8.0\n","tabulate 0.9.0\n","tbb 2021.11.0\n","tblib 3.0.0\n","tenacity 8.2.3\n","tensorboard 2.14.1\n","tensorboard-data-server 0.7.2\n","tensorboardX 2.6.2.2\n","tensorflow 2.14.0\n","tensorflow-datasets 4.9.3\n","tensorflow-estimator 2.14.0\n","tensorflow-gcs-config 2.14.0\n","tensorflow-hub 0.15.0\n","tensorflow-io-gcs-filesystem 0.34.0\n","tensorflow-metadata 1.14.0\n","tensorflow-probability 0.22.0\n","tensorstore 0.1.45\n","termcolor 2.3.0\n","terminado 0.18.0\n","text-unidecode 1.3\n","textblob 0.17.1\n","tf-slim 1.1.0\n","thinc 8.1.12\n","threadpoolctl 3.2.0\n","tifffile 2023.9.26\n","timm 0.5.4\n","tinycss2 1.2.1\n","tokenizers 0.15.0\n","toml 0.10.2\n","tomli 2.0.1\n","toolz 0.12.0\n","torch 2.1.0+cu118\n","torchaudio 2.1.0+cu118\n","torchdata 0.7.0\n","torchsummary 1.5.1\n","torchtext 0.16.0\n","torchvision 0.16.0+cu118\n","tornado 6.3.2\n","tqdm 4.66.1\n","traitlets 5.7.1\n","traittypes 0.2.1\n","transformers 4.35.2\n","triton 2.1.0\n","ttach 0.0.3\n","tweepy 4.14.0\n","typer 0.9.0\n","types-pytz 2023.3.1.1\n","types-setuptools 68.2.0.1\n","typing_extensions 4.5.0\n","tzlocal 5.2\n","uc-micro-py 1.0.2\n","uritemplate 4.1.1\n","urllib3 2.0.7\n","vega-datasets 0.9.0\n","wadllib 1.3.6\n","wasabi 1.1.2\n","wcwidth 0.2.10\n","webcolors 1.13\n","webencodings 0.5.1\n","websocket-client 1.6.4\n","Werkzeug 3.0.1\n","wheel 0.41.3\n","widgetsnbextension 3.6.6\n","wordcloud 1.9.2\n","wrapt 1.14.1\n","xarray 2023.7.0\n","xarray-einstats 0.6.0\n","xgboost 2.0.2\n","xlrd 2.0.1\n","xxhash 3.4.1\n","xyzservices 2023.10.1\n","yarl 1.9.2\n","yellowbrick 1.5\n","yfinance 0.2.31\n","zict 3.0.0\n","zipp 3.17.0\n"]}],"source":["!pip list\n","!pip freeze\u003erequirements.txt\n","!cp requirements.txt ../runs"]},{"cell_type":"markdown","metadata":{"id":"h31KAx1ZZEl9"},"source":["# Pre-Training\n","* set up path by command line\n","* use argparse to set down hyper-parameter\n","\n","10000epochs will be trined with 400 images, for data-flow illustration.\n","We suggest you to use 4 * A100 SMX4 GPUs to train PuzzleTuning with CPIA dataset.\n","\n"]},{"cell_type":"markdown","metadata":{"id":"hveEqtxuZePT"},"source":["Our official training script is given here:"]},{"cell_type":"code","execution_count":null,"metadata":{"colab":{"background_save":true},"id":"F-wStD9SYeXA"},"outputs":[],"source":["# nohup python PuzzleTuning.py --batch_size 64 --group_shuffle_size 16 --blr 1.5e-4 --epochs 200 --accum_iter 2 --print_freq 2000 --check_point_gap 50 --input_size 224 --warmup_epochs 20 --pin_mem --num_workers 32 --strategy loop --PromptTuning Deep --basic_state_dict ../saved_models/ViT_b16_224_Imagenet.pth --data_path ../datasets/All \u0026"]},{"cell_type":"markdown","metadata":{"id":"Y3pitng_YhqM"},"source":["All following lines are for data-flow illustation with colab"]},{"cell_type":"code","execution_count":null,"metadata":{"colab":{"background_save":true},"id":"mjq7h2j1Wzdh"},"outputs":[{"name":"stdout","output_type":"stream","text":["/home/Pathology_Experiment/code\n"]}],"source":["# change working dir\n","import os\n","os.chdir(\"/home/Pathology_Experiment/code\")\n","!pwd"]},{"cell_type":"markdown","metadata":{"id":"7xGPpwiXa5vC"},"source":["Training"]},{"cell_type":"code","execution_count":null,"metadata":{"colab":{"background_save":true},"id":"T6jwGi8oa69a"},"outputs":[{"name":"stdout","output_type":"stream","text":["\u001b[1;30;43mStreaming output truncated to the last 5000 lines.\u001b[0m\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39167] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0216 (0.0216) time: 0.2915 data: 0.2048 max mem: 5716\n","Epoch: [39167] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0247 (0.0241) time: 0.0953 data: 0.0172 max mem: 5716\n","Epoch: [39167] Total time: 0:00:01 (0.0994 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0247 (0.0241) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39168] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0211 (0.0211) time: 0.2886 data: 0.1982 max mem: 5716\n","Epoch: [39168] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0240 (0.0244) time: 0.0966 data: 0.0167 max mem: 5716\n","Epoch: [39168] Total time: 0:00:01 (0.1007 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0240 (0.0244) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39169] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0210 (0.0210) time: 0.2844 data: 0.1939 max mem: 5716\n","Epoch: [39169] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0244 (0.0242) time: 0.0944 data: 0.0163 max mem: 5716\n","Epoch: [39169] Total time: 0:00:01 (0.0985 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0244 (0.0242) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39170] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0197 (0.0197) time: 0.2880 data: 0.2013 max mem: 5716\n","Epoch: [39170] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0199 (0.0208) time: 0.0956 data: 0.0169 max mem: 5716\n","Epoch: [39170] Total time: 0:00:01 (0.0996 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0199 (0.0208) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39171] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0222 (0.0222) time: 0.2832 data: 0.1917 max mem: 5716\n","Epoch: [39171] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0216 (0.0208) time: 0.0948 data: 0.0161 max mem: 5716\n","Epoch: [39171] Total time: 0:00:01 (0.0988 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0216 (0.0208) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39172] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0209 (0.0209) time: 0.2895 data: 0.1995 max mem: 5716\n","Epoch: [39172] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0206 (0.0209) time: 0.0959 data: 0.0168 max mem: 5716\n","Epoch: [39172] Total time: 0:00:01 (0.1000 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0206 (0.0209) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39173] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0233 (0.0233) time: 0.2843 data: 0.1959 max mem: 5716\n","Epoch: [39173] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0232 (0.0229) time: 0.0943 data: 0.0165 max mem: 5716\n","Epoch: [39173] Total time: 0:00:01 (0.0984 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0232 (0.0229) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39174] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0241 (0.0241) time: 0.2906 data: 0.1934 max mem: 5716\n","Epoch: [39174] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0241 (0.0233) time: 0.0948 data: 0.0163 max mem: 5716\n","Epoch: [39174] Total time: 0:00:01 (0.0990 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0241 (0.0233) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39175] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0242 (0.0242) time: 0.2966 data: 0.2071 max mem: 5716\n","Epoch: [39175] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0226 (0.0232) time: 0.0965 data: 0.0174 max mem: 5716\n","Epoch: [39175] Total time: 0:00:01 (0.1006 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0226 (0.0232) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39176] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0258 (0.0258) time: 0.2936 data: 0.1950 max mem: 5716\n","Epoch: [39176] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0236 (0.0239) time: 0.0955 data: 0.0164 max mem: 5716\n","Epoch: [39176] Total time: 0:00:01 (0.0996 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0236 (0.0239) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39177] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0225 (0.0225) time: 0.2921 data: 0.2054 max mem: 5716\n","Epoch: [39177] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0245 (0.0242) time: 0.0989 data: 0.0173 max mem: 5716\n","Epoch: [39177] Total time: 0:00:01 (0.1031 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0245 (0.0242) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39178] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0232 (0.0232) time: 0.2914 data: 0.2039 max mem: 5716\n","Epoch: [39178] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0247 (0.0242) time: 0.0949 data: 0.0171 max mem: 5716\n","Epoch: [39178] Total time: 0:00:01 (0.0990 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0247 (0.0242) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39179] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0196 (0.0196) time: 0.2880 data: 0.1962 max mem: 5716\n","Epoch: [39179] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0196 (0.0206) time: 0.0949 data: 0.0165 max mem: 5716\n","Epoch: [39179] Total time: 0:00:01 (0.0991 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0196 (0.0206) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39180] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0212 (0.0212) time: 0.2890 data: 0.2023 max mem: 5716\n","Epoch: [39180] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0202 (0.0208) time: 0.0950 data: 0.0170 max mem: 5716\n","Epoch: [39180] Total time: 0:00:01 (0.0991 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0202 (0.0208) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39181] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0242 (0.0242) time: 0.2971 data: 0.2001 max mem: 5716\n","Epoch: [39181] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0205 (0.0209) time: 0.0951 data: 0.0168 max mem: 5716\n","Epoch: [39181] Total time: 0:00:01 (0.0992 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0205 (0.0209) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39182] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0185 (0.0185) time: 0.2895 data: 0.2023 max mem: 5716\n","Epoch: [39182] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0227 (0.0232) time: 0.0953 data: 0.0170 max mem: 5716\n","Epoch: [39182] Total time: 0:00:01 (0.0994 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0227 (0.0232) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39183] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0217 (0.0217) time: 0.2912 data: 0.2033 max mem: 5716\n","Epoch: [39183] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0224 (0.0229) time: 0.0949 data: 0.0171 max mem: 5716\n","Epoch: [39183] Total time: 0:00:01 (0.0990 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0224 (0.0229) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39184] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0240 (0.0240) time: 0.2834 data: 0.1942 max mem: 5716\n","Epoch: [39184] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0235 (0.0235) time: 0.0981 data: 0.0163 max mem: 5716\n","Epoch: [39184] Total time: 0:00:01 (0.1023 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0235 (0.0235) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39185] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0242 (0.0242) time: 0.2991 data: 0.2109 max mem: 5716\n","Epoch: [39185] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0226 (0.0242) time: 0.0958 data: 0.0177 max mem: 5716\n","Epoch: [39185] Total time: 0:00:01 (0.0999 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0226 (0.0242) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39186] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0225 (0.0225) time: 0.2837 data: 0.1913 max mem: 5716\n","Epoch: [39186] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0236 (0.0247) time: 0.0940 data: 0.0161 max mem: 5716\n","Epoch: [39186] Total time: 0:00:01 (0.0981 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0236 (0.0247) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39187] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0256 (0.0256) time: 0.2908 data: 0.2052 max mem: 5716\n","Epoch: [39187] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0234 (0.0243) time: 0.0953 data: 0.0172 max mem: 5716\n","Epoch: [39187] Total time: 0:00:01 (0.0995 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0234 (0.0243) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39188] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0199 (0.0199) time: 0.2964 data: 0.2084 max mem: 5716\n","Epoch: [39188] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0207 (0.0210) time: 0.0958 data: 0.0175 max mem: 5716\n","Epoch: [39188] Total time: 0:00:01 (0.0999 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0207 (0.0210) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39189] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0174 (0.0174) time: 0.2920 data: 0.2044 max mem: 5716\n","Epoch: [39189] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0203 (0.0209) time: 0.0950 data: 0.0172 max mem: 5716\n","Epoch: [39189] Total time: 0:00:01 (0.0991 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0203 (0.0209) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39190] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0200 (0.0200) time: 0.2902 data: 0.2035 max mem: 5716\n","Epoch: [39190] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0200 (0.0206) time: 0.0953 data: 0.0171 max mem: 5716\n","Epoch: [39190] Total time: 0:00:01 (0.0995 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0200 (0.0206) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39191] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0179 (0.0179) time: 0.3042 data: 0.2043 max mem: 5716\n","Epoch: [39191] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0229 (0.0228) time: 0.0957 data: 0.0172 max mem: 5716\n","Epoch: [39191] Total time: 0:00:01 (0.0998 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0229 (0.0228) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39192] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0204 (0.0204) time: 0.3022 data: 0.2075 max mem: 5716\n","Epoch: [39192] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0221 (0.0234) time: 0.0965 data: 0.0174 max mem: 5716\n","Epoch: [39192] Total time: 0:00:01 (0.1007 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0221 (0.0234) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39193] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0246 (0.0246) time: 0.2921 data: 0.2048 max mem: 5716\n","Epoch: [39193] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0221 (0.0234) time: 0.0953 data: 0.0172 max mem: 5716\n","Epoch: [39193] Total time: 0:00:01 (0.0995 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0221 (0.0234) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39194] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0248 (0.0248) time: 0.2807 data: 0.1907 max mem: 5716\n","Epoch: [39194] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0241 (0.0244) time: 0.0950 data: 0.0160 max mem: 5716\n","Epoch: [39194] Total time: 0:00:01 (0.0991 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0241 (0.0244) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39195] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0293 (0.0293) time: 0.2886 data: 0.2005 max mem: 5716\n","Epoch: [39195] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0243 (0.0244) time: 0.0949 data: 0.0169 max mem: 5716\n","Epoch: [39195] Total time: 0:00:01 (0.0990 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0243 (0.0244) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39196] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0213 (0.0213) time: 0.2926 data: 0.1923 max mem: 5716\n","Epoch: [39196] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0240 (0.0241) time: 0.0949 data: 0.0162 max mem: 5716\n","Epoch: [39196] Total time: 0:00:01 (0.0990 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0240 (0.0241) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39197] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0213 (0.0213) time: 0.2885 data: 0.1916 max mem: 5716\n","Epoch: [39197] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0202 (0.0209) time: 0.0949 data: 0.0161 max mem: 5716\n","Epoch: [39197] Total time: 0:00:01 (0.0990 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0202 (0.0209) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39198] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0235 (0.0235) time: 0.2906 data: 0.2040 max mem: 5716\n","Epoch: [39198] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0212 (0.0207) time: 0.0953 data: 0.0171 max mem: 5716\n","Epoch: [39198] Total time: 0:00:01 (0.0995 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0212 (0.0207) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39199] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0241 (0.0241) time: 0.2995 data: 0.1958 max mem: 5716\n","Epoch: [39199] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0210 (0.0207) time: 0.0957 data: 0.0165 max mem: 5716\n","Epoch: [39199] Total time: 0:00:01 (0.0998 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0210 (0.0207) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39200] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0197 (0.0197) time: 0.2956 data: 0.2058 max mem: 5716\n","Epoch: [39200] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0230 (0.0233) time: 0.0962 data: 0.0173 max mem: 5716\n","Epoch: [39200] Total time: 0:00:01 (0.1004 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0230 (0.0233) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39201] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0205 (0.0205) time: 0.2909 data: 0.2029 max mem: 5716\n","Epoch: [39201] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0231 (0.0232) time: 0.0997 data: 0.0171 max mem: 5716\n","Epoch: [39201] Total time: 0:00:01 (0.1040 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0231 (0.0232) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39202] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0227 (0.0227) time: 0.2903 data: 0.2003 max mem: 5716\n","Epoch: [39202] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0233 (0.0236) time: 0.0976 data: 0.0168 max mem: 5716\n","Epoch: [39202] Total time: 0:00:01 (0.1018 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0233 (0.0236) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39203] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0226 (0.0226) time: 0.2833 data: 0.1940 max mem: 5716\n","Epoch: [39203] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0228 (0.0246) time: 0.0949 data: 0.0164 max mem: 5716\n","Epoch: [39203] Total time: 0:00:01 (0.0991 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0228 (0.0246) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39204] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0214 (0.0214) time: 0.2899 data: 0.1996 max mem: 5716\n","Epoch: [39204] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0233 (0.0240) time: 0.0957 data: 0.0168 max mem: 5716\n","Epoch: [39204] Total time: 0:00:01 (0.0999 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0233 (0.0240) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39205] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0237 (0.0237) time: 0.2823 data: 0.1906 max mem: 5716\n","Epoch: [39205] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0237 (0.0246) time: 0.0951 data: 0.0160 max mem: 5716\n","Epoch: [39205] Total time: 0:00:01 (0.0992 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0237 (0.0246) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39206] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0203 (0.0203) time: 0.2985 data: 0.2102 max mem: 5716\n","Epoch: [39206] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0197 (0.0207) time: 0.0963 data: 0.0177 max mem: 5716\n","Epoch: [39206] Total time: 0:00:01 (0.1005 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0197 (0.0207) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39207] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0236 (0.0236) time: 0.2897 data: 0.1970 max mem: 5716\n","Epoch: [39207] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0210 (0.0210) time: 0.0959 data: 0.0166 max mem: 5716\n","Epoch: [39207] Total time: 0:00:01 (0.1000 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0210 (0.0210) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39208] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0245 (0.0245) time: 0.2897 data: 0.1998 max mem: 5716\n","Epoch: [39208] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0201 (0.0207) time: 0.0950 data: 0.0168 max mem: 5716\n","Epoch: [39208] Total time: 0:00:01 (0.1002 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0201 (0.0207) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39209] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0242 (0.0242) time: 0.3004 data: 0.2061 max mem: 5716\n","Epoch: [39209] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0234 (0.0233) time: 0.0971 data: 0.0173 max mem: 5716\n","Epoch: [39209] Total time: 0:00:01 (0.1027 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0234 (0.0233) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39210] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0226 (0.0226) time: 0.2937 data: 0.2054 max mem: 5716\n","Epoch: [39210] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0221 (0.0231) time: 0.0966 data: 0.0173 max mem: 5716\n","Epoch: [39210] Total time: 0:00:01 (0.1008 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0221 (0.0231) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39211] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0198 (0.0198) time: 0.2867 data: 0.1955 max mem: 5716\n","Epoch: [39211] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0236 (0.0232) time: 0.0956 data: 0.0165 max mem: 5716\n","Epoch: [39211] Total time: 0:00:01 (0.0998 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0236 (0.0232) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39212] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0241 (0.0241) time: 0.3049 data: 0.2065 max mem: 5716\n","Epoch: [39212] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0247 (0.0245) time: 0.0965 data: 0.0173 max mem: 5716\n","Epoch: [39212] Total time: 0:00:01 (0.1006 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0247 (0.0245) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39213] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0253 (0.0253) time: 0.2945 data: 0.2034 max mem: 5716\n","Epoch: [39213] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0253 (0.0246) time: 0.0963 data: 0.0171 max mem: 5716\n","Epoch: [39213] Total time: 0:00:01 (0.1003 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0253 (0.0246) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39214] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0289 (0.0289) time: 0.2878 data: 0.1981 max mem: 5716\n","Epoch: [39214] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0234 (0.0243) time: 0.0951 data: 0.0167 max mem: 5716\n","Epoch: [39214] Total time: 0:00:01 (0.0991 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0234 (0.0243) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39215] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0234 (0.0234) time: 0.2811 data: 0.1922 max mem: 5716\n","Epoch: [39215] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0207 (0.0212) time: 0.0943 data: 0.0162 max mem: 5716\n","Epoch: [39215] Total time: 0:00:01 (0.0984 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0207 (0.0212) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39216] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0228 (0.0228) time: 0.2962 data: 0.2016 max mem: 5716\n","Epoch: [39216] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0201 (0.0209) time: 0.0953 data: 0.0169 max mem: 5716\n","Epoch: [39216] Total time: 0:00:01 (0.0993 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0201 (0.0209) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39217] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0168 (0.0168) time: 0.2777 data: 0.1891 max mem: 5716\n","Epoch: [39217] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0207 (0.0207) time: 0.0941 data: 0.0159 max mem: 5716\n","Epoch: [39217] Total time: 0:00:01 (0.0982 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0207 (0.0207) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39218] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0208 (0.0208) time: 0.2812 data: 0.1868 max mem: 5716\n","Epoch: [39218] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0231 (0.0231) time: 0.0970 data: 0.0157 max mem: 5716\n","Epoch: [39218] Total time: 0:00:01 (0.1011 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0231 (0.0231) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39219] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0223 (0.0223) time: 0.2862 data: 0.1974 max mem: 5716\n","Epoch: [39219] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0232 (0.0235) time: 0.0979 data: 0.0166 max mem: 5716\n","Epoch: [39219] Total time: 0:00:01 (0.1023 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0232 (0.0235) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39220] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0253 (0.0253) time: 0.2909 data: 0.2040 max mem: 5716\n","Epoch: [39220] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0230 (0.0233) time: 0.0955 data: 0.0172 max mem: 5716\n","Epoch: [39220] Total time: 0:00:01 (0.0996 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0230 (0.0233) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39221] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0226 (0.0226) time: 0.2874 data: 0.1964 max mem: 5716\n","Epoch: [39221] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0235 (0.0243) time: 0.0957 data: 0.0165 max mem: 5716\n","Epoch: [39221] Total time: 0:00:01 (0.0998 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0235 (0.0243) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39222] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0258 (0.0258) time: 0.3034 data: 0.2141 max mem: 5716\n","Epoch: [39222] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0241 (0.0244) time: 0.0962 data: 0.0180 max mem: 5716\n","Epoch: [39222] Total time: 0:00:01 (0.1003 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0241 (0.0244) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39223] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0304 (0.0304) time: 0.2919 data: 0.2009 max mem: 5716\n","Epoch: [39223] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0240 (0.0245) time: 0.0958 data: 0.0169 max mem: 5716\n","Epoch: [39223] Total time: 0:00:01 (0.1000 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0240 (0.0245) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39224] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0244 (0.0244) time: 0.2855 data: 0.1900 max mem: 5716\n","Epoch: [39224] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0201 (0.0208) time: 0.0943 data: 0.0160 max mem: 5716\n","Epoch: [39224] Total time: 0:00:01 (0.0983 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0201 (0.0208) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39225] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0215 (0.0215) time: 0.2878 data: 0.1984 max mem: 5716\n","Epoch: [39225] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0202 (0.0209) time: 0.0958 data: 0.0167 max mem: 5716\n","Epoch: [39225] Total time: 0:00:01 (0.1012 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0202 (0.0209) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39226] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0218 (0.0218) time: 0.2885 data: 0.1955 max mem: 5716\n","Epoch: [39226] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0214 (0.0207) time: 0.0952 data: 0.0164 max mem: 5716\n","Epoch: [39226] Total time: 0:00:01 (0.0994 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0214 (0.0207) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39227] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0191 (0.0191) time: 0.2841 data: 0.1937 max mem: 5716\n","Epoch: [39227] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0225 (0.0233) time: 0.0953 data: 0.0163 max mem: 5716\n","Epoch: [39227] Total time: 0:00:01 (0.0995 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0225 (0.0233) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39228] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0243 (0.0243) time: 0.2876 data: 0.1998 max mem: 5716\n","Epoch: [39228] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0238 (0.0233) time: 0.0955 data: 0.0168 max mem: 5716\n","Epoch: [39228] Total time: 0:00:01 (0.0996 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0238 (0.0233) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39229] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0185 (0.0185) time: 0.2777 data: 0.1882 max mem: 5716\n","Epoch: [39229] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0227 (0.0231) time: 0.0936 data: 0.0158 max mem: 5716\n","Epoch: [39229] Total time: 0:00:01 (0.0978 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0227 (0.0231) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39230] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0309 (0.0309) time: 0.2854 data: 0.1951 max mem: 5716\n","Epoch: [39230] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0241 (0.0245) time: 0.0952 data: 0.0164 max mem: 5716\n","Epoch: [39230] Total time: 0:00:01 (0.0993 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0241 (0.0245) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39231] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0236 (0.0236) time: 0.3027 data: 0.2006 max mem: 5716\n","Epoch: [39231] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0245 (0.0246) time: 0.0963 data: 0.0169 max mem: 5716\n","Epoch: [39231] Total time: 0:00:01 (0.1005 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0245 (0.0246) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39232] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0215 (0.0215) time: 0.3095 data: 0.2085 max mem: 5716\n","Epoch: [39232] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0248 (0.0245) time: 0.1007 data: 0.0175 max mem: 5716\n","Epoch: [39232] Total time: 0:00:01 (0.1049 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0248 (0.0245) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39233] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0242 (0.0242) time: 0.2904 data: 0.2033 max mem: 5716\n","Epoch: [39233] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0205 (0.0208) time: 0.0979 data: 0.0171 max mem: 5716\n","Epoch: [39233] Total time: 0:00:01 (0.1020 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0205 (0.0208) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39234] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0232 (0.0232) time: 0.2928 data: 0.2039 max mem: 5716\n","Epoch: [39234] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0205 (0.0208) time: 0.0950 data: 0.0171 max mem: 5716\n","Epoch: [39234] Total time: 0:00:01 (0.0992 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0205 (0.0208) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39235] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0211 (0.0211) time: 0.2861 data: 0.1957 max mem: 5716\n","Epoch: [39235] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0208 (0.0206) time: 0.0943 data: 0.0165 max mem: 5716\n","Epoch: [39235] Total time: 0:00:01 (0.0998 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0208 (0.0206) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39236] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0195 (0.0195) time: 0.2903 data: 0.2042 max mem: 5716\n","Epoch: [39236] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0227 (0.0234) time: 0.0954 data: 0.0172 max mem: 5716\n","Epoch: [39236] Total time: 0:00:01 (0.0995 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0227 (0.0234) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39237] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0221 (0.0221) time: 0.2978 data: 0.1980 max mem: 5716\n","Epoch: [39237] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0224 (0.0230) time: 0.0956 data: 0.0167 max mem: 5716\n","Epoch: [39237] Total time: 0:00:01 (0.0999 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0224 (0.0230) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39238] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0212 (0.0212) time: 0.2901 data: 0.2025 max mem: 5716\n","Epoch: [39238] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0233 (0.0234) time: 0.0947 data: 0.0170 max mem: 5716\n","Epoch: [39238] Total time: 0:00:01 (0.0988 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0233 (0.0234) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39239] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0236 (0.0236) time: 0.2912 data: 0.2024 max mem: 5716\n","Epoch: [39239] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0234 (0.0245) time: 0.0954 data: 0.0170 max mem: 5716\n","Epoch: [39239] Total time: 0:00:01 (0.0996 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0234 (0.0245) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39240] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0229 (0.0229) time: 0.2897 data: 0.2009 max mem: 5716\n","Epoch: [39240] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0229 (0.0241) time: 0.0949 data: 0.0169 max mem: 5716\n","Epoch: [39240] Total time: 0:00:01 (0.0990 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0229 (0.0241) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39241] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0210 (0.0210) time: 0.2953 data: 0.2065 max mem: 5716\n","Epoch: [39241] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0233 (0.0242) time: 0.0956 data: 0.0174 max mem: 5716\n","Epoch: [39241] Total time: 0:00:01 (0.1007 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0233 (0.0242) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39242] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0205 (0.0205) time: 0.2895 data: 0.2020 max mem: 5716\n","Epoch: [39242] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0209 (0.0208) time: 0.0950 data: 0.0170 max mem: 5716\n","Epoch: [39242] Total time: 0:00:01 (0.0992 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0209 (0.0208) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39243] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0227 (0.0227) time: 0.2968 data: 0.2077 max mem: 5716\n","Epoch: [39243] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0204 (0.0207) time: 0.0974 data: 0.0175 max mem: 5716\n","Epoch: [39243] Total time: 0:00:01 (0.1027 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0204 (0.0207) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39244] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0200 (0.0200) time: 0.3002 data: 0.2107 max mem: 5716\n","Epoch: [39244] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0210 (0.0210) time: 0.0974 data: 0.0177 max mem: 5716\n","Epoch: [39244] Total time: 0:00:01 (0.1017 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0210 (0.0210) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39245] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0180 (0.0180) time: 0.3023 data: 0.2036 max mem: 5716\n","Epoch: [39245] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0236 (0.0232) time: 0.0966 data: 0.0171 max mem: 5716\n","Epoch: [39245] Total time: 0:00:01 (0.1008 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0236 (0.0232) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39246] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0231 (0.0231) time: 0.2818 data: 0.1918 max mem: 5716\n","Epoch: [39246] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0225 (0.0236) time: 0.0964 data: 0.0161 max mem: 5716\n","Epoch: [39246] Total time: 0:00:01 (0.1004 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0225 (0.0236) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39247] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0246 (0.0246) time: 0.2810 data: 0.1918 max mem: 5716\n","Epoch: [39247] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0234 (0.0236) time: 0.0943 data: 0.0161 max mem: 5716\n","Epoch: [39247] Total time: 0:00:01 (0.0983 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0234 (0.0236) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39248] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0255 (0.0255) time: 0.2887 data: 0.2019 max mem: 5716\n","Epoch: [39248] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0232 (0.0240) time: 0.0955 data: 0.0170 max mem: 5716\n","Epoch: [39248] Total time: 0:00:01 (0.0996 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0232 (0.0240) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39249] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0260 (0.0260) time: 0.2970 data: 0.2001 max mem: 5716\n","Epoch: [39249] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0257 (0.0246) time: 0.0954 data: 0.0168 max mem: 5716\n","Epoch: [39249] Total time: 0:00:01 (0.0994 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0257 (0.0246) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39250] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0247 (0.0247) time: 0.2884 data: 0.2014 max mem: 5716\n","Epoch: [39250] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0234 (0.0245) time: 0.0966 data: 0.0169 max mem: 5716\n","Epoch: [39250] Total time: 0:00:01 (0.1007 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0234 (0.0245) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39251] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0240 (0.0240) time: 0.2818 data: 0.1910 max mem: 5716\n","Epoch: [39251] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0208 (0.0211) time: 0.0947 data: 0.0161 max mem: 5716\n","Epoch: [39251] Total time: 0:00:01 (0.0989 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0208 (0.0211) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39252] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0157 (0.0157) time: 0.2865 data: 0.1876 max mem: 5716\n","Epoch: [39252] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0205 (0.0208) time: 0.0955 data: 0.0158 max mem: 5716\n","Epoch: [39252] Total time: 0:00:01 (0.0996 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0205 (0.0208) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39253] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0179 (0.0179) time: 0.2830 data: 0.1943 max mem: 5716\n","Epoch: [39253] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0202 (0.0209) time: 0.0978 data: 0.0164 max mem: 5716\n","Epoch: [39253] Total time: 0:00:01 (0.1019 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0202 (0.0209) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39254] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0242 (0.0242) time: 0.2960 data: 0.2054 max mem: 5716\n","Epoch: [39254] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0233 (0.0230) time: 0.0967 data: 0.0173 max mem: 5716\n","Epoch: [39254] Total time: 0:00:01 (0.1009 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0233 (0.0230) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39255] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0220 (0.0220) time: 0.3060 data: 0.2102 max mem: 5716\n","Epoch: [39255] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0232 (0.0234) time: 0.0975 data: 0.0177 max mem: 5716\n","Epoch: [39255] Total time: 0:00:01 (0.1017 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0232 (0.0234) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39256] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0265 (0.0265) time: 0.2931 data: 0.2047 max mem: 5716\n","Epoch: [39256] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0232 (0.0232) time: 0.0972 data: 0.0172 max mem: 5716\n","Epoch: [39256] Total time: 0:00:01 (0.1014 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0232 (0.0232) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39257] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0259 (0.0259) time: 0.2882 data: 0.1969 max mem: 5716\n","Epoch: [39257] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0237 (0.0242) time: 0.0948 data: 0.0166 max mem: 5716\n","Epoch: [39257] Total time: 0:00:01 (0.0989 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0237 (0.0242) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39258] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0295 (0.0295) time: 0.2896 data: 0.2026 max mem: 5716\n","Epoch: [39258] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0244 (0.0244) time: 0.0948 data: 0.0170 max mem: 5716\n","Epoch: [39258] Total time: 0:00:01 (0.0989 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0244 (0.0244) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39259] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0257 (0.0257) time: 0.3086 data: 0.2031 max mem: 5716\n","Epoch: [39259] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0246 (0.0244) time: 0.0964 data: 0.0171 max mem: 5716\n","Epoch: [39259] Total time: 0:00:01 (0.1005 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0246 (0.0244) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39260] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0204 (0.0204) time: 0.2958 data: 0.1971 max mem: 5716\n","Epoch: [39260] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0200 (0.0204) time: 0.0960 data: 0.0166 max mem: 5716\n","Epoch: [39260] Total time: 0:00:01 (0.1000 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0200 (0.0204) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39261] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0202 (0.0202) time: 0.2877 data: 0.1933 max mem: 5716\n","Epoch: [39261] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0209 (0.0208) time: 0.0967 data: 0.0163 max mem: 5716\n","Epoch: [39261] Total time: 0:00:01 (0.1008 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0209 (0.0208) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39262] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0186 (0.0186) time: 0.2846 data: 0.1900 max mem: 5716\n","Epoch: [39262] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0196 (0.0208) time: 0.0957 data: 0.0160 max mem: 5716\n","Epoch: [39262] Total time: 0:00:01 (0.0999 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0196 (0.0208) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39263] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0225 (0.0225) time: 0.2910 data: 0.2053 max mem: 5716\n","Epoch: [39263] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0227 (0.0232) time: 0.0951 data: 0.0172 max mem: 5716\n","Epoch: [39263] Total time: 0:00:01 (0.0992 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0227 (0.0232) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39264] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0270 (0.0270) time: 0.2872 data: 0.1980 max mem: 5716\n","Epoch: [39264] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0228 (0.0233) time: 0.0948 data: 0.0166 max mem: 5716\n","Epoch: [39264] Total time: 0:00:01 (0.0989 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0228 (0.0233) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39265] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0293 (0.0293) time: 0.2850 data: 0.1967 max mem: 5716\n","Epoch: [39265] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0230 (0.0233) time: 0.0965 data: 0.0166 max mem: 5716\n","Epoch: [39265] Total time: 0:00:01 (0.1006 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0230 (0.0233) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39266] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0250 (0.0250) time: 0.3023 data: 0.2050 max mem: 5716\n","Epoch: [39266] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0243 (0.0247) time: 0.0963 data: 0.0172 max mem: 5716\n","Epoch: [39266] Total time: 0:00:01 (0.1005 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0243 (0.0247) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39267] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0247 (0.0247) time: 0.2872 data: 0.1971 max mem: 5716\n","Epoch: [39267] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0239 (0.0242) time: 0.0954 data: 0.0166 max mem: 5716\n","Epoch: [39267] Total time: 0:00:01 (0.0995 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0239 (0.0242) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39268] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0243 (0.0243) time: 0.2984 data: 0.1955 max mem: 5716\n","Epoch: [39268] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0243 (0.0242) time: 0.0958 data: 0.0164 max mem: 5716\n","Epoch: [39268] Total time: 0:00:01 (0.1006 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0243 (0.0242) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39269] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0235 (0.0235) time: 0.2824 data: 0.1935 max mem: 5716\n","Epoch: [39269] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0208 (0.0207) time: 0.0945 data: 0.0163 max mem: 5716\n","Epoch: [39269] Total time: 0:00:01 (0.0987 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0208 (0.0207) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39270] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0201 (0.0201) time: 0.2876 data: 0.1994 max mem: 5716\n","Epoch: [39270] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0201 (0.0209) time: 0.0955 data: 0.0168 max mem: 5716\n","Epoch: [39270] Total time: 0:00:01 (0.0996 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0201 (0.0209) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39271] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0138 (0.0138) time: 0.2786 data: 0.1895 max mem: 5716\n","Epoch: [39271] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0196 (0.0208) time: 0.0942 data: 0.0159 max mem: 5716\n","Epoch: [39271] Total time: 0:00:01 (0.0983 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0196 (0.0208) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39272] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0294 (0.0294) time: 0.2877 data: 0.1978 max mem: 5716\n","Epoch: [39272] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0230 (0.0234) time: 0.0942 data: 0.0166 max mem: 5716\n","Epoch: [39272] Total time: 0:00:01 (0.0983 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0230 (0.0234) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39273] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0253 (0.0253) time: 0.2798 data: 0.1891 max mem: 5716\n","Epoch: [39273] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0230 (0.0231) time: 0.0938 data: 0.0159 max mem: 5716\n","Epoch: [39273] Total time: 0:00:01 (0.0979 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0230 (0.0231) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39274] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0213 (0.0213) time: 0.2887 data: 0.1994 max mem: 5716\n","Epoch: [39274] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0218 (0.0230) time: 0.0956 data: 0.0168 max mem: 5716\n","Epoch: [39274] Total time: 0:00:01 (0.0998 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0218 (0.0230) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39275] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0208 (0.0208) time: 0.2903 data: 0.2029 max mem: 5716\n","Epoch: [39275] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0231 (0.0244) time: 0.0950 data: 0.0171 max mem: 5716\n","Epoch: [39275] Total time: 0:00:01 (0.0991 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0231 (0.0244) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39276] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0230 (0.0230) time: 0.2872 data: 0.1978 max mem: 5716\n","Epoch: [39276] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0233 (0.0243) time: 0.0950 data: 0.0167 max mem: 5716\n","Epoch: [39276] Total time: 0:00:01 (0.0991 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0233 (0.0243) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39277] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0220 (0.0220) time: 0.2851 data: 0.1966 max mem: 5716\n","Epoch: [39277] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0243 (0.0244) time: 0.0966 data: 0.0166 max mem: 5716\n","Epoch: [39277] Total time: 0:00:01 (0.1008 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0243 (0.0244) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39278] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0222 (0.0222) time: 0.2969 data: 0.2074 max mem: 5716\n","Epoch: [39278] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0214 (0.0205) time: 0.0985 data: 0.0174 max mem: 5716\n","Epoch: [39278] Total time: 0:00:01 (0.1026 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0214 (0.0205) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39279] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0169 (0.0169) time: 0.3155 data: 0.2083 max mem: 5716\n","Epoch: [39279] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0190 (0.0209) time: 0.0989 data: 0.0175 max mem: 5716\n","Epoch: [39279] Total time: 0:00:01 (0.1031 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0190 (0.0209) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39280] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0237 (0.0237) time: 0.2868 data: 0.1948 max mem: 5716\n","Epoch: [39280] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0208 (0.0208) time: 0.0961 data: 0.0164 max mem: 5716\n","Epoch: [39280] Total time: 0:00:01 (0.1002 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0208 (0.0208) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39281] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0176 (0.0176) time: 0.3083 data: 0.2072 max mem: 5716\n","Epoch: [39281] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0225 (0.0233) time: 0.0981 data: 0.0174 max mem: 5716\n","Epoch: [39281] Total time: 0:00:01 (0.1023 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0225 (0.0233) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39282] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0257 (0.0257) time: 0.2879 data: 0.1935 max mem: 5716\n","Epoch: [39282] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0222 (0.0233) time: 0.0948 data: 0.0163 max mem: 5716\n","Epoch: [39282] Total time: 0:00:01 (0.0990 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0222 (0.0233) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39283] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0275 (0.0275) time: 0.2888 data: 0.2001 max mem: 5716\n","Epoch: [39283] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0235 (0.0235) time: 0.0980 data: 0.0168 max mem: 5716\n","Epoch: [39283] Total time: 0:00:01 (0.1034 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0235 (0.0235) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39284] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0222 (0.0222) time: 0.2824 data: 0.1924 max mem: 5716\n","Epoch: [39284] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0240 (0.0243) time: 0.0943 data: 0.0162 max mem: 5716\n","Epoch: [39284] Total time: 0:00:01 (0.0984 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0240 (0.0243) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39285] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0252 (0.0252) time: 0.2933 data: 0.2068 max mem: 5716\n","Epoch: [39285] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0252 (0.0242) time: 0.0957 data: 0.0174 max mem: 5716\n","Epoch: [39285] Total time: 0:00:01 (0.0997 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0252 (0.0242) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39286] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0252 (0.0252) time: 0.2828 data: 0.1932 max mem: 5716\n","Epoch: [39286] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0243 (0.0244) time: 0.0949 data: 0.0163 max mem: 5716\n","Epoch: [39286] Total time: 0:00:01 (0.0990 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0243 (0.0244) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39287] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0194 (0.0194) time: 0.2892 data: 0.1998 max mem: 5716\n","Epoch: [39287] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0196 (0.0207) time: 0.0955 data: 0.0168 max mem: 5716\n","Epoch: [39287] Total time: 0:00:01 (0.0996 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0196 (0.0207) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39288] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0238 (0.0238) time: 0.2924 data: 0.2050 max mem: 5716\n","Epoch: [39288] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0221 (0.0211) time: 0.0953 data: 0.0172 max mem: 5716\n","Epoch: [39288] Total time: 0:00:01 (0.0995 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0221 (0.0211) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39289] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0233 (0.0233) time: 0.2929 data: 0.2031 max mem: 5716\n","Epoch: [39289] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0199 (0.0207) time: 0.0959 data: 0.0171 max mem: 5716\n","Epoch: [39289] Total time: 0:00:01 (0.1001 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0199 (0.0207) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39290] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0284 (0.0284) time: 0.2988 data: 0.2124 max mem: 5716\n","Epoch: [39290] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0232 (0.0231) time: 0.0993 data: 0.0179 max mem: 5716\n","Epoch: [39290] Total time: 0:00:01 (0.1035 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0232 (0.0231) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39291] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0193 (0.0193) time: 0.2965 data: 0.2073 max mem: 5716\n","Epoch: [39291] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0228 (0.0230) time: 0.0957 data: 0.0174 max mem: 5716\n","Epoch: [39291] Total time: 0:00:01 (0.0998 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0228 (0.0230) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39292] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0218 (0.0218) time: 0.2948 data: 0.2041 max mem: 5716\n","Epoch: [39292] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0228 (0.0233) time: 0.0958 data: 0.0172 max mem: 5716\n","Epoch: [39292] Total time: 0:00:01 (0.0999 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0228 (0.0233) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39293] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0230 (0.0230) time: 0.2902 data: 0.1992 max mem: 5716\n","Epoch: [39293] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0236 (0.0242) time: 0.0953 data: 0.0168 max mem: 5716\n","Epoch: [39293] Total time: 0:00:01 (0.0994 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0236 (0.0242) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39294] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0232 (0.0232) time: 0.2873 data: 0.1972 max mem: 5716\n","Epoch: [39294] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0243 (0.0242) time: 0.0950 data: 0.0166 max mem: 5716\n","Epoch: [39294] Total time: 0:00:01 (0.0992 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0243 (0.0242) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39295] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0217 (0.0217) time: 0.2893 data: 0.1985 max mem: 5716\n","Epoch: [39295] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0249 (0.0244) time: 0.0961 data: 0.0167 max mem: 5716\n","Epoch: [39295] Total time: 0:00:01 (0.1003 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0249 (0.0244) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39296] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0273 (0.0273) time: 0.2948 data: 0.2057 max mem: 5716\n","Epoch: [39296] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0207 (0.0208) time: 0.0975 data: 0.0173 max mem: 5716\n","Epoch: [39296] Total time: 0:00:01 (0.1019 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0207 (0.0208) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39297] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0246 (0.0246) time: 0.3022 data: 0.2031 max mem: 5716\n","Epoch: [39297] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0208 (0.0209) time: 0.0973 data: 0.0171 max mem: 5716\n","Epoch: [39297] Total time: 0:00:01 (0.1014 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0208 (0.0209) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39298] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0234 (0.0234) time: 0.3028 data: 0.2161 max mem: 5716\n","Epoch: [39298] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0201 (0.0205) time: 0.0964 data: 0.0182 max mem: 5716\n","Epoch: [39298] Total time: 0:00:01 (0.1006 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0201 (0.0205) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39299] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0216 (0.0216) time: 0.2877 data: 0.1969 max mem: 5716\n","Epoch: [39299] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0238 (0.0235) time: 0.0975 data: 0.0166 max mem: 5716\n","Epoch: [39299] Total time: 0:00:01 (0.1017 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0238 (0.0235) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39300] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0263 (0.0263) time: 0.2901 data: 0.2014 max mem: 5716\n","Epoch: [39300] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0221 (0.0230) time: 0.0953 data: 0.0169 max mem: 5716\n","Epoch: [39300] Total time: 0:00:01 (0.0993 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0221 (0.0230) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39301] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0231 (0.0231) time: 0.2887 data: 0.2025 max mem: 5716\n","Epoch: [39301] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0231 (0.0226) time: 0.0957 data: 0.0170 max mem: 5716\n","Epoch: [39301] Total time: 0:00:01 (0.0997 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0231 (0.0226) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39302] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0207 (0.0207) time: 0.2904 data: 0.2032 max mem: 5716\n","Epoch: [39302] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0249 (0.0247) time: 0.0948 data: 0.0171 max mem: 5716\n","Epoch: [39302] Total time: 0:00:01 (0.0989 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0249 (0.0247) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39303] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0254 (0.0254) time: 0.2877 data: 0.1973 max mem: 5716\n","Epoch: [39303] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0236 (0.0244) time: 0.0951 data: 0.0166 max mem: 5716\n","Epoch: [39303] Total time: 0:00:01 (0.1007 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0236 (0.0244) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39304] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0187 (0.0187) time: 0.2890 data: 0.1934 max mem: 5716\n","Epoch: [39304] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0225 (0.0241) time: 0.0956 data: 0.0163 max mem: 5716\n","Epoch: [39304] Total time: 0:00:01 (0.1011 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0225 (0.0241) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39305] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0211 (0.0211) time: 0.3003 data: 0.1971 max mem: 5716\n","Epoch: [39305] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0214 (0.0211) time: 0.0972 data: 0.0166 max mem: 5716\n","Epoch: [39305] Total time: 0:00:01 (0.1012 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0214 (0.0211) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39306] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0215 (0.0215) time: 0.2831 data: 0.1922 max mem: 5716\n","Epoch: [39306] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0210 (0.0207) time: 0.0942 data: 0.0162 max mem: 5716\n","Epoch: [39306] Total time: 0:00:01 (0.0983 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0210 (0.0207) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39307] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0206 (0.0206) time: 0.2922 data: 0.2053 max mem: 5716\n","Epoch: [39307] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0206 (0.0209) time: 0.0947 data: 0.0172 max mem: 5716\n","Epoch: [39307] Total time: 0:00:01 (0.0988 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0206 (0.0209) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39308] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0213 (0.0213) time: 0.2921 data: 0.2040 max mem: 5716\n","Epoch: [39308] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0229 (0.0232) time: 0.0963 data: 0.0172 max mem: 5716\n","Epoch: [39308] Total time: 0:00:01 (0.1004 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0229 (0.0232) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39309] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0206 (0.0206) time: 0.2957 data: 0.2084 max mem: 5716\n","Epoch: [39309] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0221 (0.0231) time: 0.0979 data: 0.0175 max mem: 5716\n","Epoch: [39309] Total time: 0:00:01 (0.1021 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0221 (0.0231) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39310] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0260 (0.0260) time: 0.2996 data: 0.2104 max mem: 5716\n","Epoch: [39310] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0228 (0.0232) time: 0.0958 data: 0.0177 max mem: 5716\n","Epoch: [39310] Total time: 0:00:01 (0.0999 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0228 (0.0232) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39311] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0266 (0.0266) time: 0.2889 data: 0.1977 max mem: 5716\n","Epoch: [39311] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0239 (0.0244) time: 0.0952 data: 0.0166 max mem: 5716\n","Epoch: [39311] Total time: 0:00:01 (0.0993 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0239 (0.0244) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39312] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0235 (0.0235) time: 0.3035 data: 0.2143 max mem: 5716\n","Epoch: [39312] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0246 (0.0246) time: 0.0960 data: 0.0180 max mem: 5716\n","Epoch: [39312] Total time: 0:00:01 (0.1002 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0246 (0.0246) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39313] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0202 (0.0202) time: 0.2919 data: 0.2040 max mem: 5716\n","Epoch: [39313] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0248 (0.0245) time: 0.0958 data: 0.0172 max mem: 5716\n","Epoch: [39313] Total time: 0:00:01 (0.1000 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0248 (0.0245) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39314] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0225 (0.0225) time: 0.2956 data: 0.2077 max mem: 5716\n","Epoch: [39314] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0208 (0.0208) time: 0.0955 data: 0.0174 max mem: 5716\n","Epoch: [39314] Total time: 0:00:01 (0.0997 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0208 (0.0208) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39315] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0235 (0.0235) time: 0.2819 data: 0.1896 max mem: 5716\n","Epoch: [39315] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0209 (0.0208) time: 0.0944 data: 0.0160 max mem: 5716\n","Epoch: [39315] Total time: 0:00:01 (0.0986 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0209 (0.0208) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39316] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0224 (0.0224) time: 0.2850 data: 0.1975 max mem: 5716\n","Epoch: [39316] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0207 (0.0208) time: 0.0962 data: 0.0166 max mem: 5716\n","Epoch: [39316] Total time: 0:00:01 (0.1003 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0207 (0.0208) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39317] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0196 (0.0196) time: 0.2869 data: 0.1993 max mem: 5716\n","Epoch: [39317] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0224 (0.0230) time: 0.0954 data: 0.0168 max mem: 5716\n","Epoch: [39317] Total time: 0:00:01 (0.1013 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0224 (0.0230) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39318] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0237 (0.0237) time: 0.2861 data: 0.1969 max mem: 5716\n","Epoch: [39318] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0237 (0.0233) time: 0.0946 data: 0.0165 max mem: 5716\n","Epoch: [39318] Total time: 0:00:01 (0.0987 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0237 (0.0233) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39319] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0260 (0.0260) time: 0.3064 data: 0.2054 max mem: 5716\n","Epoch: [39319] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0224 (0.0228) time: 0.0964 data: 0.0173 max mem: 5716\n","Epoch: [39319] Total time: 0:00:01 (0.1005 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0224 (0.0228) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39320] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0260 (0.0260) time: 0.2993 data: 0.2096 max mem: 5716\n","Epoch: [39320] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0239 (0.0243) time: 0.0958 data: 0.0176 max mem: 5716\n","Epoch: [39320] Total time: 0:00:01 (0.1012 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0239 (0.0243) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39321] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0219 (0.0219) time: 0.2893 data: 0.1982 max mem: 5716\n","Epoch: [39321] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0237 (0.0239) time: 0.0962 data: 0.0167 max mem: 5716\n","Epoch: [39321] Total time: 0:00:01 (0.1004 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0237 (0.0239) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39322] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0294 (0.0294) time: 0.2967 data: 0.2074 max mem: 5716\n","Epoch: [39322] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0244 (0.0243) time: 0.0969 data: 0.0174 max mem: 5716\n","Epoch: [39322] Total time: 0:00:01 (0.1011 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0244 (0.0243) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39323] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0199 (0.0199) time: 0.2986 data: 0.2078 max mem: 5716\n","Epoch: [39323] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0205 (0.0208) time: 0.0960 data: 0.0175 max mem: 5716\n","Epoch: [39323] Total time: 0:00:01 (0.1002 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0205 (0.0208) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39324] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0207 (0.0207) time: 0.2936 data: 0.2038 max mem: 5716\n","Epoch: [39324] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0209 (0.0208) time: 0.0953 data: 0.0172 max mem: 5716\n","Epoch: [39324] Total time: 0:00:01 (0.1005 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0209 (0.0208) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39325] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0221 (0.0221) time: 0.2884 data: 0.1977 max mem: 5716\n","Epoch: [39325] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0212 (0.0206) time: 0.0947 data: 0.0166 max mem: 5716\n","Epoch: [39325] Total time: 0:00:01 (0.1002 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0212 (0.0206) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39326] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0266 (0.0266) time: 0.2933 data: 0.2058 max mem: 5716\n","Epoch: [39326] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0228 (0.0231) time: 0.0956 data: 0.0173 max mem: 5716\n","Epoch: [39326] Total time: 0:00:01 (0.1014 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0228 (0.0231) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39327] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0194 (0.0194) time: 0.2892 data: 0.2018 max mem: 5716\n","Epoch: [39327] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0231 (0.0232) time: 0.0945 data: 0.0169 max mem: 5716\n","Epoch: [39327] Total time: 0:00:01 (0.0986 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0231 (0.0232) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39328] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0182 (0.0182) time: 0.2943 data: 0.2059 max mem: 5716\n","Epoch: [39328] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0222 (0.0230) time: 0.0956 data: 0.0173 max mem: 5716\n","Epoch: [39328] Total time: 0:00:01 (0.0998 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0222 (0.0230) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39329] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0258 (0.0258) time: 0.2929 data: 0.2042 max mem: 5716\n","Epoch: [39329] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0241 (0.0242) time: 0.0984 data: 0.0172 max mem: 5716\n","Epoch: [39329] Total time: 0:00:01 (0.1026 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0241 (0.0242) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39330] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0258 (0.0258) time: 0.2955 data: 0.1973 max mem: 5716\n","Epoch: [39330] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0240 (0.0242) time: 0.0975 data: 0.0166 max mem: 5716\n","Epoch: [39330] Total time: 0:00:01 (0.1030 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0240 (0.0242) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39331] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0246 (0.0246) time: 0.2923 data: 0.2054 max mem: 5716\n","Epoch: [39331] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0245 (0.0244) time: 0.0950 data: 0.0173 max mem: 5716\n","Epoch: [39331] Total time: 0:00:01 (0.0992 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0245 (0.0244) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39332] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0187 (0.0187) time: 0.2885 data: 0.1965 max mem: 5716\n","Epoch: [39332] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0195 (0.0207) time: 0.0961 data: 0.0166 max mem: 5716\n","Epoch: [39332] Total time: 0:00:01 (0.1003 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0195 (0.0207) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39333] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0219 (0.0219) time: 0.2901 data: 0.2013 max mem: 5716\n","Epoch: [39333] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0202 (0.0207) time: 0.0957 data: 0.0169 max mem: 5716\n","Epoch: [39333] Total time: 0:00:01 (0.0997 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0202 (0.0207) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39334] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0220 (0.0220) time: 0.2923 data: 0.2029 max mem: 5716\n","Epoch: [39334] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0202 (0.0208) time: 0.0957 data: 0.0171 max mem: 5716\n","Epoch: [39334] Total time: 0:00:01 (0.0998 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0202 (0.0208) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39335] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0210 (0.0210) time: 0.3042 data: 0.2031 max mem: 5716\n","Epoch: [39335] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0227 (0.0234) time: 0.0972 data: 0.0171 max mem: 5716\n","Epoch: [39335] Total time: 0:00:01 (0.1014 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0227 (0.0234) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39336] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0223 (0.0223) time: 0.2913 data: 0.1921 max mem: 5716\n","Epoch: [39336] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0223 (0.0229) time: 0.0954 data: 0.0162 max mem: 5716\n","Epoch: [39336] Total time: 0:00:01 (0.0995 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0223 (0.0229) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39337] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0255 (0.0255) time: 0.2931 data: 0.2002 max mem: 5716\n","Epoch: [39337] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0227 (0.0234) time: 0.0966 data: 0.0168 max mem: 5716\n","Epoch: [39337] Total time: 0:00:01 (0.1022 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0227 (0.0234) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39338] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0294 (0.0294) time: 0.2788 data: 0.1892 max mem: 5716\n","Epoch: [39338] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0235 (0.0241) time: 0.0955 data: 0.0159 max mem: 5716\n","Epoch: [39338] Total time: 0:00:01 (0.0996 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0235 (0.0241) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39339] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0302 (0.0302) time: 0.2845 data: 0.1928 max mem: 5716\n","Epoch: [39339] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0229 (0.0242) time: 0.0957 data: 0.0162 max mem: 5716\n","Epoch: [39339] Total time: 0:00:01 (0.0998 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0229 (0.0242) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39340] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0200 (0.0200) time: 0.2937 data: 0.2059 max mem: 5716\n","Epoch: [39340] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0237 (0.0243) time: 0.0952 data: 0.0173 max mem: 5716\n","Epoch: [39340] Total time: 0:00:01 (0.0993 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0237 (0.0243) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39341] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0247 (0.0247) time: 0.2833 data: 0.1919 max mem: 5716\n","Epoch: [39341] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0204 (0.0211) time: 0.0949 data: 0.0161 max mem: 5716\n","Epoch: [39341] Total time: 0:00:01 (0.1010 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0204 (0.0211) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39342] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0218 (0.0218) time: 0.2874 data: 0.1968 max mem: 5716\n","Epoch: [39342] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0196 (0.0206) time: 0.0950 data: 0.0165 max mem: 5716\n","Epoch: [39342] Total time: 0:00:01 (0.0992 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0196 (0.0206) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39343] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0218 (0.0218) time: 0.2947 data: 0.2089 max mem: 5716\n","Epoch: [39343] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0205 (0.0205) time: 0.0954 data: 0.0176 max mem: 5716\n","Epoch: [39343] Total time: 0:00:01 (0.0995 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0205 (0.0205) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39344] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0208 (0.0208) time: 0.2924 data: 0.2050 max mem: 5716\n","Epoch: [39344] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0241 (0.0233) time: 0.0952 data: 0.0173 max mem: 5716\n","Epoch: [39344] Total time: 0:00:01 (0.0994 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0241 (0.0233) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39345] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0194 (0.0194) time: 0.2913 data: 0.1924 max mem: 5716\n","Epoch: [39345] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0222 (0.0230) time: 0.0958 data: 0.0162 max mem: 5716\n","Epoch: [39345] Total time: 0:00:01 (0.1013 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0222 (0.0230) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39346] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0227 (0.0227) time: 0.2926 data: 0.2009 max mem: 5716\n","Epoch: [39346] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0231 (0.0231) time: 0.0973 data: 0.0169 max mem: 5716\n","Epoch: [39346] Total time: 0:00:01 (0.1022 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0231 (0.0231) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39347] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0232 (0.0232) time: 0.2924 data: 0.2001 max mem: 5716\n","Epoch: [39347] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0233 (0.0242) time: 0.0960 data: 0.0168 max mem: 5716\n","Epoch: [39347] Total time: 0:00:01 (0.1011 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0233 (0.0242) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39348] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0215 (0.0215) time: 0.2889 data: 0.1950 max mem: 5716\n","Epoch: [39348] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0235 (0.0244) time: 0.0951 data: 0.0164 max mem: 5716\n","Epoch: [39348] Total time: 0:00:01 (0.0992 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0235 (0.0244) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39349] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0232 (0.0232) time: 0.2858 data: 0.1966 max mem: 5716\n","Epoch: [39349] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0237 (0.0243) time: 0.0949 data: 0.0165 max mem: 5716\n","Epoch: [39349] Total time: 0:00:01 (0.0990 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0237 (0.0243) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39350] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0203 (0.0203) time: 0.3145 data: 0.2150 max mem: 5716\n","Epoch: [39350] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0203 (0.0210) time: 0.0975 data: 0.0181 max mem: 5716\n","Epoch: [39350] Total time: 0:00:01 (0.1016 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0203 (0.0210) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39351] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0201 (0.0201) time: 0.2968 data: 0.2113 max mem: 5716\n","Epoch: [39351] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0204 (0.0206) time: 0.0952 data: 0.0178 max mem: 5716\n","Epoch: [39351] Total time: 0:00:01 (0.0994 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0204 (0.0206) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39352] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0198 (0.0198) time: 0.2917 data: 0.2048 max mem: 5716\n","Epoch: [39352] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0198 (0.0206) time: 0.0952 data: 0.0172 max mem: 5716\n","Epoch: [39352] Total time: 0:00:01 (0.0994 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0198 (0.0206) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39353] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0214 (0.0214) time: 0.2884 data: 0.1955 max mem: 5716\n","Epoch: [39353] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0227 (0.0233) time: 0.0981 data: 0.0164 max mem: 5716\n","Epoch: [39353] Total time: 0:00:01 (0.1023 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0227 (0.0233) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39354] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0274 (0.0274) time: 0.2954 data: 0.2074 max mem: 5716\n","Epoch: [39354] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0219 (0.0231) time: 0.0979 data: 0.0175 max mem: 5716\n","Epoch: [39354] Total time: 0:00:01 (0.1020 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0219 (0.0231) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39355] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0268 (0.0268) time: 0.2996 data: 0.2111 max mem: 5716\n","Epoch: [39355] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0222 (0.0229) time: 0.0969 data: 0.0177 max mem: 5716\n","Epoch: [39355] Total time: 0:00:01 (0.1010 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0222 (0.0229) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39356] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0208 (0.0208) time: 0.2927 data: 0.1996 max mem: 5716\n","Epoch: [39356] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0243 (0.0242) time: 0.0962 data: 0.0168 max mem: 5716\n","Epoch: [39356] Total time: 0:00:01 (0.1004 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0243 (0.0242) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39357] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0201 (0.0201) time: 0.2865 data: 0.1964 max mem: 5716\n","Epoch: [39357] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0246 (0.0247) time: 0.0950 data: 0.0165 max mem: 5716\n","Epoch: [39357] Total time: 0:00:01 (0.0991 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0246 (0.0247) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39358] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0291 (0.0291) time: 0.2896 data: 0.1981 max mem: 5716\n","Epoch: [39358] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0236 (0.0243) time: 0.0979 data: 0.0167 max mem: 5716\n","Epoch: [39358] Total time: 0:00:01 (0.1020 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0236 (0.0243) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39359] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0224 (0.0224) time: 0.2929 data: 0.2044 max mem: 5716\n","Epoch: [39359] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0222 (0.0209) time: 0.0952 data: 0.0172 max mem: 5716\n","Epoch: [39359] Total time: 0:00:01 (0.0993 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0222 (0.0209) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39360] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0261 (0.0261) time: 0.2943 data: 0.2068 max mem: 5716\n","Epoch: [39360] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0200 (0.0208) time: 0.0955 data: 0.0174 max mem: 5716\n","Epoch: [39360] Total time: 0:00:01 (0.0996 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0200 (0.0208) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39361] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0161 (0.0161) time: 0.2958 data: 0.2077 max mem: 5716\n","Epoch: [39361] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0200 (0.0207) time: 0.0953 data: 0.0175 max mem: 5716\n","Epoch: [39361] Total time: 0:00:01 (0.0995 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0200 (0.0207) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39362] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0249 (0.0249) time: 0.2944 data: 0.2051 max mem: 5716\n","Epoch: [39362] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0235 (0.0230) time: 0.0952 data: 0.0172 max mem: 5716\n","Epoch: [39362] Total time: 0:00:01 (0.0994 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0235 (0.0230) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39363] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0235 (0.0235) time: 0.2948 data: 0.2038 max mem: 5716\n","Epoch: [39363] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0233 (0.0233) time: 0.0989 data: 0.0171 max mem: 5716\n","Epoch: [39363] Total time: 0:00:01 (0.1031 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0233 (0.0233) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39364] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0250 (0.0250) time: 0.2921 data: 0.2043 max mem: 5716\n","Epoch: [39364] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0219 (0.0229) time: 0.0963 data: 0.0172 max mem: 5716\n","Epoch: [39364] Total time: 0:00:01 (0.1005 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0219 (0.0229) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39365] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0265 (0.0265) time: 0.2934 data: 0.2047 max mem: 5716\n","Epoch: [39365] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0231 (0.0241) time: 0.0948 data: 0.0172 max mem: 5716\n","Epoch: [39365] Total time: 0:00:01 (0.0989 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0231 (0.0241) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39366] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0229 (0.0229) time: 0.2880 data: 0.1976 max mem: 5716\n","Epoch: [39366] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0243 (0.0244) time: 0.0967 data: 0.0166 max mem: 5716\n","Epoch: [39366] Total time: 0:00:01 (0.1009 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0243 (0.0244) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39367] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0288 (0.0288) time: 0.2969 data: 0.2083 max mem: 5716\n","Epoch: [39367] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0239 (0.0245) time: 0.0966 data: 0.0175 max mem: 5716\n","Epoch: [39367] Total time: 0:00:01 (0.1008 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0239 (0.0245) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39368] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0257 (0.0257) time: 0.2980 data: 0.2089 max mem: 5716\n","Epoch: [39368] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0209 (0.0209) time: 0.0967 data: 0.0176 max mem: 5716\n","Epoch: [39368] Total time: 0:00:01 (0.1009 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0209 (0.0209) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39369] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0191 (0.0191) time: 0.2932 data: 0.2062 max mem: 5716\n","Epoch: [39369] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0209 (0.0209) time: 0.0955 data: 0.0173 max mem: 5716\n","Epoch: [39369] Total time: 0:00:01 (0.0996 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0209 (0.0209) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39370] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0298 (0.0298) time: 0.2908 data: 0.1945 max mem: 5716\n","Epoch: [39370] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0196 (0.0208) time: 0.0949 data: 0.0164 max mem: 5716\n","Epoch: [39370] Total time: 0:00:01 (0.0990 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0196 (0.0208) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39371] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0256 (0.0256) time: 0.2757 data: 0.1866 max mem: 5716\n","Epoch: [39371] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0216 (0.0228) time: 0.0943 data: 0.0157 max mem: 5716\n","Epoch: [39371] Total time: 0:00:01 (0.0983 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0216 (0.0228) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39372] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0235 (0.0235) time: 0.2920 data: 0.2027 max mem: 5716\n","Epoch: [39372] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0221 (0.0231) time: 0.0949 data: 0.0170 max mem: 5716\n","Epoch: [39372] Total time: 0:00:01 (0.1003 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0221 (0.0231) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39373] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0256 (0.0256) time: 0.2886 data: 0.1963 max mem: 5716\n","Epoch: [39373] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0226 (0.0229) time: 0.0962 data: 0.0165 max mem: 5716\n","Epoch: [39373] Total time: 0:00:01 (0.1003 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0226 (0.0229) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39374] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0261 (0.0261) time: 0.2934 data: 0.2035 max mem: 5716\n","Epoch: [39374] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0253 (0.0245) time: 0.0957 data: 0.0171 max mem: 5716\n","Epoch: [39374] Total time: 0:00:01 (0.0998 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0253 (0.0245) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39375] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0221 (0.0221) time: 0.2942 data: 0.2067 max mem: 5716\n","Epoch: [39375] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0237 (0.0240) time: 0.0958 data: 0.0174 max mem: 5716\n","Epoch: [39375] Total time: 0:00:01 (0.0999 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0237 (0.0240) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39376] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0227 (0.0227) time: 0.2841 data: 0.1959 max mem: 5716\n","Epoch: [39376] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0227 (0.0243) time: 0.0946 data: 0.0165 max mem: 5716\n","Epoch: [39376] Total time: 0:00:01 (0.0986 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0227 (0.0243) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39377] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0231 (0.0231) time: 0.2962 data: 0.2083 max mem: 5716\n","Epoch: [39377] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0215 (0.0210) time: 0.0962 data: 0.0175 max mem: 5716\n","Epoch: [39377] Total time: 0:00:01 (0.1003 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0215 (0.0210) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39378] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0308 (0.0308) time: 0.3009 data: 0.1984 max mem: 5716\n","Epoch: [39378] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0194 (0.0207) time: 0.0959 data: 0.0167 max mem: 5716\n","Epoch: [39378] Total time: 0:00:01 (0.1000 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0194 (0.0207) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39379] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0132 (0.0132) time: 0.2944 data: 0.2063 max mem: 5716\n","Epoch: [39379] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0216 (0.0208) time: 0.0959 data: 0.0174 max mem: 5716\n","Epoch: [39379] Total time: 0:00:01 (0.1001 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0216 (0.0208) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39380] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0199 (0.0199) time: 0.2951 data: 0.2013 max mem: 5716\n","Epoch: [39380] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0225 (0.0232) time: 0.0959 data: 0.0169 max mem: 5716\n","Epoch: [39380] Total time: 0:00:01 (0.1001 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0225 (0.0232) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39381] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0255 (0.0255) time: 0.2940 data: 0.2067 max mem: 5716\n","Epoch: [39381] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0238 (0.0238) time: 0.0973 data: 0.0174 max mem: 5716\n","Epoch: [39381] Total time: 0:00:01 (0.1016 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0238 (0.0238) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39382] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0206 (0.0206) time: 0.2881 data: 0.1955 max mem: 5716\n","Epoch: [39382] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0238 (0.0231) time: 0.0946 data: 0.0164 max mem: 5716\n","Epoch: [39382] Total time: 0:00:01 (0.0987 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0238 (0.0231) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39383] [ 0/12] eta: 0:00:05 lr: 0.000000 loss: 0.0285 (0.0285) time: 0.4891 data: 0.4065 max mem: 5716\n","Epoch: [39383] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0249 (0.0246) time: 0.1111 data: 0.0340 max mem: 5716\n","Epoch: [39383] Total time: 0:00:01 (0.1152 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0249 (0.0246) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39384] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0204 (0.0204) time: 0.2843 data: 0.1968 max mem: 5716\n","Epoch: [39384] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0254 (0.0242) time: 0.0943 data: 0.0165 max mem: 5716\n","Epoch: [39384] Total time: 0:00:01 (0.0984 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0254 (0.0242) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39385] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0251 (0.0251) time: 0.2860 data: 0.1982 max mem: 5716\n","Epoch: [39385] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0229 (0.0240) time: 0.0944 data: 0.0167 max mem: 5716\n","Epoch: [39385] Total time: 0:00:01 (0.0985 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0229 (0.0240) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39386] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0254 (0.0254) time: 0.2885 data: 0.2004 max mem: 5716\n","Epoch: [39386] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0203 (0.0209) time: 0.0949 data: 0.0168 max mem: 5716\n","Epoch: [39386] Total time: 0:00:01 (0.0991 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0203 (0.0209) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39387] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0183 (0.0183) time: 0.2876 data: 0.1983 max mem: 5716\n","Epoch: [39387] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0201 (0.0207) time: 0.0956 data: 0.0167 max mem: 5716\n","Epoch: [39387] Total time: 0:00:01 (0.0997 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0201 (0.0207) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39388] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0201 (0.0201) time: 0.2847 data: 0.1961 max mem: 5716\n","Epoch: [39388] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0201 (0.0210) time: 0.0945 data: 0.0165 max mem: 5716\n","Epoch: [39388] Total time: 0:00:01 (0.0987 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0201 (0.0210) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39389] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0255 (0.0255) time: 0.2927 data: 0.2044 max mem: 5716\n","Epoch: [39389] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0232 (0.0233) time: 0.0953 data: 0.0172 max mem: 5716\n","Epoch: [39389] Total time: 0:00:01 (0.0995 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0232 (0.0233) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39390] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0200 (0.0200) time: 0.2874 data: 0.1964 max mem: 5716\n","Epoch: [39390] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0236 (0.0232) time: 0.0962 data: 0.0165 max mem: 5716\n","Epoch: [39390] Total time: 0:00:01 (0.1004 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0236 (0.0232) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39391] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0242 (0.0242) time: 0.2886 data: 0.2009 max mem: 5716\n","Epoch: [39391] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0227 (0.0233) time: 0.0952 data: 0.0169 max mem: 5716\n","Epoch: [39391] Total time: 0:00:01 (0.1014 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0227 (0.0233) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39392] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0240 (0.0240) time: 0.3101 data: 0.2233 max mem: 5716\n","Epoch: [39392] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0240 (0.0241) time: 0.0970 data: 0.0188 max mem: 5716\n","Epoch: [39392] Total time: 0:00:01 (0.1011 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0240 (0.0241) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39393] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0264 (0.0264) time: 0.2939 data: 0.2004 max mem: 5716\n","Epoch: [39393] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0241 (0.0243) time: 0.0974 data: 0.0169 max mem: 5716\n","Epoch: [39393] Total time: 0:00:01 (0.1015 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0241 (0.0243) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39394] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0256 (0.0256) time: 0.2986 data: 0.1978 max mem: 5716\n","Epoch: [39394] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0238 (0.0243) time: 0.0962 data: 0.0166 max mem: 5716\n","Epoch: [39394] Total time: 0:00:01 (0.1003 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0238 (0.0243) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39395] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0218 (0.0218) time: 0.3086 data: 0.2095 max mem: 5716\n","Epoch: [39395] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0203 (0.0208) time: 0.0971 data: 0.0176 max mem: 5716\n","Epoch: [39395] Total time: 0:00:01 (0.1012 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0203 (0.0208) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39396] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0165 (0.0165) time: 0.2912 data: 0.2035 max mem: 5716\n","Epoch: [39396] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0208 (0.0207) time: 0.0957 data: 0.0171 max mem: 5716\n","Epoch: [39396] Total time: 0:00:01 (0.0998 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0208 (0.0207) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39397] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0264 (0.0264) time: 0.2861 data: 0.1952 max mem: 5716\n","Epoch: [39397] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0209 (0.0210) time: 0.0952 data: 0.0164 max mem: 5716\n","Epoch: [39397] Total time: 0:00:01 (0.0993 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0209 (0.0210) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39398] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0209 (0.0209) time: 0.2881 data: 0.1982 max mem: 5716\n","Epoch: [39398] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0216 (0.0234) time: 0.0956 data: 0.0167 max mem: 5716\n","Epoch: [39398] Total time: 0:00:01 (0.0997 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0216 (0.0234) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39399] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0220 (0.0220) time: 0.2882 data: 0.2008 max mem: 5716\n","Epoch: [39399] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0229 (0.0231) time: 0.0985 data: 0.0169 max mem: 5716\n","Epoch: [39399] Total time: 0:00:01 (0.1026 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0229 (0.0231) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39400] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0199 (0.0199) time: 0.2898 data: 0.2029 max mem: 5716\n","Epoch: [39400] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0235 (0.0233) time: 0.0950 data: 0.0170 max mem: 5716\n","Epoch: [39400] Total time: 0:00:01 (0.0991 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0235 (0.0233) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39401] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0237 (0.0237) time: 0.2831 data: 0.1956 max mem: 5716\n","Epoch: [39401] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0234 (0.0243) time: 0.0951 data: 0.0165 max mem: 5716\n","Epoch: [39401] Total time: 0:00:01 (0.0992 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0234 (0.0243) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39402] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0278 (0.0278) time: 0.2805 data: 0.1918 max mem: 5716\n","Epoch: [39402] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0231 (0.0239) time: 0.0945 data: 0.0161 max mem: 5716\n","Epoch: [39402] Total time: 0:00:01 (0.0985 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0231 (0.0239) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39403] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0235 (0.0235) time: 0.2811 data: 0.1887 max mem: 5716\n","Epoch: [39403] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0244 (0.0245) time: 0.0956 data: 0.0159 max mem: 5716\n","Epoch: [39403] Total time: 0:00:01 (0.0996 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0244 (0.0245) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39404] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0218 (0.0218) time: 0.2864 data: 0.1977 max mem: 5716\n","Epoch: [39404] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0211 (0.0210) time: 0.0956 data: 0.0166 max mem: 5716\n","Epoch: [39404] Total time: 0:00:01 (0.0998 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0211 (0.0210) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39405] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0200 (0.0200) time: 0.2925 data: 0.2036 max mem: 5716\n","Epoch: [39405] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0200 (0.0207) time: 0.0977 data: 0.0171 max mem: 5716\n","Epoch: [39405] Total time: 0:00:01 (0.1019 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0200 (0.0207) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39406] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0234 (0.0234) time: 0.2931 data: 0.2053 max mem: 5716\n","Epoch: [39406] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0201 (0.0207) time: 0.0968 data: 0.0173 max mem: 5716\n","Epoch: [39406] Total time: 0:00:01 (0.1010 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0201 (0.0207) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39407] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0226 (0.0226) time: 0.2947 data: 0.2062 max mem: 5716\n","Epoch: [39407] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0223 (0.0235) time: 0.0963 data: 0.0173 max mem: 5716\n","Epoch: [39407] Total time: 0:00:01 (0.1005 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0223 (0.0235) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39408] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0209 (0.0209) time: 0.2987 data: 0.1991 max mem: 5716\n","Epoch: [39408] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0225 (0.0232) time: 0.0959 data: 0.0167 max mem: 5716\n","Epoch: [39408] Total time: 0:00:01 (0.1000 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0225 (0.0232) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39409] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0214 (0.0214) time: 0.2844 data: 0.1946 max mem: 5716\n","Epoch: [39409] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0224 (0.0232) time: 0.0942 data: 0.0164 max mem: 5716\n","Epoch: [39409] Total time: 0:00:01 (0.0983 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0224 (0.0232) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39410] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0206 (0.0206) time: 0.2946 data: 0.2026 max mem: 5716\n","Epoch: [39410] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0245 (0.0247) time: 0.0958 data: 0.0170 max mem: 5716\n","Epoch: [39410] Total time: 0:00:01 (0.0999 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0245 (0.0247) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39411] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0248 (0.0248) time: 0.2897 data: 0.1965 max mem: 5716\n","Epoch: [39411] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0239 (0.0242) time: 0.0976 data: 0.0165 max mem: 5716\n","Epoch: [39411] Total time: 0:00:01 (0.1018 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0239 (0.0242) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39412] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0228 (0.0228) time: 0.2908 data: 0.2040 max mem: 5716\n","Epoch: [39412] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0238 (0.0243) time: 0.0953 data: 0.0172 max mem: 5716\n","Epoch: [39412] Total time: 0:00:01 (0.0994 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0238 (0.0243) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39413] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0164 (0.0164) time: 0.2857 data: 0.1967 max mem: 5716\n","Epoch: [39413] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0216 (0.0207) time: 0.0949 data: 0.0165 max mem: 5716\n","Epoch: [39413] Total time: 0:00:01 (0.0989 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0216 (0.0207) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39414] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0189 (0.0189) time: 0.2989 data: 0.1944 max mem: 5716\n","Epoch: [39414] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0212 (0.0207) time: 0.0957 data: 0.0164 max mem: 5716\n","Epoch: [39414] Total time: 0:00:01 (0.0998 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0212 (0.0207) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39415] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0183 (0.0183) time: 0.2931 data: 0.1895 max mem: 5716\n","Epoch: [39415] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0206 (0.0208) time: 0.0948 data: 0.0160 max mem: 5716\n","Epoch: [39415] Total time: 0:00:01 (0.0995 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0206 (0.0208) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39416] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0248 (0.0248) time: 0.2941 data: 0.1972 max mem: 5716\n","Epoch: [39416] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0229 (0.0230) time: 0.0954 data: 0.0166 max mem: 5716\n","Epoch: [39416] Total time: 0:00:01 (0.0994 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0229 (0.0230) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39417] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0253 (0.0253) time: 0.2814 data: 0.1927 max mem: 5716\n","Epoch: [39417] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0240 (0.0233) time: 0.0946 data: 0.0162 max mem: 5716\n","Epoch: [39417] Total time: 0:00:01 (0.0986 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0240 (0.0233) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39418] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0272 (0.0272) time: 0.2854 data: 0.1969 max mem: 5716\n","Epoch: [39418] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0229 (0.0231) time: 0.0951 data: 0.0166 max mem: 5716\n","Epoch: [39418] Total time: 0:00:01 (0.0993 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0229 (0.0231) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39419] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0251 (0.0251) time: 0.2974 data: 0.2104 max mem: 5716\n","Epoch: [39419] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0236 (0.0241) time: 0.0957 data: 0.0177 max mem: 5716\n","Epoch: [39419] Total time: 0:00:01 (0.1021 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0236 (0.0241) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39420] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0283 (0.0283) time: 0.2871 data: 0.1964 max mem: 5716\n","Epoch: [39420] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0248 (0.0247) time: 0.0950 data: 0.0165 max mem: 5716\n","Epoch: [39420] Total time: 0:00:01 (0.0992 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0248 (0.0247) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39421] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0231 (0.0231) time: 0.2837 data: 0.1943 max mem: 5716\n","Epoch: [39421] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0236 (0.0239) time: 0.0942 data: 0.0163 max mem: 5716\n","Epoch: [39421] Total time: 0:00:01 (0.0983 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0236 (0.0239) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39422] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0210 (0.0210) time: 0.2987 data: 0.2024 max mem: 5716\n","Epoch: [39422] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0198 (0.0206) time: 0.0958 data: 0.0170 max mem: 5716\n","Epoch: [39422] Total time: 0:00:01 (0.0999 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0198 (0.0206) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39423] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0184 (0.0184) time: 0.2824 data: 0.1930 max mem: 5716\n","Epoch: [39423] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0201 (0.0212) time: 0.0943 data: 0.0162 max mem: 5716\n","Epoch: [39423] Total time: 0:00:01 (0.0985 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0201 (0.0212) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39424] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0200 (0.0200) time: 0.2900 data: 0.1969 max mem: 5716\n","Epoch: [39424] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0211 (0.0210) time: 0.0982 data: 0.0166 max mem: 5716\n","Epoch: [39424] Total time: 0:00:01 (0.1024 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0211 (0.0210) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39425] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0176 (0.0176) time: 0.2919 data: 0.2039 max mem: 5716\n","Epoch: [39425] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0229 (0.0233) time: 0.0951 data: 0.0171 max mem: 5716\n","Epoch: [39425] Total time: 0:00:01 (0.0992 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0229 (0.0233) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39426] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0181 (0.0181) time: 0.2887 data: 0.2021 max mem: 5716\n","Epoch: [39426] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0224 (0.0233) time: 0.0955 data: 0.0170 max mem: 5716\n","Epoch: [39426] Total time: 0:00:01 (0.0996 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0224 (0.0233) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39427] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0221 (0.0221) time: 0.2831 data: 0.1929 max mem: 5716\n","Epoch: [39427] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0226 (0.0232) time: 0.0942 data: 0.0162 max mem: 5716\n","Epoch: [39427] Total time: 0:00:01 (0.0983 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0226 (0.0232) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39428] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0248 (0.0248) time: 0.2871 data: 0.1975 max mem: 5716\n","Epoch: [39428] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0235 (0.0243) time: 0.0947 data: 0.0166 max mem: 5716\n","Epoch: [39428] Total time: 0:00:01 (0.0989 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0235 (0.0243) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39429] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0199 (0.0199) time: 0.2887 data: 0.1985 max mem: 5716\n","Epoch: [39429] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0234 (0.0241) time: 0.0948 data: 0.0167 max mem: 5716\n","Epoch: [39429] Total time: 0:00:01 (0.0989 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0234 (0.0241) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39430] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0223 (0.0223) time: 0.2868 data: 0.1969 max mem: 5716\n","Epoch: [39430] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0245 (0.0243) time: 0.0946 data: 0.0166 max mem: 5716\n","Epoch: [39430] Total time: 0:00:01 (0.0998 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0245 (0.0243) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39431] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0185 (0.0185) time: 0.3016 data: 0.2137 max mem: 5716\n","Epoch: [39431] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0201 (0.0210) time: 0.0968 data: 0.0180 max mem: 5716\n","Epoch: [39431] Total time: 0:00:01 (0.1011 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0201 (0.0210) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39432] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0239 (0.0239) time: 0.3014 data: 0.2115 max mem: 5716\n","Epoch: [39432] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0205 (0.0207) time: 0.0967 data: 0.0178 max mem: 5716\n","Epoch: [39432] Total time: 0:00:01 (0.1008 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0205 (0.0207) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39433] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0250 (0.0250) time: 0.2968 data: 0.2085 max mem: 5716\n","Epoch: [39433] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0202 (0.0207) time: 0.0970 data: 0.0175 max mem: 5716\n","Epoch: [39433] Total time: 0:00:01 (0.1012 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0202 (0.0207) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39434] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0219 (0.0219) time: 0.2904 data: 0.2022 max mem: 5716\n","Epoch: [39434] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0241 (0.0237) time: 0.0948 data: 0.0170 max mem: 5716\n","Epoch: [39434] Total time: 0:00:01 (0.0990 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0241 (0.0237) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39435] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0207 (0.0207) time: 0.2852 data: 0.1940 max mem: 5716\n","Epoch: [39435] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0215 (0.0231) time: 0.0944 data: 0.0163 max mem: 5716\n","Epoch: [39435] Total time: 0:00:01 (0.0985 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0215 (0.0231) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39436] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0205 (0.0205) time: 0.2868 data: 0.1962 max mem: 5716\n","Epoch: [39436] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0229 (0.0230) time: 0.0947 data: 0.0165 max mem: 5716\n","Epoch: [39436] Total time: 0:00:01 (0.0988 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0229 (0.0230) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39437] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0240 (0.0240) time: 0.2872 data: 0.1969 max mem: 5716\n","Epoch: [39437] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0240 (0.0243) time: 0.0947 data: 0.0166 max mem: 5716\n","Epoch: [39437] Total time: 0:00:01 (0.0989 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0240 (0.0243) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39438] [ 0/12] eta: 0:00:05 lr: 0.000000 loss: 0.0249 (0.0249) time: 0.4923 data: 0.4070 max mem: 5716\n","Epoch: [39438] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0235 (0.0241) time: 0.1126 data: 0.0341 max mem: 5716\n","Epoch: [39438] Total time: 0:00:01 (0.1168 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0235 (0.0241) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39439] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0291 (0.0291) time: 0.2875 data: 0.1990 max mem: 5716\n","Epoch: [39439] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0240 (0.0246) time: 0.0957 data: 0.0168 max mem: 5716\n","Epoch: [39439] Total time: 0:00:01 (0.0999 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0240 (0.0246) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39440] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0197 (0.0197) time: 0.2973 data: 0.2062 max mem: 5716\n","Epoch: [39440] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0207 (0.0208) time: 0.0974 data: 0.0174 max mem: 5716\n","Epoch: [39440] Total time: 0:00:01 (0.1027 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0207 (0.0208) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39441] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0204 (0.0204) time: 0.2853 data: 0.1960 max mem: 5716\n","Epoch: [39441] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0202 (0.0209) time: 0.0957 data: 0.0165 max mem: 5716\n","Epoch: [39441] Total time: 0:00:01 (0.0998 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0202 (0.0209) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39442] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0168 (0.0168) time: 0.2954 data: 0.2081 max mem: 5716\n","Epoch: [39442] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0198 (0.0207) time: 0.0959 data: 0.0175 max mem: 5716\n","Epoch: [39442] Total time: 0:00:01 (0.1000 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0198 (0.0207) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39443] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0283 (0.0283) time: 0.2917 data: 0.1999 max mem: 5716\n","Epoch: [39443] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0220 (0.0228) time: 0.0983 data: 0.0168 max mem: 5716\n","Epoch: [39443] Total time: 0:00:01 (0.1025 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0220 (0.0228) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39444] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0273 (0.0273) time: 0.2917 data: 0.2049 max mem: 5716\n","Epoch: [39444] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0233 (0.0235) time: 0.0961 data: 0.0172 max mem: 5716\n","Epoch: [39444] Total time: 0:00:01 (0.1003 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0233 (0.0235) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39445] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0291 (0.0291) time: 0.2934 data: 0.2067 max mem: 5716\n","Epoch: [39445] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0214 (0.0229) time: 0.0959 data: 0.0174 max mem: 5716\n","Epoch: [39445] Total time: 0:00:01 (0.1000 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0214 (0.0229) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39446] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0234 (0.0234) time: 0.2854 data: 0.1955 max mem: 5716\n","Epoch: [39446] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0239 (0.0248) time: 0.0944 data: 0.0164 max mem: 5716\n","Epoch: [39446] Total time: 0:00:01 (0.0985 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0239 (0.0248) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39447] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0231 (0.0231) time: 0.2967 data: 0.2098 max mem: 5716\n","Epoch: [39447] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0245 (0.0245) time: 0.0957 data: 0.0176 max mem: 5716\n","Epoch: [39447] Total time: 0:00:01 (0.0999 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0245 (0.0245) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39448] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0208 (0.0208) time: 0.2931 data: 0.1969 max mem: 5716\n","Epoch: [39448] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0236 (0.0242) time: 0.0990 data: 0.0166 max mem: 5716\n","Epoch: [39448] Total time: 0:00:01 (0.1032 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0236 (0.0242) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39449] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0192 (0.0192) time: 0.2835 data: 0.1942 max mem: 5716\n","Epoch: [39449] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0201 (0.0207) time: 0.0955 data: 0.0164 max mem: 5716\n","Epoch: [39449] Total time: 0:00:01 (0.0995 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0201 (0.0207) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39450] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0183 (0.0183) time: 0.2881 data: 0.1972 max mem: 5716\n","Epoch: [39450] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0204 (0.0206) time: 0.0956 data: 0.0166 max mem: 5716\n","Epoch: [39450] Total time: 0:00:01 (0.0998 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0204 (0.0206) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39451] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0168 (0.0168) time: 0.2900 data: 0.2035 max mem: 5716\n","Epoch: [39451] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0196 (0.0208) time: 0.0951 data: 0.0171 max mem: 5716\n","Epoch: [39451] Total time: 0:00:01 (0.0992 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0196 (0.0208) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39452] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0218 (0.0218) time: 0.2929 data: 0.2058 max mem: 5716\n","Epoch: [39452] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0220 (0.0229) time: 0.0949 data: 0.0173 max mem: 5716\n","Epoch: [39452] Total time: 0:00:01 (0.0989 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0220 (0.0229) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39453] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0239 (0.0239) time: 0.2895 data: 0.2025 max mem: 5716\n","Epoch: [39453] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0239 (0.0233) time: 0.0946 data: 0.0170 max mem: 5716\n","Epoch: [39453] Total time: 0:00:01 (0.0986 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0239 (0.0233) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39454] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0240 (0.0240) time: 0.2824 data: 0.1924 max mem: 5716\n","Epoch: [39454] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0229 (0.0234) time: 0.0942 data: 0.0162 max mem: 5716\n","Epoch: [39454] Total time: 0:00:01 (0.0982 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0229 (0.0234) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39455] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0228 (0.0228) time: 0.2938 data: 0.2055 max mem: 5716\n","Epoch: [39455] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0235 (0.0242) time: 0.0961 data: 0.0173 max mem: 5716\n","Epoch: [39455] Total time: 0:00:01 (0.1002 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0235 (0.0242) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39456] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0251 (0.0251) time: 0.3070 data: 0.2092 max mem: 5716\n","Epoch: [39456] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0250 (0.0246) time: 0.0979 data: 0.0176 max mem: 5716\n","Epoch: [39456] Total time: 0:00:01 (0.1021 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0250 (0.0246) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39457] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0268 (0.0268) time: 0.2921 data: 0.2065 max mem: 5716\n","Epoch: [39457] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0239 (0.0247) time: 0.0950 data: 0.0174 max mem: 5716\n","Epoch: [39457] Total time: 0:00:01 (0.0991 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0239 (0.0247) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39458] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0261 (0.0261) time: 0.2884 data: 0.1899 max mem: 5716\n","Epoch: [39458] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0199 (0.0209) time: 0.0973 data: 0.0160 max mem: 5716\n","Epoch: [39458] Total time: 0:00:01 (0.1015 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0199 (0.0209) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39459] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0212 (0.0212) time: 0.2852 data: 0.1941 max mem: 5716\n","Epoch: [39459] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0211 (0.0206) time: 0.0941 data: 0.0163 max mem: 5716\n","Epoch: [39459] Total time: 0:00:01 (0.0996 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0211 (0.0206) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39460] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0201 (0.0201) time: 0.2906 data: 0.1912 max mem: 5716\n","Epoch: [39460] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0210 (0.0209) time: 0.0946 data: 0.0161 max mem: 5716\n","Epoch: [39460] Total time: 0:00:01 (0.0988 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0210 (0.0209) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39461] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0191 (0.0191) time: 0.2846 data: 0.1954 max mem: 5716\n","Epoch: [39461] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0226 (0.0229) time: 0.0942 data: 0.0164 max mem: 5716\n","Epoch: [39461] Total time: 0:00:01 (0.0997 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0226 (0.0229) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39462] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0258 (0.0258) time: 0.2953 data: 0.2081 max mem: 5716\n","Epoch: [39462] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0224 (0.0232) time: 0.0956 data: 0.0175 max mem: 5716\n","Epoch: [39462] Total time: 0:00:01 (0.0998 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0224 (0.0232) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39463] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0285 (0.0285) time: 0.2844 data: 0.1962 max mem: 5716\n","Epoch: [39463] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0232 (0.0233) time: 0.0941 data: 0.0165 max mem: 5716\n","Epoch: [39463] Total time: 0:00:01 (0.0982 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0232 (0.0233) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39464] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0254 (0.0254) time: 0.2924 data: 0.2066 max mem: 5716\n","Epoch: [39464] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0247 (0.0246) time: 0.0950 data: 0.0174 max mem: 5716\n","Epoch: [39464] Total time: 0:00:01 (0.0994 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0247 (0.0246) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39465] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0270 (0.0270) time: 0.2877 data: 0.1951 max mem: 5716\n","Epoch: [39465] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0242 (0.0242) time: 0.0949 data: 0.0164 max mem: 5716\n","Epoch: [39465] Total time: 0:00:01 (0.0991 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0242 (0.0242) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39466] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0230 (0.0230) time: 0.2955 data: 0.2074 max mem: 5716\n","Epoch: [39466] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0236 (0.0243) time: 0.0959 data: 0.0174 max mem: 5716\n","Epoch: [39466] Total time: 0:00:01 (0.1011 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0236 (0.0243) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39467] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0181 (0.0181) time: 0.3002 data: 0.1989 max mem: 5716\n","Epoch: [39467] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0215 (0.0205) time: 0.0968 data: 0.0167 max mem: 5716\n","Epoch: [39467] Total time: 0:00:01 (0.1010 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0215 (0.0205) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39468] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0185 (0.0185) time: 0.2852 data: 0.1965 max mem: 5716\n","Epoch: [39468] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0194 (0.0208) time: 0.0958 data: 0.0166 max mem: 5716\n","Epoch: [39468] Total time: 0:00:01 (0.1000 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0194 (0.0208) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39469] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0195 (0.0195) time: 0.2871 data: 0.1955 max mem: 5716\n","Epoch: [39469] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0208 (0.0207) time: 0.0952 data: 0.0164 max mem: 5716\n","Epoch: [39469] Total time: 0:00:01 (0.0993 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0208 (0.0207) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39470] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0215 (0.0215) time: 0.2899 data: 0.1899 max mem: 5716\n","Epoch: [39470] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0229 (0.0237) time: 0.0950 data: 0.0160 max mem: 5716\n","Epoch: [39470] Total time: 0:00:01 (0.0991 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0229 (0.0237) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39471] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0215 (0.0215) time: 0.2855 data: 0.1958 max mem: 5716\n","Epoch: [39471] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0226 (0.0230) time: 0.0942 data: 0.0165 max mem: 5716\n","Epoch: [39471] Total time: 0:00:01 (0.0983 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0226 (0.0230) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39472] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0271 (0.0271) time: 0.2892 data: 0.1986 max mem: 5716\n","Epoch: [39472] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0227 (0.0235) time: 0.0958 data: 0.0167 max mem: 5716\n","Epoch: [39472] Total time: 0:00:01 (0.1000 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0227 (0.0235) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39473] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0289 (0.0289) time: 0.2865 data: 0.1976 max mem: 5716\n","Epoch: [39473] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0229 (0.0241) time: 0.0949 data: 0.0166 max mem: 5716\n","Epoch: [39473] Total time: 0:00:01 (0.0990 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0229 (0.0241) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39474] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0270 (0.0270) time: 0.2995 data: 0.1945 max mem: 5716\n","Epoch: [39474] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0235 (0.0245) time: 0.0972 data: 0.0164 max mem: 5716\n","Epoch: [39474] Total time: 0:00:01 (0.1013 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0235 (0.0245) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39475] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0287 (0.0287) time: 0.2949 data: 0.1967 max mem: 5716\n","Epoch: [39475] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0237 (0.0243) time: 0.0952 data: 0.0166 max mem: 5716\n","Epoch: [39475] Total time: 0:00:01 (0.0993 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0237 (0.0243) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39476] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0222 (0.0222) time: 0.2892 data: 0.2014 max mem: 5716\n","Epoch: [39476] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0205 (0.0209) time: 0.0955 data: 0.0169 max mem: 5716\n","Epoch: [39476] Total time: 0:00:01 (0.0996 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0205 (0.0209) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39477] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0208 (0.0208) time: 0.2913 data: 0.2007 max mem: 5716\n","Epoch: [39477] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0206 (0.0206) time: 0.0971 data: 0.0169 max mem: 5716\n","Epoch: [39477] Total time: 0:00:01 (0.1013 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0206 (0.0206) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39478] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0260 (0.0260) time: 0.2858 data: 0.1968 max mem: 5716\n","Epoch: [39478] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0196 (0.0207) time: 0.0944 data: 0.0166 max mem: 5716\n","Epoch: [39478] Total time: 0:00:01 (0.0985 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0196 (0.0207) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39479] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0245 (0.0245) time: 0.2940 data: 0.2060 max mem: 5716\n","Epoch: [39479] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0239 (0.0233) time: 0.0953 data: 0.0173 max mem: 5716\n","Epoch: [39479] Total time: 0:00:01 (0.0994 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0239 (0.0233) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39480] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0208 (0.0208) time: 0.2801 data: 0.1919 max mem: 5716\n","Epoch: [39480] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0225 (0.0233) time: 0.0941 data: 0.0161 max mem: 5716\n","Epoch: [39480] Total time: 0:00:01 (0.0982 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0225 (0.0233) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39481] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0184 (0.0184) time: 0.2825 data: 0.1912 max mem: 5716\n","Epoch: [39481] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0220 (0.0232) time: 0.0956 data: 0.0161 max mem: 5716\n","Epoch: [39481] Total time: 0:00:01 (0.0998 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0220 (0.0232) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39482] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0227 (0.0227) time: 0.2909 data: 0.2032 max mem: 5716\n","Epoch: [39482] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0237 (0.0248) time: 0.0957 data: 0.0171 max mem: 5716\n","Epoch: [39482] Total time: 0:00:01 (0.0998 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0237 (0.0248) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39483] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0266 (0.0266) time: 0.2881 data: 0.1975 max mem: 5716\n","Epoch: [39483] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0250 (0.0245) time: 0.0959 data: 0.0166 max mem: 5716\n","Epoch: [39483] Total time: 0:00:01 (0.1001 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0250 (0.0245) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39484] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0264 (0.0264) time: 0.2990 data: 0.1967 max mem: 5716\n","Epoch: [39484] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0236 (0.0243) time: 0.0984 data: 0.0166 max mem: 5716\n","Epoch: [39484] Total time: 0:00:01 (0.1025 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0236 (0.0243) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39485] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0172 (0.0172) time: 0.2979 data: 0.1983 max mem: 5716\n","Epoch: [39485] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0213 (0.0207) time: 0.0960 data: 0.0167 max mem: 5716\n","Epoch: [39485] Total time: 0:00:01 (0.1021 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0213 (0.0207) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39486] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0229 (0.0229) time: 0.2904 data: 0.1984 max mem: 5716\n","Epoch: [39486] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0204 (0.0211) time: 0.0953 data: 0.0167 max mem: 5716\n","Epoch: [39486] Total time: 0:00:01 (0.0994 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0204 (0.0211) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39487] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0242 (0.0242) time: 0.2855 data: 0.1962 max mem: 5716\n","Epoch: [39487] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0210 (0.0208) time: 0.0958 data: 0.0165 max mem: 5716\n","Epoch: [39487] Total time: 0:00:01 (0.0999 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0210 (0.0208) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39488] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0251 (0.0251) time: 0.3007 data: 0.2132 max mem: 5716\n","Epoch: [39488] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0234 (0.0231) time: 0.0966 data: 0.0179 max mem: 5716\n","Epoch: [39488] Total time: 0:00:01 (0.1008 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0234 (0.0231) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39489] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0193 (0.0193) time: 0.2895 data: 0.2008 max mem: 5716\n","Epoch: [39489] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0235 (0.0232) time: 0.0953 data: 0.0169 max mem: 5716\n","Epoch: [39489] Total time: 0:00:01 (0.0994 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0235 (0.0232) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39490] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0222 (0.0222) time: 0.2886 data: 0.1991 max mem: 5716\n","Epoch: [39490] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0229 (0.0229) time: 0.0947 data: 0.0167 max mem: 5716\n","Epoch: [39490] Total time: 0:00:01 (0.0988 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0229 (0.0229) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39491] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0213 (0.0213) time: 0.2959 data: 0.2051 max mem: 5716\n","Epoch: [39491] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0245 (0.0242) time: 0.0955 data: 0.0172 max mem: 5716\n","Epoch: [39491] Total time: 0:00:01 (0.0997 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0245 (0.0242) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39492] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0249 (0.0249) time: 0.2931 data: 0.2053 max mem: 5716\n","Epoch: [39492] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0251 (0.0250) time: 0.0954 data: 0.0173 max mem: 5716\n","Epoch: [39492] Total time: 0:00:01 (0.0995 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0251 (0.0250) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39493] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0216 (0.0216) time: 0.3029 data: 0.2124 max mem: 5716\n","Epoch: [39493] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0231 (0.0245) time: 0.0969 data: 0.0179 max mem: 5716\n","Epoch: [39493] Total time: 0:00:01 (0.1026 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0231 (0.0245) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39494] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0234 (0.0234) time: 0.2864 data: 0.1963 max mem: 5716\n","Epoch: [39494] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0198 (0.0209) time: 0.0952 data: 0.0165 max mem: 5716\n","Epoch: [39494] Total time: 0:00:01 (0.0993 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0198 (0.0209) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39495] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0181 (0.0181) time: 0.2902 data: 0.1976 max mem: 5716\n","Epoch: [39495] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0185 (0.0208) time: 0.0951 data: 0.0166 max mem: 5716\n","Epoch: [39495] Total time: 0:00:01 (0.0992 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0185 (0.0208) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39496] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0217 (0.0217) time: 0.2823 data: 0.1935 max mem: 5716\n","Epoch: [39496] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0204 (0.0211) time: 0.0940 data: 0.0163 max mem: 5716\n","Epoch: [39496] Total time: 0:00:01 (0.0981 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0204 (0.0211) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39497] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0202 (0.0202) time: 0.2934 data: 0.2045 max mem: 5716\n","Epoch: [39497] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0223 (0.0232) time: 0.0955 data: 0.0172 max mem: 5716\n","Epoch: [39497] Total time: 0:00:01 (0.0996 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0223 (0.0232) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39498] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0192 (0.0192) time: 0.2884 data: 0.2019 max mem: 5716\n","Epoch: [39498] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0227 (0.0228) time: 0.0951 data: 0.0170 max mem: 5716\n","Epoch: [39498] Total time: 0:00:01 (0.0992 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0227 (0.0228) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39499] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0213 (0.0213) time: 0.2846 data: 0.1943 max mem: 5716\n","Epoch: [39499] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0228 (0.0231) time: 0.0945 data: 0.0164 max mem: 5716\n","Epoch: [39499] Total time: 0:00:01 (0.0987 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0228 (0.0231) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39500] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0283 (0.0283) time: 0.2972 data: 0.2021 max mem: 5716\n","Epoch: [39500] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0236 (0.0247) time: 0.0955 data: 0.0170 max mem: 5716\n","Epoch: [39500] Total time: 0:00:01 (0.1014 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0236 (0.0247) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39501] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0229 (0.0229) time: 0.2900 data: 0.1951 max mem: 5716\n","Epoch: [39501] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0229 (0.0240) time: 0.0977 data: 0.0164 max mem: 5716\n","Epoch: [39501] Total time: 0:00:01 (0.1018 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0229 (0.0240) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39502] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0267 (0.0267) time: 0.2877 data: 0.1977 max mem: 5716\n","Epoch: [39502] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0252 (0.0247) time: 0.0946 data: 0.0166 max mem: 5716\n","Epoch: [39502] Total time: 0:00:01 (0.0987 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0252 (0.0247) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39503] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0176 (0.0176) time: 0.2855 data: 0.1939 max mem: 5716\n","Epoch: [39503] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0203 (0.0206) time: 0.0969 data: 0.0163 max mem: 5716\n","Epoch: [39503] Total time: 0:00:01 (0.1010 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0203 (0.0206) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39504] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0184 (0.0184) time: 0.2878 data: 0.1980 max mem: 5716\n","Epoch: [39504] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0222 (0.0209) time: 0.0951 data: 0.0167 max mem: 5716\n","Epoch: [39504] Total time: 0:00:01 (0.0992 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0222 (0.0209) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39505] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0189 (0.0189) time: 0.2999 data: 0.2067 max mem: 5716\n","Epoch: [39505] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0204 (0.0207) time: 0.0956 data: 0.0174 max mem: 5716\n","Epoch: [39505] Total time: 0:00:01 (0.0998 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0204 (0.0207) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39506] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0202 (0.0202) time: 0.3105 data: 0.2215 max mem: 5716\n","Epoch: [39506] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0219 (0.0233) time: 0.0988 data: 0.0186 max mem: 5716\n","Epoch: [39506] Total time: 0:00:01 (0.1029 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0219 (0.0233) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39507] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0279 (0.0279) time: 0.2906 data: 0.2001 max mem: 5716\n","Epoch: [39507] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0232 (0.0233) time: 0.0960 data: 0.0169 max mem: 5716\n","Epoch: [39507] Total time: 0:00:01 (0.1001 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0232 (0.0233) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39508] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0196 (0.0196) time: 0.2853 data: 0.1953 max mem: 5716\n","Epoch: [39508] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0209 (0.0233) time: 0.0952 data: 0.0164 max mem: 5716\n","Epoch: [39508] Total time: 0:00:01 (0.0992 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0209 (0.0233) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39509] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0292 (0.0292) time: 0.2848 data: 0.1961 max mem: 5716\n","Epoch: [39509] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0247 (0.0246) time: 0.0967 data: 0.0165 max mem: 5716\n","Epoch: [39509] Total time: 0:00:01 (0.1022 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0247 (0.0246) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39510] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0211 (0.0211) time: 0.2821 data: 0.1922 max mem: 5716\n","Epoch: [39510] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0241 (0.0238) time: 0.0945 data: 0.0162 max mem: 5716\n","Epoch: [39510] Total time: 0:00:01 (0.0986 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0241 (0.0238) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39511] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0232 (0.0232) time: 0.2877 data: 0.1998 max mem: 5716\n","Epoch: [39511] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0232 (0.0244) time: 0.0949 data: 0.0168 max mem: 5716\n","Epoch: [39511] Total time: 0:00:01 (0.0990 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0232 (0.0244) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39512] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0189 (0.0189) time: 0.2918 data: 0.2032 max mem: 5716\n","Epoch: [39512] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0200 (0.0207) time: 0.0949 data: 0.0171 max mem: 5716\n","Epoch: [39512] Total time: 0:00:01 (0.0991 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0200 (0.0207) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39513] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0180 (0.0180) time: 0.2804 data: 0.1904 max mem: 5716\n","Epoch: [39513] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0200 (0.0206) time: 0.0943 data: 0.0160 max mem: 5716\n","Epoch: [39513] Total time: 0:00:01 (0.0984 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0200 (0.0206) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39514] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0185 (0.0185) time: 0.2900 data: 0.2001 max mem: 5716\n","Epoch: [39514] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0209 (0.0209) time: 0.0958 data: 0.0168 max mem: 5716\n","Epoch: [39514] Total time: 0:00:01 (0.0999 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0209 (0.0209) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39515] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0268 (0.0268) time: 0.2919 data: 0.2061 max mem: 5716\n","Epoch: [39515] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0223 (0.0230) time: 0.0961 data: 0.0174 max mem: 5716\n","Epoch: [39515] Total time: 0:00:01 (0.1002 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0223 (0.0230) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39516] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0255 (0.0255) time: 0.2966 data: 0.2086 max mem: 5716\n","Epoch: [39516] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0227 (0.0235) time: 0.0975 data: 0.0175 max mem: 5716\n","Epoch: [39516] Total time: 0:00:01 (0.1017 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0227 (0.0235) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39517] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0209 (0.0209) time: 0.2840 data: 0.1944 max mem: 5716\n","Epoch: [39517] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0237 (0.0232) time: 0.0944 data: 0.0164 max mem: 5716\n","Epoch: [39517] Total time: 0:00:01 (0.0985 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0237 (0.0232) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39518] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0230 (0.0230) time: 0.3005 data: 0.2123 max mem: 5716\n","Epoch: [39518] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0247 (0.0243) time: 0.0973 data: 0.0179 max mem: 5716\n","Epoch: [39518] Total time: 0:00:01 (0.1014 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0247 (0.0243) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39519] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0273 (0.0273) time: 0.2910 data: 0.2017 max mem: 5716\n","Epoch: [39519] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0243 (0.0242) time: 0.0965 data: 0.0170 max mem: 5716\n","Epoch: [39519] Total time: 0:00:01 (0.1006 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0243 (0.0242) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39520] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0239 (0.0239) time: 0.3041 data: 0.1996 max mem: 5716\n","Epoch: [39520] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0238 (0.0242) time: 0.0958 data: 0.0168 max mem: 5716\n","Epoch: [39520] Total time: 0:00:01 (0.1000 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0238 (0.0242) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39521] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0187 (0.0187) time: 0.2844 data: 0.1939 max mem: 5716\n","Epoch: [39521] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0189 (0.0207) time: 0.0953 data: 0.0163 max mem: 5716\n","Epoch: [39521] Total time: 0:00:01 (0.0994 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0189 (0.0207) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39522] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0223 (0.0223) time: 0.2962 data: 0.1997 max mem: 5716\n","Epoch: [39522] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0216 (0.0208) time: 0.0958 data: 0.0168 max mem: 5716\n","Epoch: [39522] Total time: 0:00:01 (0.0999 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0216 (0.0208) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39523] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0216 (0.0216) time: 0.2877 data: 0.1983 max mem: 5716\n","Epoch: [39523] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0210 (0.0211) time: 0.0953 data: 0.0167 max mem: 5716\n","Epoch: [39523] Total time: 0:00:01 (0.0994 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0210 (0.0211) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39524] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0262 (0.0262) time: 0.2947 data: 0.2067 max mem: 5716\n","Epoch: [39524] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0227 (0.0233) time: 0.0964 data: 0.0174 max mem: 5716\n","Epoch: [39524] Total time: 0:00:01 (0.1006 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0227 (0.0233) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39525] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0234 (0.0234) time: 0.2840 data: 0.1945 max mem: 5716\n","Epoch: [39525] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0234 (0.0234) time: 0.0950 data: 0.0164 max mem: 5716\n","Epoch: [39525] Total time: 0:00:01 (0.1002 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0234 (0.0234) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39526] [ 0/12] eta: 0:00:06 lr: 0.000000 loss: 0.0185 (0.0185) time: 0.5113 data: 0.4237 max mem: 5716\n","Epoch: [39526] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0224 (0.0231) time: 0.1134 data: 0.0355 max mem: 5716\n","Epoch: [39526] Total time: 0:00:01 (0.1176 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0224 (0.0231) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39527] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0232 (0.0232) time: 0.2982 data: 0.1986 max mem: 5716\n","Epoch: [39527] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0240 (0.0242) time: 0.0958 data: 0.0167 max mem: 5716\n","Epoch: [39527] Total time: 0:00:01 (0.1000 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0240 (0.0242) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39528] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0230 (0.0230) time: 0.2881 data: 0.2002 max mem: 5716\n","Epoch: [39528] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0233 (0.0242) time: 0.0944 data: 0.0168 max mem: 5716\n","Epoch: [39528] Total time: 0:00:01 (0.0985 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0233 (0.0242) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39529] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0261 (0.0261) time: 0.2851 data: 0.1973 max mem: 5716\n","Epoch: [39529] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0234 (0.0241) time: 0.0942 data: 0.0166 max mem: 5716\n","Epoch: [39529] Total time: 0:00:01 (0.0983 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0234 (0.0241) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39530] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0239 (0.0239) time: 0.2973 data: 0.2092 max mem: 5716\n","Epoch: [39530] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0203 (0.0210) time: 0.0962 data: 0.0176 max mem: 5716\n","Epoch: [39530] Total time: 0:00:01 (0.1004 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0203 (0.0210) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39531] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0200 (0.0200) time: 0.2914 data: 0.1999 max mem: 5716\n","Epoch: [39531] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0200 (0.0208) time: 0.0955 data: 0.0168 max mem: 5716\n","Epoch: [39531] Total time: 0:00:01 (0.0997 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0200 (0.0208) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39532] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0181 (0.0181) time: 0.2900 data: 0.2032 max mem: 5716\n","Epoch: [39532] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0199 (0.0205) time: 0.0953 data: 0.0171 max mem: 5716\n","Epoch: [39532] Total time: 0:00:01 (0.0995 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0199 (0.0205) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39533] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0180 (0.0180) time: 0.2881 data: 0.2016 max mem: 5716\n","Epoch: [39533] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0231 (0.0232) time: 0.0949 data: 0.0169 max mem: 5716\n","Epoch: [39533] Total time: 0:00:01 (0.0989 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0231 (0.0232) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39534] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0264 (0.0264) time: 0.2838 data: 0.1942 max mem: 5716\n","Epoch: [39534] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0226 (0.0235) time: 0.0960 data: 0.0163 max mem: 5716\n","Epoch: [39534] Total time: 0:00:01 (0.1013 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0226 (0.0235) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39535] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0237 (0.0237) time: 0.2918 data: 0.1983 max mem: 5716\n","Epoch: [39535] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0237 (0.0235) time: 0.0983 data: 0.0167 max mem: 5716\n","Epoch: [39535] Total time: 0:00:01 (0.1024 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0237 (0.0235) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39536] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0223 (0.0223) time: 0.2934 data: 0.2059 max mem: 5716\n","Epoch: [39536] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0228 (0.0241) time: 0.0951 data: 0.0173 max mem: 5716\n","Epoch: [39536] Total time: 0:00:01 (0.0992 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0228 (0.0241) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39537] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0209 (0.0209) time: 0.2874 data: 0.1970 max mem: 5716\n","Epoch: [39537] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0235 (0.0242) time: 0.0947 data: 0.0166 max mem: 5716\n","Epoch: [39537] Total time: 0:00:01 (0.0988 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0235 (0.0242) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39538] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0287 (0.0287) time: 0.2865 data: 0.2014 max mem: 5716\n","Epoch: [39538] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0245 (0.0243) time: 0.0942 data: 0.0170 max mem: 5716\n","Epoch: [39538] Total time: 0:00:01 (0.0983 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0245 (0.0243) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39539] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0243 (0.0243) time: 0.2919 data: 0.1941 max mem: 5716\n","Epoch: [39539] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0205 (0.0205) time: 0.0946 data: 0.0163 max mem: 5716\n","Epoch: [39539] Total time: 0:00:01 (0.0987 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0205 (0.0205) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39540] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0247 (0.0247) time: 0.2956 data: 0.1979 max mem: 5716\n","Epoch: [39540] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0206 (0.0205) time: 0.0957 data: 0.0166 max mem: 5716\n","Epoch: [39540] Total time: 0:00:01 (0.0999 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0206 (0.0205) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39541] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0253 (0.0253) time: 0.2842 data: 0.1939 max mem: 5716\n","Epoch: [39541] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0207 (0.0208) time: 0.0950 data: 0.0163 max mem: 5716\n","Epoch: [39541] Total time: 0:00:01 (0.0991 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0207 (0.0208) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39542] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0225 (0.0225) time: 0.2857 data: 0.1939 max mem: 5716\n","Epoch: [39542] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0234 (0.0234) time: 0.0946 data: 0.0163 max mem: 5716\n","Epoch: [39542] Total time: 0:00:01 (0.0987 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0234 (0.0234) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39543] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0234 (0.0234) time: 0.2931 data: 0.1936 max mem: 5716\n","Epoch: [39543] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0230 (0.0231) time: 0.0976 data: 0.0163 max mem: 5716\n","Epoch: [39543] Total time: 0:00:01 (0.1032 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0230 (0.0231) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39544] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0217 (0.0217) time: 0.2947 data: 0.2046 max mem: 5716\n","Epoch: [39544] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0247 (0.0236) time: 0.0971 data: 0.0172 max mem: 5716\n","Epoch: [39544] Total time: 0:00:01 (0.1012 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0247 (0.0236) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39545] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0246 (0.0246) time: 0.2965 data: 0.2048 max mem: 5716\n","Epoch: [39545] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0239 (0.0245) time: 0.0956 data: 0.0172 max mem: 5716\n","Epoch: [39545] Total time: 0:00:01 (0.0997 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0239 (0.0245) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39546] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0269 (0.0269) time: 0.2847 data: 0.1973 max mem: 5716\n","Epoch: [39546] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0225 (0.0244) time: 0.0944 data: 0.0166 max mem: 5716\n","Epoch: [39546] Total time: 0:00:01 (0.0984 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0225 (0.0244) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39547] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0257 (0.0257) time: 0.2887 data: 0.1989 max mem: 5716\n","Epoch: [39547] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0236 (0.0244) time: 0.0947 data: 0.0167 max mem: 5716\n","Epoch: [39547] Total time: 0:00:01 (0.0988 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0236 (0.0244) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39548] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0177 (0.0177) time: 0.2890 data: 0.1985 max mem: 5716\n","Epoch: [39548] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0211 (0.0209) time: 0.0955 data: 0.0167 max mem: 5716\n","Epoch: [39548] Total time: 0:00:01 (0.0997 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0211 (0.0209) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39549] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0216 (0.0216) time: 0.2919 data: 0.2045 max mem: 5716\n","Epoch: [39549] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0208 (0.0211) time: 0.0955 data: 0.0172 max mem: 5716\n","Epoch: [39549] Total time: 0:00:01 (0.0996 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0208 (0.0211) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39550] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0237 (0.0237) time: 0.2953 data: 0.2077 max mem: 5716\n","Epoch: [39550] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0198 (0.0207) time: 0.0961 data: 0.0175 max mem: 5716\n","Epoch: [39550] Total time: 0:00:01 (0.1002 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0198 (0.0207) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39551] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0239 (0.0239) time: 0.2908 data: 0.2007 max mem: 5716\n","Epoch: [39551] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0232 (0.0238) time: 0.0956 data: 0.0169 max mem: 5716\n","Epoch: [39551] Total time: 0:00:01 (0.0998 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0232 (0.0238) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39552] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0270 (0.0270) time: 0.2869 data: 0.1977 max mem: 5716\n","Epoch: [39552] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0238 (0.0230) time: 0.0947 data: 0.0166 max mem: 5716\n","Epoch: [39552] Total time: 0:00:01 (0.0989 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0238 (0.0230) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39553] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0227 (0.0227) time: 0.2883 data: 0.1990 max mem: 5716\n","Epoch: [39553] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0238 (0.0235) time: 0.0961 data: 0.0167 max mem: 5716\n","Epoch: [39553] Total time: 0:00:01 (0.1001 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0238 (0.0235) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39554] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0248 (0.0248) time: 0.2896 data: 0.2017 max mem: 5716\n","Epoch: [39554] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0246 (0.0245) time: 0.0948 data: 0.0169 max mem: 5716\n","Epoch: [39554] Total time: 0:00:01 (0.0990 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0246 (0.0245) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39555] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0245 (0.0245) time: 0.2840 data: 0.1902 max mem: 5716\n","Epoch: [39555] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0245 (0.0244) time: 0.0975 data: 0.0160 max mem: 5716\n","Epoch: [39555] Total time: 0:00:01 (0.1016 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0245 (0.0244) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39556] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0206 (0.0206) time: 0.2838 data: 0.1915 max mem: 5716\n","Epoch: [39556] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0241 (0.0243) time: 0.0953 data: 0.0161 max mem: 5716\n","Epoch: [39556] Total time: 0:00:01 (0.0994 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0241 (0.0243) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39557] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0187 (0.0187) time: 0.2873 data: 0.1947 max mem: 5716\n","Epoch: [39557] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0200 (0.0207) time: 0.0960 data: 0.0164 max mem: 5716\n","Epoch: [39557] Total time: 0:00:01 (0.1002 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0200 (0.0207) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39558] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0212 (0.0212) time: 0.2774 data: 0.1874 max mem: 5716\n","Epoch: [39558] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0198 (0.0206) time: 0.0936 data: 0.0158 max mem: 5716\n","Epoch: [39558] Total time: 0:00:01 (0.0977 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0198 (0.0206) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39559] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0205 (0.0205) time: 0.2915 data: 0.2058 max mem: 5716\n","Epoch: [39559] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0205 (0.0207) time: 0.0953 data: 0.0173 max mem: 5716\n","Epoch: [39559] Total time: 0:00:01 (0.0994 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0205 (0.0207) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39560] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0248 (0.0248) time: 0.2922 data: 0.2033 max mem: 5716\n","Epoch: [39560] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0234 (0.0236) time: 0.0961 data: 0.0172 max mem: 5716\n","Epoch: [39560] Total time: 0:00:01 (0.1004 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0234 (0.0236) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39561] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0216 (0.0216) time: 0.2834 data: 0.1949 max mem: 5716\n","Epoch: [39561] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0225 (0.0232) time: 0.0949 data: 0.0164 max mem: 5716\n","Epoch: [39561] Total time: 0:00:01 (0.0990 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0225 (0.0232) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39562] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0234 (0.0234) time: 0.2949 data: 0.2072 max mem: 5716\n","Epoch: [39562] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0228 (0.0232) time: 0.0976 data: 0.0174 max mem: 5716\n","Epoch: [39562] Total time: 0:00:01 (0.1018 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0228 (0.0232) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39563] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0262 (0.0262) time: 0.2903 data: 0.2029 max mem: 5716\n","Epoch: [39563] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0236 (0.0244) time: 0.0951 data: 0.0171 max mem: 5716\n","Epoch: [39563] Total time: 0:00:01 (0.0992 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0236 (0.0244) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39564] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0253 (0.0253) time: 0.2883 data: 0.1937 max mem: 5716\n","Epoch: [39564] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0234 (0.0239) time: 0.0973 data: 0.0163 max mem: 5716\n","Epoch: [39564] Total time: 0:00:01 (0.1015 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0234 (0.0239) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39565] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0256 (0.0256) time: 0.2916 data: 0.1902 max mem: 5716\n","Epoch: [39565] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0239 (0.0241) time: 0.0964 data: 0.0160 max mem: 5716\n","Epoch: [39565] Total time: 0:00:01 (0.1005 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0239 (0.0241) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39566] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0206 (0.0206) time: 0.2875 data: 0.2012 max mem: 5716\n","Epoch: [39566] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0207 (0.0207) time: 0.0952 data: 0.0169 max mem: 5716\n","Epoch: [39566] Total time: 0:00:01 (0.0994 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0207 (0.0207) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39567] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0208 (0.0208) time: 0.2914 data: 0.2013 max mem: 5716\n","Epoch: [39567] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0208 (0.0208) time: 0.0954 data: 0.0169 max mem: 5716\n","Epoch: [39567] Total time: 0:00:01 (0.0996 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0208 (0.0208) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39568] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0187 (0.0187) time: 0.2876 data: 0.1984 max mem: 5716\n","Epoch: [39568] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0201 (0.0211) time: 0.0955 data: 0.0167 max mem: 5716\n","Epoch: [39568] Total time: 0:00:01 (0.0997 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0201 (0.0211) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39569] [ 0/12] eta: 0:00:06 lr: 0.000000 loss: 0.0230 (0.0230) time: 0.5141 data: 0.4305 max mem: 5716\n","Epoch: [39569] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0222 (0.0232) time: 0.1147 data: 0.0360 max mem: 5716\n","Epoch: [39569] Total time: 0:00:01 (0.1187 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0222 (0.0232) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39570] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0233 (0.0233) time: 0.2943 data: 0.1944 max mem: 5716\n","Epoch: [39570] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0233 (0.0235) time: 0.0959 data: 0.0164 max mem: 5716\n","Epoch: [39570] Total time: 0:00:01 (0.1000 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0233 (0.0235) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39571] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0243 (0.0243) time: 0.2841 data: 0.1961 max mem: 5716\n","Epoch: [39571] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0242 (0.0232) time: 0.0943 data: 0.0165 max mem: 5716\n","Epoch: [39571] Total time: 0:00:01 (0.0983 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0242 (0.0232) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39572] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0276 (0.0276) time: 0.2859 data: 0.1976 max mem: 5716\n","Epoch: [39572] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0238 (0.0243) time: 0.0941 data: 0.0166 max mem: 5716\n","Epoch: [39572] Total time: 0:00:01 (0.0983 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0238 (0.0243) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39573] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0262 (0.0262) time: 0.2899 data: 0.2045 max mem: 5716\n","Epoch: [39573] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0233 (0.0243) time: 0.0947 data: 0.0172 max mem: 5716\n","Epoch: [39573] Total time: 0:00:01 (0.0988 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0233 (0.0243) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39574] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0204 (0.0204) time: 0.2975 data: 0.2106 max mem: 5716\n","Epoch: [39574] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0251 (0.0245) time: 0.0960 data: 0.0177 max mem: 5716\n","Epoch: [39574] Total time: 0:00:01 (0.1002 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0251 (0.0245) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39575] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0185 (0.0185) time: 0.2838 data: 0.1953 max mem: 5716\n","Epoch: [39575] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0199 (0.0212) time: 0.0942 data: 0.0164 max mem: 5716\n","Epoch: [39575] Total time: 0:00:01 (0.0985 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0199 (0.0212) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39576] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0198 (0.0198) time: 0.2831 data: 0.1942 max mem: 5716\n","Epoch: [39576] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0196 (0.0204) time: 0.0945 data: 0.0163 max mem: 5716\n","Epoch: [39576] Total time: 0:00:01 (0.0987 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0196 (0.0204) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39577] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0169 (0.0169) time: 0.2943 data: 0.1956 max mem: 5716\n","Epoch: [39577] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0190 (0.0208) time: 0.0952 data: 0.0164 max mem: 5716\n","Epoch: [39577] Total time: 0:00:01 (0.0993 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0190 (0.0208) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39578] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0214 (0.0214) time: 0.3043 data: 0.2075 max mem: 5716\n","Epoch: [39578] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0231 (0.0233) time: 0.0995 data: 0.0174 max mem: 5716\n","Epoch: [39578] Total time: 0:00:01 (0.1036 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0231 (0.0233) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39579] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0219 (0.0219) time: 0.2877 data: 0.1989 max mem: 5716\n","Epoch: [39579] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0223 (0.0231) time: 0.0950 data: 0.0167 max mem: 5716\n","Epoch: [39579] Total time: 0:00:01 (0.0991 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0223 (0.0231) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39580] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0247 (0.0247) time: 0.2950 data: 0.2062 max mem: 5716\n","Epoch: [39580] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0243 (0.0235) time: 0.0962 data: 0.0174 max mem: 5716\n","Epoch: [39580] Total time: 0:00:01 (0.1003 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0243 (0.0235) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39581] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0270 (0.0270) time: 0.2921 data: 0.2024 max mem: 5716\n","Epoch: [39581] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0237 (0.0240) time: 0.0969 data: 0.0170 max mem: 5716\n","Epoch: [39581] Total time: 0:00:01 (0.1010 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0237 (0.0240) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39582] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0271 (0.0271) time: 0.3071 data: 0.2090 max mem: 5716\n","Epoch: [39582] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0234 (0.0243) time: 0.0965 data: 0.0176 max mem: 5716\n","Epoch: [39582] Total time: 0:00:01 (0.1007 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0234 (0.0243) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39583] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0248 (0.0248) time: 0.2890 data: 0.1989 max mem: 5716\n","Epoch: [39583] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0243 (0.0245) time: 0.0951 data: 0.0167 max mem: 5716\n","Epoch: [39583] Total time: 0:00:01 (0.0992 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0243 (0.0245) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39584] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0196 (0.0196) time: 0.2842 data: 0.1917 max mem: 5716\n","Epoch: [39584] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0191 (0.0207) time: 0.0977 data: 0.0161 max mem: 5716\n","Epoch: [39584] Total time: 0:00:01 (0.1018 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0191 (0.0207) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39585] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0224 (0.0224) time: 0.2832 data: 0.1941 max mem: 5716\n","Epoch: [39585] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0202 (0.0210) time: 0.0948 data: 0.0163 max mem: 5716\n","Epoch: [39585] Total time: 0:00:01 (0.0989 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0202 (0.0210) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39586] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0197 (0.0197) time: 0.2905 data: 0.2014 max mem: 5716\n","Epoch: [39586] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0198 (0.0207) time: 0.0952 data: 0.0169 max mem: 5716\n","Epoch: [39586] Total time: 0:00:01 (0.0993 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0198 (0.0207) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39587] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0241 (0.0241) time: 0.2911 data: 0.2027 max mem: 5716\n","Epoch: [39587] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0218 (0.0232) time: 0.0956 data: 0.0171 max mem: 5716\n","Epoch: [39587] Total time: 0:00:01 (0.0996 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0218 (0.0232) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39588] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0241 (0.0241) time: 0.2816 data: 0.1909 max mem: 5716\n","Epoch: [39588] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0231 (0.0232) time: 0.0943 data: 0.0161 max mem: 5716\n","Epoch: [39588] Total time: 0:00:01 (0.0983 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0231 (0.0232) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39589] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0244 (0.0244) time: 0.2797 data: 0.1893 max mem: 5716\n","Epoch: [39589] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0230 (0.0233) time: 0.0941 data: 0.0159 max mem: 5716\n","Epoch: [39589] Total time: 0:00:01 (0.0981 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0230 (0.0233) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39590] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0282 (0.0282) time: 0.2860 data: 0.1960 max mem: 5716\n","Epoch: [39590] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0247 (0.0247) time: 0.0950 data: 0.0165 max mem: 5716\n","Epoch: [39590] Total time: 0:00:01 (0.0990 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0247 (0.0247) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39591] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0233 (0.0233) time: 0.3078 data: 0.1974 max mem: 5716\n","Epoch: [39591] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0233 (0.0241) time: 0.0962 data: 0.0166 max mem: 5716\n","Epoch: [39591] Total time: 0:00:01 (0.1003 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0233 (0.0241) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39592] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0244 (0.0244) time: 0.2874 data: 0.1983 max mem: 5716\n","Epoch: [39592] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0242 (0.0240) time: 0.0953 data: 0.0167 max mem: 5716\n","Epoch: [39592] Total time: 0:00:01 (0.0995 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0242 (0.0240) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39593] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0245 (0.0245) time: 0.2864 data: 0.1978 max mem: 5716\n","Epoch: [39593] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0185 (0.0204) time: 0.0950 data: 0.0166 max mem: 5716\n","Epoch: [39593] Total time: 0:00:01 (0.0992 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0185 (0.0204) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39594] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0203 (0.0203) time: 0.2904 data: 0.1999 max mem: 5716\n","Epoch: [39594] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0203 (0.0208) time: 0.0969 data: 0.0168 max mem: 5716\n","Epoch: [39594] Total time: 0:00:01 (0.1010 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0203 (0.0208) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39595] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0265 (0.0265) time: 0.2871 data: 0.1958 max mem: 5716\n","Epoch: [39595] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0209 (0.0208) time: 0.0955 data: 0.0165 max mem: 5716\n","Epoch: [39595] Total time: 0:00:01 (0.0997 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0209 (0.0208) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39596] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0241 (0.0241) time: 0.2910 data: 0.2016 max mem: 5716\n","Epoch: [39596] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0237 (0.0233) time: 0.0953 data: 0.0169 max mem: 5716\n","Epoch: [39596] Total time: 0:00:01 (0.0994 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0237 (0.0233) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39597] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0270 (0.0270) time: 0.2857 data: 0.1940 max mem: 5716\n","Epoch: [39597] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0226 (0.0231) time: 0.0946 data: 0.0163 max mem: 5716\n","Epoch: [39597] Total time: 0:00:01 (0.0987 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0226 (0.0231) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39598] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0198 (0.0198) time: 0.2991 data: 0.2087 max mem: 5716\n","Epoch: [39598] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0229 (0.0233) time: 0.0964 data: 0.0176 max mem: 5716\n","Epoch: [39598] Total time: 0:00:01 (0.1005 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0229 (0.0233) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39599] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0209 (0.0209) time: 0.2880 data: 0.2009 max mem: 5716\n","Epoch: [39599] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0238 (0.0243) time: 0.0945 data: 0.0169 max mem: 5716\n","Epoch: [39599] Total time: 0:00:01 (0.0986 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0238 (0.0243) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39600] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0286 (0.0286) time: 0.2891 data: 0.1986 max mem: 5716\n","Epoch: [39600] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0236 (0.0245) time: 0.0949 data: 0.0167 max mem: 5716\n","Epoch: [39600] Total time: 0:00:01 (0.0990 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0236 (0.0245) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39601] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0267 (0.0267) time: 0.2831 data: 0.1938 max mem: 5716\n","Epoch: [39601] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0244 (0.0244) time: 0.0956 data: 0.0163 max mem: 5716\n","Epoch: [39601] Total time: 0:00:01 (0.0998 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0244 (0.0244) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39602] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0204 (0.0204) time: 0.2934 data: 0.2032 max mem: 5716\n","Epoch: [39602] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0214 (0.0209) time: 0.0958 data: 0.0171 max mem: 5716\n","Epoch: [39602] Total time: 0:00:01 (0.0999 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0214 (0.0209) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39603] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0198 (0.0198) time: 0.2834 data: 0.1949 max mem: 5716\n","Epoch: [39603] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0198 (0.0206) time: 0.0944 data: 0.0164 max mem: 5716\n","Epoch: [39603] Total time: 0:00:01 (0.0985 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0198 (0.0206) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39604] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0172 (0.0172) time: 0.2916 data: 0.2015 max mem: 5716\n","Epoch: [39604] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0199 (0.0209) time: 0.0980 data: 0.0169 max mem: 5716\n","Epoch: [39604] Total time: 0:00:01 (0.1022 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0199 (0.0209) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39605] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0197 (0.0197) time: 0.2956 data: 0.1988 max mem: 5716\n","Epoch: [39605] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0232 (0.0231) time: 0.0960 data: 0.0167 max mem: 5716\n","Epoch: [39605] Total time: 0:00:01 (0.1002 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0232 (0.0231) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39606] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0261 (0.0261) time: 0.3007 data: 0.2129 max mem: 5716\n","Epoch: [39606] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0234 (0.0234) time: 0.0966 data: 0.0179 max mem: 5716\n","Epoch: [39606] Total time: 0:00:01 (0.1008 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0234 (0.0234) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39607] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0219 (0.0219) time: 0.2966 data: 0.2029 max mem: 5716\n","Epoch: [39607] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0219 (0.0234) time: 0.0957 data: 0.0171 max mem: 5716\n","Epoch: [39607] Total time: 0:00:01 (0.0999 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0219 (0.0234) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39608] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0273 (0.0273) time: 0.2901 data: 0.2032 max mem: 5716\n","Epoch: [39608] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0238 (0.0239) time: 0.0950 data: 0.0171 max mem: 5716\n","Epoch: [39608] Total time: 0:00:01 (0.0992 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0238 (0.0239) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39609] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0259 (0.0259) time: 0.2975 data: 0.2095 max mem: 5716\n","Epoch: [39609] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0236 (0.0244) time: 0.0954 data: 0.0176 max mem: 5716\n","Epoch: [39609] Total time: 0:00:01 (0.0996 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0236 (0.0244) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39610] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0271 (0.0271) time: 0.2911 data: 0.2041 max mem: 5716\n","Epoch: [39610] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0242 (0.0247) time: 0.0960 data: 0.0172 max mem: 5716\n","Epoch: [39610] Total time: 0:00:01 (0.1001 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0242 (0.0247) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39611] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0240 (0.0240) time: 0.2872 data: 0.1974 max mem: 5716\n","Epoch: [39611] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0201 (0.0206) time: 0.0953 data: 0.0166 max mem: 5716\n","Epoch: [39611] Total time: 0:00:01 (0.0997 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0201 (0.0206) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39612] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0184 (0.0184) time: 0.2899 data: 0.1986 max mem: 5716\n","Epoch: [39612] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0196 (0.0206) time: 0.0955 data: 0.0167 max mem: 5716\n","Epoch: [39612] Total time: 0:00:01 (0.0997 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0196 (0.0206) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39613] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0230 (0.0230) time: 0.2878 data: 0.1984 max mem: 5716\n","Epoch: [39613] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0217 (0.0207) time: 0.0957 data: 0.0167 max mem: 5716\n","Epoch: [39613] Total time: 0:00:01 (0.0998 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0217 (0.0207) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39614] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0250 (0.0250) time: 0.2950 data: 0.2085 max mem: 5716\n","Epoch: [39614] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0222 (0.0232) time: 0.0951 data: 0.0175 max mem: 5716\n","Epoch: [39614] Total time: 0:00:01 (0.0993 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0222 (0.0232) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39615] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0260 (0.0260) time: 0.2852 data: 0.1964 max mem: 5716\n","Epoch: [39615] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0240 (0.0235) time: 0.0946 data: 0.0165 max mem: 5716\n","Epoch: [39615] Total time: 0:00:01 (0.0987 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0240 (0.0235) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39616] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0234 (0.0234) time: 0.2976 data: 0.2105 max mem: 5716\n","Epoch: [39616] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0233 (0.0231) time: 0.0958 data: 0.0177 max mem: 5716\n","Epoch: [39616] Total time: 0:00:01 (0.1000 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0233 (0.0231) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39617] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0255 (0.0255) time: 0.2972 data: 0.1945 max mem: 5716\n","Epoch: [39617] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0237 (0.0243) time: 0.0959 data: 0.0164 max mem: 5716\n","Epoch: [39617] Total time: 0:00:01 (0.1001 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0237 (0.0243) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39618] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0233 (0.0233) time: 0.2837 data: 0.1935 max mem: 5716\n","Epoch: [39618] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0237 (0.0240) time: 0.0956 data: 0.0163 max mem: 5716\n","Epoch: [39618] Total time: 0:00:01 (0.0998 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0237 (0.0240) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39619] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0242 (0.0242) time: 0.2912 data: 0.1983 max mem: 5716\n","Epoch: [39619] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0234 (0.0246) time: 0.0960 data: 0.0167 max mem: 5716\n","Epoch: [39619] Total time: 0:00:01 (0.1002 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0234 (0.0246) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39620] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0295 (0.0295) time: 0.3007 data: 0.2130 max mem: 5716\n","Epoch: [39620] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0202 (0.0210) time: 0.0969 data: 0.0179 max mem: 5716\n","Epoch: [39620] Total time: 0:00:01 (0.1014 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0202 (0.0210) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39621] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0230 (0.0230) time: 0.2875 data: 0.1997 max mem: 5716\n","Epoch: [39621] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0196 (0.0207) time: 0.0967 data: 0.0168 max mem: 5716\n","Epoch: [39621] Total time: 0:00:01 (0.1011 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0196 (0.0207) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39622] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0261 (0.0261) time: 0.2829 data: 0.1915 max mem: 5716\n","Epoch: [39622] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0196 (0.0207) time: 0.0947 data: 0.0161 max mem: 5716\n","Epoch: [39622] Total time: 0:00:01 (0.0989 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0196 (0.0207) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39623] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0208 (0.0208) time: 0.2801 data: 0.1887 max mem: 5716\n","Epoch: [39623] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0223 (0.0232) time: 0.0948 data: 0.0159 max mem: 5716\n","Epoch: [39623] Total time: 0:00:01 (0.0988 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0223 (0.0232) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39624] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0253 (0.0253) time: 0.3055 data: 0.2045 max mem: 5716\n","Epoch: [39624] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0225 (0.0233) time: 0.0959 data: 0.0172 max mem: 5716\n","Epoch: [39624] Total time: 0:00:01 (0.1000 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0225 (0.0233) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39625] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0207 (0.0207) time: 0.2877 data: 0.2003 max mem: 5716\n","Epoch: [39625] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0230 (0.0232) time: 0.0950 data: 0.0168 max mem: 5716\n","Epoch: [39625] Total time: 0:00:01 (0.0991 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0230 (0.0232) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39626] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0244 (0.0244) time: 0.2902 data: 0.2026 max mem: 5716\n","Epoch: [39626] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0238 (0.0242) time: 0.0992 data: 0.0171 max mem: 5716\n","Epoch: [39626] Total time: 0:00:01 (0.1033 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0238 (0.0242) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39627] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0207 (0.0207) time: 0.2883 data: 0.1990 max mem: 5716\n","Epoch: [39627] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0241 (0.0243) time: 0.0950 data: 0.0167 max mem: 5716\n","Epoch: [39627] Total time: 0:00:01 (0.0992 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0241 (0.0243) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39628] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0243 (0.0243) time: 0.2917 data: 0.1990 max mem: 5716\n","Epoch: [39628] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0251 (0.0242) time: 0.0982 data: 0.0167 max mem: 5716\n","Epoch: [39628] Total time: 0:00:01 (0.1024 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0251 (0.0242) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39629] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0182 (0.0182) time: 0.2978 data: 0.2100 max mem: 5716\n","Epoch: [39629] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0208 (0.0209) time: 0.0963 data: 0.0177 max mem: 5716\n","Epoch: [39629] Total time: 0:00:01 (0.1004 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0208 (0.0209) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39630] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0221 (0.0221) time: 0.2961 data: 0.2082 max mem: 5716\n","Epoch: [39630] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0210 (0.0209) time: 0.0961 data: 0.0175 max mem: 5716\n","Epoch: [39630] Total time: 0:00:01 (0.1002 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0210 (0.0209) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39631] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0152 (0.0152) time: 0.2833 data: 0.1930 max mem: 5716\n","Epoch: [39631] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0203 (0.0208) time: 0.0947 data: 0.0162 max mem: 5716\n","Epoch: [39631] Total time: 0:00:01 (0.0988 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0203 (0.0208) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39632] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0238 (0.0238) time: 0.2972 data: 0.1995 max mem: 5716\n","Epoch: [39632] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0232 (0.0232) time: 0.0958 data: 0.0168 max mem: 5716\n","Epoch: [39632] Total time: 0:00:01 (0.0999 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0232 (0.0232) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39633] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0192 (0.0192) time: 0.2866 data: 0.1957 max mem: 5716\n","Epoch: [39633] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0238 (0.0235) time: 0.0963 data: 0.0165 max mem: 5716\n","Epoch: [39633] Total time: 0:00:01 (0.1004 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0238 (0.0235) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39634] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0264 (0.0264) time: 0.2830 data: 0.1913 max mem: 5716\n","Epoch: [39634] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0231 (0.0229) time: 0.0947 data: 0.0161 max mem: 5716\n","Epoch: [39634] Total time: 0:00:01 (0.0988 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0231 (0.0229) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39635] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0253 (0.0253) time: 0.2925 data: 0.1969 max mem: 5716\n","Epoch: [39635] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0226 (0.0243) time: 0.0949 data: 0.0166 max mem: 5716\n","Epoch: [39635] Total time: 0:00:01 (0.1004 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0226 (0.0243) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39636] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0234 (0.0234) time: 0.2940 data: 0.2061 max mem: 5716\n","Epoch: [39636] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0230 (0.0238) time: 0.0962 data: 0.0173 max mem: 5716\n","Epoch: [39636] Total time: 0:00:01 (0.1003 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0230 (0.0238) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39637] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0254 (0.0254) time: 0.3015 data: 0.2018 max mem: 5716\n","Epoch: [39637] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0234 (0.0244) time: 0.0958 data: 0.0170 max mem: 5716\n","Epoch: [39637] Total time: 0:00:01 (0.1000 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0234 (0.0244) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39638] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0231 (0.0231) time: 0.3016 data: 0.2042 max mem: 5716\n","Epoch: [39638] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0189 (0.0208) time: 0.0976 data: 0.0172 max mem: 5716\n","Epoch: [39638] Total time: 0:00:01 (0.1017 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0189 (0.0208) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39639] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0163 (0.0163) time: 0.3245 data: 0.2157 max mem: 5716\n","Epoch: [39639] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0198 (0.0206) time: 0.0987 data: 0.0182 max mem: 5716\n","Epoch: [39639] Total time: 0:00:01 (0.1029 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0198 (0.0206) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39640] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0152 (0.0152) time: 0.2893 data: 0.1987 max mem: 5716\n","Epoch: [39640] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0206 (0.0205) time: 0.0958 data: 0.0167 max mem: 5716\n","Epoch: [39640] Total time: 0:00:01 (0.1001 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0206 (0.0205) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39641] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0207 (0.0207) time: 0.2865 data: 0.1971 max mem: 5716\n","Epoch: [39641] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0227 (0.0231) time: 0.0947 data: 0.0166 max mem: 5716\n","Epoch: [39641] Total time: 0:00:01 (0.0989 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0227 (0.0231) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39642] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0199 (0.0199) time: 0.2983 data: 0.2084 max mem: 5716\n","Epoch: [39642] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0230 (0.0233) time: 0.0959 data: 0.0175 max mem: 5716\n","Epoch: [39642] Total time: 0:00:01 (0.1001 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0230 (0.0233) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39643] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0214 (0.0214) time: 0.2844 data: 0.1968 max mem: 5716\n","Epoch: [39643] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0219 (0.0232) time: 0.0955 data: 0.0166 max mem: 5716\n","Epoch: [39643] Total time: 0:00:01 (0.0996 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0219 (0.0232) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39644] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0250 (0.0250) time: 0.2824 data: 0.1912 max mem: 5716\n","Epoch: [39644] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0239 (0.0238) time: 0.0949 data: 0.0161 max mem: 5716\n","Epoch: [39644] Total time: 0:00:01 (0.0990 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0239 (0.0238) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39645] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0225 (0.0225) time: 0.2914 data: 0.1978 max mem: 5716\n","Epoch: [39645] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0234 (0.0244) time: 0.0954 data: 0.0167 max mem: 5716\n","Epoch: [39645] Total time: 0:00:01 (0.1009 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0234 (0.0244) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39646] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0219 (0.0219) time: 0.2968 data: 0.1973 max mem: 5716\n","Epoch: [39646] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0235 (0.0241) time: 0.0953 data: 0.0166 max mem: 5716\n","Epoch: [39646] Total time: 0:00:01 (0.0994 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0235 (0.0241) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39647] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0198 (0.0198) time: 0.2932 data: 0.2046 max mem: 5716\n","Epoch: [39647] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0198 (0.0207) time: 0.0962 data: 0.0172 max mem: 5716\n","Epoch: [39647] Total time: 0:00:01 (0.1004 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0198 (0.0207) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39648] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0211 (0.0211) time: 0.2938 data: 0.2043 max mem: 5716\n","Epoch: [39648] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0202 (0.0207) time: 0.0953 data: 0.0172 max mem: 5716\n","Epoch: [39648] Total time: 0:00:01 (0.0995 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0202 (0.0207) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39649] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0151 (0.0151) time: 0.2935 data: 0.2056 max mem: 5716\n","Epoch: [39649] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0210 (0.0206) time: 0.0954 data: 0.0173 max mem: 5716\n","Epoch: [39649] Total time: 0:00:01 (0.0995 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0210 (0.0206) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39650] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0208 (0.0208) time: 0.2799 data: 0.1897 max mem: 5716\n","Epoch: [39650] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0229 (0.0230) time: 0.0939 data: 0.0160 max mem: 5716\n","Epoch: [39650] Total time: 0:00:01 (0.0979 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0229 (0.0230) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39651] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0262 (0.0262) time: 0.2831 data: 0.1922 max mem: 5716\n","Epoch: [39651] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0232 (0.0234) time: 0.0976 data: 0.0162 max mem: 5716\n","Epoch: [39651] Total time: 0:00:01 (0.1018 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0232 (0.0234) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39652] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0211 (0.0211) time: 0.2969 data: 0.1957 max mem: 5716\n","Epoch: [39652] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0235 (0.0232) time: 0.0959 data: 0.0165 max mem: 5716\n","Epoch: [39652] Total time: 0:00:01 (0.1000 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0235 (0.0232) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39653] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0256 (0.0256) time: 0.2956 data: 0.2068 max mem: 5716\n","Epoch: [39653] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0237 (0.0244) time: 0.0958 data: 0.0174 max mem: 5716\n","Epoch: [39653] Total time: 0:00:01 (0.1000 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0237 (0.0244) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39654] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0228 (0.0228) time: 0.2945 data: 0.2054 max mem: 5716\n","Epoch: [39654] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0234 (0.0241) time: 0.0954 data: 0.0173 max mem: 5716\n","Epoch: [39654] Total time: 0:00:01 (0.0995 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0234 (0.0241) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39655] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0211 (0.0211) time: 0.2864 data: 0.1937 max mem: 5716\n","Epoch: [39655] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0247 (0.0243) time: 0.0973 data: 0.0163 max mem: 5716\n","Epoch: [39655] Total time: 0:00:01 (0.1014 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0247 (0.0243) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39656] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0185 (0.0185) time: 0.2887 data: 0.2009 max mem: 5716\n","Epoch: [39656] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0195 (0.0209) time: 0.0951 data: 0.0169 max mem: 5716\n","Epoch: [39656] Total time: 0:00:01 (0.0991 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0195 (0.0209) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39657] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0228 (0.0228) time: 0.3013 data: 0.2102 max mem: 5716\n","Epoch: [39657] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0203 (0.0206) time: 0.0972 data: 0.0177 max mem: 5716\n","Epoch: [39657] Total time: 0:00:01 (0.1014 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0203 (0.0206) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39658] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0188 (0.0188) time: 0.2865 data: 0.1972 max mem: 5716\n","Epoch: [39658] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0202 (0.0203) time: 0.0955 data: 0.0166 max mem: 5716\n","Epoch: [39658] Total time: 0:00:01 (0.0996 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0202 (0.0203) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39659] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0215 (0.0215) time: 0.3044 data: 0.2059 max mem: 5716\n","Epoch: [39659] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0238 (0.0232) time: 0.0969 data: 0.0173 max mem: 5716\n","Epoch: [39659] Total time: 0:00:01 (0.1010 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0238 (0.0232) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39660] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0269 (0.0269) time: 0.2952 data: 0.2074 max mem: 5716\n","Epoch: [39660] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0232 (0.0234) time: 0.0959 data: 0.0174 max mem: 5716\n","Epoch: [39660] Total time: 0:00:01 (0.1000 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0232 (0.0234) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39661] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0208 (0.0208) time: 0.2886 data: 0.1973 max mem: 5716\n","Epoch: [39661] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0224 (0.0231) time: 0.0960 data: 0.0166 max mem: 5716\n","Epoch: [39661] Total time: 0:00:01 (0.1001 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0224 (0.0231) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39662] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0318 (0.0318) time: 0.3002 data: 0.2118 max mem: 5716\n","Epoch: [39662] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0225 (0.0244) time: 0.0973 data: 0.0178 max mem: 5716\n","Epoch: [39662] Total time: 0:00:01 (0.1014 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0225 (0.0244) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39663] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0328 (0.0328) time: 0.2959 data: 0.2076 max mem: 5716\n","Epoch: [39663] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0218 (0.0245) time: 0.0962 data: 0.0175 max mem: 5716\n","Epoch: [39663] Total time: 0:00:01 (0.1014 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0218 (0.0245) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39664] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0231 (0.0231) time: 0.2967 data: 0.2074 max mem: 5716\n","Epoch: [39664] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0233 (0.0242) time: 0.0996 data: 0.0175 max mem: 5716\n","Epoch: [39664] Total time: 0:00:01 (0.1038 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0233 (0.0242) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39665] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0241 (0.0241) time: 0.2888 data: 0.1994 max mem: 5716\n","Epoch: [39665] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0198 (0.0206) time: 0.0953 data: 0.0168 max mem: 5716\n","Epoch: [39665] Total time: 0:00:01 (0.0995 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0198 (0.0206) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39666] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0229 (0.0229) time: 0.2893 data: 0.2014 max mem: 5716\n","Epoch: [39666] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0200 (0.0206) time: 0.0949 data: 0.0169 max mem: 5716\n","Epoch: [39666] Total time: 0:00:01 (0.0990 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0200 (0.0206) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39667] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0181 (0.0181) time: 0.2891 data: 0.1985 max mem: 5716\n","Epoch: [39667] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0207 (0.0211) time: 0.0948 data: 0.0167 max mem: 5716\n","Epoch: [39667] Total time: 0:00:01 (0.0990 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0207 (0.0211) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39668] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0222 (0.0222) time: 0.2832 data: 0.1941 max mem: 5716\n","Epoch: [39668] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0230 (0.0233) time: 0.0941 data: 0.0163 max mem: 5716\n","Epoch: [39668] Total time: 0:00:01 (0.0981 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0230 (0.0233) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39669] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0253 (0.0253) time: 0.2909 data: 0.2031 max mem: 5716\n","Epoch: [39669] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0229 (0.0232) time: 0.0951 data: 0.0171 max mem: 5716\n","Epoch: [39669] Total time: 0:00:01 (0.0992 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0229 (0.0232) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39670] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0275 (0.0275) time: 0.2938 data: 0.2068 max mem: 5716\n","Epoch: [39670] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0233 (0.0235) time: 0.0954 data: 0.0174 max mem: 5716\n","Epoch: [39670] Total time: 0:00:01 (0.0995 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0233 (0.0235) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39671] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0239 (0.0239) time: 0.2961 data: 0.2063 max mem: 5716\n","Epoch: [39671] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0246 (0.0245) time: 0.0964 data: 0.0174 max mem: 5716\n","Epoch: [39671] Total time: 0:00:01 (0.1005 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0246 (0.0245) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39672] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0221 (0.0221) time: 0.2939 data: 0.2071 max mem: 5716\n","Epoch: [39672] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0223 (0.0241) time: 0.0958 data: 0.0174 max mem: 5716\n","Epoch: [39672] Total time: 0:00:01 (0.0999 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0223 (0.0241) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39673] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0273 (0.0273) time: 0.2889 data: 0.1962 max mem: 5716\n","Epoch: [39673] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0247 (0.0243) time: 0.0988 data: 0.0165 max mem: 5716\n","Epoch: [39673] Total time: 0:00:01 (0.1029 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0247 (0.0243) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39674] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0214 (0.0214) time: 0.2893 data: 0.1971 max mem: 5716\n","Epoch: [39674] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0202 (0.0209) time: 0.0972 data: 0.0166 max mem: 5716\n","Epoch: [39674] Total time: 0:00:01 (0.1014 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0202 (0.0209) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39675] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0196 (0.0196) time: 0.2946 data: 0.2033 max mem: 5716\n","Epoch: [39675] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0197 (0.0204) time: 0.0980 data: 0.0171 max mem: 5716\n","Epoch: [39675] Total time: 0:00:01 (0.1021 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0197 (0.0204) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39676] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0230 (0.0230) time: 0.2895 data: 0.1994 max mem: 5716\n","Epoch: [39676] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0212 (0.0208) time: 0.0964 data: 0.0168 max mem: 5716\n","Epoch: [39676] Total time: 0:00:01 (0.1006 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0212 (0.0208) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39677] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0214 (0.0214) time: 0.2938 data: 0.2041 max mem: 5716\n","Epoch: [39677] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0230 (0.0233) time: 0.0961 data: 0.0171 max mem: 5716\n","Epoch: [39677] Total time: 0:00:01 (0.1002 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0230 (0.0233) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39678] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0255 (0.0255) time: 0.2969 data: 0.2083 max mem: 5716\n","Epoch: [39678] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0229 (0.0232) time: 0.0955 data: 0.0175 max mem: 5716\n","Epoch: [39678] Total time: 0:00:01 (0.0997 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0229 (0.0232) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39679] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0182 (0.0182) time: 0.2844 data: 0.1941 max mem: 5716\n","Epoch: [39679] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0226 (0.0230) time: 0.0951 data: 0.0164 max mem: 5716\n","Epoch: [39679] Total time: 0:00:01 (0.0993 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0226 (0.0230) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39680] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0221 (0.0221) time: 0.2957 data: 0.2081 max mem: 5716\n","Epoch: [39680] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0231 (0.0241) time: 0.0955 data: 0.0175 max mem: 5716\n","Epoch: [39680] Total time: 0:00:01 (0.0997 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0231 (0.0241) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39681] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0253 (0.0253) time: 0.2909 data: 0.2046 max mem: 5716\n","Epoch: [39681] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0242 (0.0244) time: 0.0985 data: 0.0172 max mem: 5716\n","Epoch: [39681] Total time: 0:00:01 (0.1026 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0242 (0.0244) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39682] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0238 (0.0238) time: 0.2903 data: 0.2036 max mem: 5716\n","Epoch: [39682] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0238 (0.0244) time: 0.0951 data: 0.0171 max mem: 5716\n","Epoch: [39682] Total time: 0:00:01 (0.0993 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0238 (0.0244) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39683] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0228 (0.0228) time: 0.2904 data: 0.2025 max mem: 5716\n","Epoch: [39683] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0194 (0.0209) time: 0.0947 data: 0.0170 max mem: 5716\n","Epoch: [39683] Total time: 0:00:01 (0.0988 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0194 (0.0209) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39684] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0270 (0.0270) time: 0.2939 data: 0.2055 max mem: 5716\n","Epoch: [39684] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0195 (0.0208) time: 0.0954 data: 0.0173 max mem: 5716\n","Epoch: [39684] Total time: 0:00:01 (0.0996 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0195 (0.0208) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39685] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0162 (0.0162) time: 0.2894 data: 0.2038 max mem: 5716\n","Epoch: [39685] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0197 (0.0209) time: 0.0947 data: 0.0171 max mem: 5716\n","Epoch: [39685] Total time: 0:00:01 (0.0988 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0197 (0.0209) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39686] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0236 (0.0236) time: 0.2886 data: 0.1974 max mem: 5716\n","Epoch: [39686] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0233 (0.0234) time: 0.0952 data: 0.0166 max mem: 5716\n","Epoch: [39686] Total time: 0:00:01 (0.0992 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0233 (0.0234) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39687] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0247 (0.0247) time: 0.2904 data: 0.2008 max mem: 5716\n","Epoch: [39687] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0229 (0.0233) time: 0.0952 data: 0.0169 max mem: 5716\n","Epoch: [39687] Total time: 0:00:01 (0.0995 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0229 (0.0233) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39688] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0302 (0.0302) time: 0.2967 data: 0.2059 max mem: 5716\n","Epoch: [39688] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0221 (0.0235) time: 0.0965 data: 0.0173 max mem: 5716\n","Epoch: [39688] Total time: 0:00:01 (0.1016 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0221 (0.0235) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39689] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0205 (0.0205) time: 0.2990 data: 0.2124 max mem: 5716\n","Epoch: [39689] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0246 (0.0240) time: 0.0959 data: 0.0179 max mem: 5716\n","Epoch: [39689] Total time: 0:00:01 (0.1001 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0246 (0.0240) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39690] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0227 (0.0227) time: 0.2829 data: 0.1939 max mem: 5716\n","Epoch: [39690] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0242 (0.0239) time: 0.0947 data: 0.0163 max mem: 5716\n","Epoch: [39690] Total time: 0:00:01 (0.0990 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0242 (0.0239) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39691] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0229 (0.0229) time: 0.2840 data: 0.1935 max mem: 5716\n","Epoch: [39691] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0231 (0.0245) time: 0.0943 data: 0.0163 max mem: 5716\n","Epoch: [39691] Total time: 0:00:01 (0.0984 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0231 (0.0245) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39692] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0224 (0.0224) time: 0.2939 data: 0.2021 max mem: 5716\n","Epoch: [39692] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0204 (0.0208) time: 0.0954 data: 0.0170 max mem: 5716\n","Epoch: [39692] Total time: 0:00:01 (0.0996 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0204 (0.0208) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39693] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0188 (0.0188) time: 0.2904 data: 0.2037 max mem: 5716\n","Epoch: [39693] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0198 (0.0209) time: 0.0955 data: 0.0171 max mem: 5716\n","Epoch: [39693] Total time: 0:00:01 (0.0996 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0198 (0.0209) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39694] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0181 (0.0181) time: 0.2954 data: 0.1961 max mem: 5716\n","Epoch: [39694] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0205 (0.0207) time: 0.0986 data: 0.0165 max mem: 5716\n","Epoch: [39694] Total time: 0:00:01 (0.1027 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0205 (0.0207) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39695] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0234 (0.0234) time: 0.2892 data: 0.1948 max mem: 5716\n","Epoch: [39695] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0234 (0.0231) time: 0.0964 data: 0.0164 max mem: 5716\n","Epoch: [39695] Total time: 0:00:01 (0.1005 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0234 (0.0231) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39696] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0262 (0.0262) time: 0.3051 data: 0.2088 max mem: 5716\n","Epoch: [39696] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0230 (0.0230) time: 0.0970 data: 0.0176 max mem: 5716\n","Epoch: [39696] Total time: 0:00:01 (0.1012 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0230 (0.0230) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39697] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0204 (0.0204) time: 0.2916 data: 0.1994 max mem: 5716\n","Epoch: [39697] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0236 (0.0234) time: 0.0965 data: 0.0168 max mem: 5716\n","Epoch: [39697] Total time: 0:00:01 (0.1007 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0236 (0.0234) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39698] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0264 (0.0264) time: 0.2841 data: 0.1915 max mem: 5716\n","Epoch: [39698] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0247 (0.0242) time: 0.0965 data: 0.0161 max mem: 5716\n","Epoch: [39698] Total time: 0:00:01 (0.1006 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0247 (0.0242) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39699] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0298 (0.0298) time: 0.2849 data: 0.1960 max mem: 5716\n","Epoch: [39699] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0233 (0.0243) time: 0.0969 data: 0.0165 max mem: 5716\n","Epoch: [39699] Total time: 0:00:01 (0.1012 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0233 (0.0243) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39700] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0279 (0.0279) time: 0.2898 data: 0.1989 max mem: 5716\n","Epoch: [39700] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0241 (0.0242) time: 0.0961 data: 0.0167 max mem: 5716\n","Epoch: [39700] Total time: 0:00:01 (0.1003 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0241 (0.0242) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39701] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0190 (0.0190) time: 0.2902 data: 0.2009 max mem: 5716\n","Epoch: [39701] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0210 (0.0208) time: 0.0954 data: 0.0169 max mem: 5716\n","Epoch: [39701] Total time: 0:00:01 (0.0995 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0210 (0.0208) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39702] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0172 (0.0172) time: 0.2858 data: 0.1960 max mem: 5716\n","Epoch: [39702] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0200 (0.0208) time: 0.0942 data: 0.0165 max mem: 5716\n","Epoch: [39702] Total time: 0:00:01 (0.0983 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0200 (0.0208) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39703] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0152 (0.0152) time: 0.2894 data: 0.2024 max mem: 5716\n","Epoch: [39703] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0218 (0.0209) time: 0.0948 data: 0.0170 max mem: 5716\n","Epoch: [39703] Total time: 0:00:01 (0.0989 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0218 (0.0209) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39704] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0252 (0.0252) time: 0.2990 data: 0.2100 max mem: 5716\n","Epoch: [39704] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0228 (0.0230) time: 0.0992 data: 0.0177 max mem: 5716\n","Epoch: [39704] Total time: 0:00:01 (0.1033 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0228 (0.0230) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39705] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0241 (0.0241) time: 0.2920 data: 0.2011 max mem: 5716\n","Epoch: [39705] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0229 (0.0234) time: 0.0960 data: 0.0169 max mem: 5716\n","Epoch: [39705] Total time: 0:00:01 (0.1006 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0229 (0.0234) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39706] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0209 (0.0209) time: 0.2893 data: 0.1993 max mem: 5716\n","Epoch: [39706] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0220 (0.0231) time: 0.0955 data: 0.0168 max mem: 5716\n","Epoch: [39706] Total time: 0:00:01 (0.0997 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0220 (0.0231) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39707] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0220 (0.0220) time: 0.3046 data: 0.2029 max mem: 5716\n","Epoch: [39707] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0243 (0.0242) time: 0.0963 data: 0.0171 max mem: 5716\n","Epoch: [39707] Total time: 0:00:01 (0.1004 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0243 (0.0242) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39708] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0218 (0.0218) time: 0.2901 data: 0.1892 max mem: 5716\n","Epoch: [39708] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0235 (0.0239) time: 0.0988 data: 0.0159 max mem: 5716\n","Epoch: [39708] Total time: 0:00:01 (0.1028 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0235 (0.0239) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39709] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0244 (0.0244) time: 0.2841 data: 0.1940 max mem: 5716\n","Epoch: [39709] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0244 (0.0242) time: 0.0954 data: 0.0163 max mem: 5716\n","Epoch: [39709] Total time: 0:00:01 (0.0995 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0244 (0.0242) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39710] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0194 (0.0194) time: 0.3031 data: 0.2054 max mem: 5716\n","Epoch: [39710] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0194 (0.0206) time: 0.0964 data: 0.0173 max mem: 5716\n","Epoch: [39710] Total time: 0:00:01 (0.1019 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0194 (0.0206) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39711] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0175 (0.0175) time: 0.2854 data: 0.1956 max mem: 5716\n","Epoch: [39711] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0208 (0.0206) time: 0.0948 data: 0.0164 max mem: 5716\n","Epoch: [39711] Total time: 0:00:01 (0.0989 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0208 (0.0206) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39712] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0179 (0.0179) time: 0.2990 data: 0.1987 max mem: 5716\n","Epoch: [39712] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0193 (0.0204) time: 0.0958 data: 0.0167 max mem: 5716\n","Epoch: [39712] Total time: 0:00:01 (0.0999 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0193 (0.0204) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39713] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0193 (0.0193) time: 0.2855 data: 0.1961 max mem: 5716\n","Epoch: [39713] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0218 (0.0233) time: 0.0947 data: 0.0165 max mem: 5716\n","Epoch: [39713] Total time: 0:00:01 (0.0988 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0218 (0.0233) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39714] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0249 (0.0249) time: 0.2969 data: 0.1977 max mem: 5716\n","Epoch: [39714] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0223 (0.0234) time: 0.0966 data: 0.0166 max mem: 5716\n","Epoch: [39714] Total time: 0:00:01 (0.1021 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0223 (0.0234) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39715] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0269 (0.0269) time: 0.2939 data: 0.1968 max mem: 5716\n","Epoch: [39715] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0230 (0.0234) time: 0.0960 data: 0.0166 max mem: 5716\n","Epoch: [39715] Total time: 0:00:01 (0.1002 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0230 (0.0234) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39716] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0244 (0.0244) time: 0.2845 data: 0.1938 max mem: 5716\n","Epoch: [39716] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0234 (0.0241) time: 0.0954 data: 0.0163 max mem: 5716\n","Epoch: [39716] Total time: 0:00:01 (0.0996 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0234 (0.0241) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39717] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0276 (0.0276) time: 0.2920 data: 0.2050 max mem: 5716\n","Epoch: [39717] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0229 (0.0243) time: 0.0952 data: 0.0172 max mem: 5716\n","Epoch: [39717] Total time: 0:00:01 (0.0994 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0229 (0.0243) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39718] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0260 (0.0260) time: 0.2833 data: 0.1916 max mem: 5716\n","Epoch: [39718] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0251 (0.0245) time: 0.0941 data: 0.0161 max mem: 5716\n","Epoch: [39718] Total time: 0:00:01 (0.0982 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0251 (0.0245) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39719] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0186 (0.0186) time: 0.2947 data: 0.2062 max mem: 5716\n","Epoch: [39719] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0206 (0.0206) time: 0.0949 data: 0.0173 max mem: 5716\n","Epoch: [39719] Total time: 0:00:01 (0.0991 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0206 (0.0206) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39720] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0207 (0.0207) time: 0.2903 data: 0.1981 max mem: 5716\n","Epoch: [39720] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0202 (0.0206) time: 0.0949 data: 0.0167 max mem: 5716\n","Epoch: [39720] Total time: 0:00:01 (0.0990 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0202 (0.0206) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39721] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0208 (0.0208) time: 0.2921 data: 0.2040 max mem: 5716\n","Epoch: [39721] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0197 (0.0208) time: 0.0980 data: 0.0171 max mem: 5716\n","Epoch: [39721] Total time: 0:00:01 (0.1021 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0197 (0.0208) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39722] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0240 (0.0240) time: 0.2921 data: 0.2042 max mem: 5716\n","Epoch: [39722] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0234 (0.0230) time: 0.0953 data: 0.0172 max mem: 5716\n","Epoch: [39722] Total time: 0:00:01 (0.0995 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0234 (0.0230) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39723] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0272 (0.0272) time: 0.2924 data: 0.2047 max mem: 5716\n","Epoch: [39723] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0231 (0.0234) time: 0.0961 data: 0.0172 max mem: 5716\n","Epoch: [39723] Total time: 0:00:01 (0.1003 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0231 (0.0234) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39724] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0254 (0.0254) time: 0.2875 data: 0.1942 max mem: 5716\n","Epoch: [39724] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0224 (0.0232) time: 0.0950 data: 0.0163 max mem: 5716\n","Epoch: [39724] Total time: 0:00:01 (0.0990 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0224 (0.0232) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39725] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0245 (0.0245) time: 0.2923 data: 0.2036 max mem: 5716\n","Epoch: [39725] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0245 (0.0243) time: 0.0981 data: 0.0171 max mem: 5716\n","Epoch: [39725] Total time: 0:00:01 (0.1024 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0245 (0.0243) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39726] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0181 (0.0181) time: 0.2983 data: 0.1940 max mem: 5716\n","Epoch: [39726] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0247 (0.0243) time: 0.0950 data: 0.0163 max mem: 5716\n","Epoch: [39726] Total time: 0:00:01 (0.0992 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0247 (0.0243) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39727] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0235 (0.0235) time: 0.2833 data: 0.1955 max mem: 5716\n","Epoch: [39727] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0235 (0.0244) time: 0.0943 data: 0.0164 max mem: 5716\n","Epoch: [39727] Total time: 0:00:01 (0.0985 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0235 (0.0244) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39728] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0227 (0.0227) time: 0.2855 data: 0.1954 max mem: 5716\n","Epoch: [39728] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0203 (0.0211) time: 0.0943 data: 0.0164 max mem: 5716\n","Epoch: [39728] Total time: 0:00:01 (0.0984 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0203 (0.0211) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39729] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0218 (0.0218) time: 0.2957 data: 0.1960 max mem: 5716\n","Epoch: [39729] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0199 (0.0207) time: 0.0951 data: 0.0165 max mem: 5716\n","Epoch: [39729] Total time: 0:00:01 (0.0993 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0199 (0.0207) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39730] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0186 (0.0186) time: 0.3024 data: 0.2060 max mem: 5716\n","Epoch: [39730] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0205 (0.0206) time: 0.0956 data: 0.0173 max mem: 5716\n","Epoch: [39730] Total time: 0:00:01 (0.0998 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0205 (0.0206) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39731] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0249 (0.0249) time: 0.2802 data: 0.1884 max mem: 5716\n","Epoch: [39731] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0229 (0.0232) time: 0.0955 data: 0.0158 max mem: 5716\n","Epoch: [39731] Total time: 0:00:01 (0.0996 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0229 (0.0232) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39732] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0192 (0.0192) time: 0.2935 data: 0.2056 max mem: 5716\n","Epoch: [39732] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0235 (0.0233) time: 0.0972 data: 0.0173 max mem: 5716\n","Epoch: [39732] Total time: 0:00:01 (0.1014 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0235 (0.0233) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39733] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0233 (0.0233) time: 0.3096 data: 0.2172 max mem: 5716\n","Epoch: [39733] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0226 (0.0228) time: 0.0964 data: 0.0183 max mem: 5716\n","Epoch: [39733] Total time: 0:00:01 (0.1009 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0226 (0.0228) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39734] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0284 (0.0284) time: 0.2859 data: 0.1979 max mem: 5716\n","Epoch: [39734] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0224 (0.0242) time: 0.0945 data: 0.0166 max mem: 5716\n","Epoch: [39734] Total time: 0:00:01 (0.0987 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0224 (0.0242) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39735] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0214 (0.0214) time: 0.2857 data: 0.1962 max mem: 5716\n","Epoch: [39735] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0242 (0.0244) time: 0.0946 data: 0.0165 max mem: 5716\n","Epoch: [39735] Total time: 0:00:01 (0.0988 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0242 (0.0244) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39736] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0206 (0.0206) time: 0.2997 data: 0.1992 max mem: 5716\n","Epoch: [39736] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0229 (0.0242) time: 0.0960 data: 0.0168 max mem: 5716\n","Epoch: [39736] Total time: 0:00:01 (0.1001 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0229 (0.0242) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39737] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0175 (0.0175) time: 0.2874 data: 0.1958 max mem: 5716\n","Epoch: [39737] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0212 (0.0204) time: 0.0967 data: 0.0164 max mem: 5716\n","Epoch: [39737] Total time: 0:00:01 (0.1008 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0212 (0.0204) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39738] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0219 (0.0219) time: 0.2814 data: 0.1919 max mem: 5716\n","Epoch: [39738] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0206 (0.0209) time: 0.0940 data: 0.0161 max mem: 5716\n","Epoch: [39738] Total time: 0:00:01 (0.0981 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0206 (0.0209) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39739] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0242 (0.0242) time: 0.2812 data: 0.1917 max mem: 5716\n","Epoch: [39739] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0197 (0.0208) time: 0.0942 data: 0.0161 max mem: 5716\n","Epoch: [39739] Total time: 0:00:01 (0.0982 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0197 (0.0208) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39740] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0232 (0.0232) time: 0.2911 data: 0.1927 max mem: 5716\n","Epoch: [39740] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0224 (0.0231) time: 0.0946 data: 0.0162 max mem: 5716\n","Epoch: [39740] Total time: 0:00:01 (0.0987 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0224 (0.0231) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39741] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0267 (0.0267) time: 0.2792 data: 0.1893 max mem: 5716\n","Epoch: [39741] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0224 (0.0232) time: 0.0952 data: 0.0160 max mem: 5716\n","Epoch: [39741] Total time: 0:00:01 (0.0993 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0224 (0.0232) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39742] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0211 (0.0211) time: 0.2893 data: 0.2008 max mem: 5716\n","Epoch: [39742] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0221 (0.0234) time: 0.0950 data: 0.0169 max mem: 5716\n","Epoch: [39742] Total time: 0:00:01 (0.0991 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0221 (0.0234) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39743] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0276 (0.0276) time: 0.2927 data: 0.2046 max mem: 5716\n","Epoch: [39743] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0241 (0.0242) time: 0.0956 data: 0.0172 max mem: 5716\n","Epoch: [39743] Total time: 0:00:01 (0.0997 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0241 (0.0242) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39744] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0238 (0.0238) time: 0.2901 data: 0.2000 max mem: 5716\n","Epoch: [39744] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0226 (0.0243) time: 0.0949 data: 0.0168 max mem: 5716\n","Epoch: [39744] Total time: 0:00:01 (0.0992 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0226 (0.0243) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39745] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0244 (0.0244) time: 0.2907 data: 0.2047 max mem: 5716\n","Epoch: [39745] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0233 (0.0243) time: 0.0951 data: 0.0172 max mem: 5716\n","Epoch: [39745] Total time: 0:00:01 (0.0992 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0233 (0.0243) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39746] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0161 (0.0161) time: 0.2854 data: 0.1946 max mem: 5716\n","Epoch: [39746] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0203 (0.0205) time: 0.0949 data: 0.0164 max mem: 5716\n","Epoch: [39746] Total time: 0:00:01 (0.0990 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0203 (0.0205) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39747] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0200 (0.0200) time: 0.2898 data: 0.2018 max mem: 5716\n","Epoch: [39747] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0207 (0.0211) time: 0.0948 data: 0.0170 max mem: 5716\n","Epoch: [39747] Total time: 0:00:01 (0.0989 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0207 (0.0211) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39748] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0170 (0.0170) time: 0.2962 data: 0.2072 max mem: 5716\n","Epoch: [39748] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0207 (0.0211) time: 0.0971 data: 0.0174 max mem: 5716\n","Epoch: [39748] Total time: 0:00:01 (0.1014 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0207 (0.0211) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39749] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0241 (0.0241) time: 0.2832 data: 0.1927 max mem: 5716\n","Epoch: [39749] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0235 (0.0234) time: 0.0951 data: 0.0162 max mem: 5716\n","Epoch: [39749] Total time: 0:00:01 (0.0992 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0235 (0.0234) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39750] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0287 (0.0287) time: 0.2830 data: 0.1933 max mem: 5716\n","Epoch: [39750] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0221 (0.0232) time: 0.0945 data: 0.0163 max mem: 5716\n","Epoch: [39750] Total time: 0:00:01 (0.0986 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0221 (0.0232) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39751] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0226 (0.0226) time: 0.2798 data: 0.1910 max mem: 5716\n","Epoch: [39751] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0229 (0.0232) time: 0.0940 data: 0.0161 max mem: 5716\n","Epoch: [39751] Total time: 0:00:01 (0.1002 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0229 (0.0232) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39752] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0240 (0.0240) time: 0.2834 data: 0.1944 max mem: 5716\n","Epoch: [39752] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0225 (0.0238) time: 0.0950 data: 0.0163 max mem: 5716\n","Epoch: [39752] Total time: 0:00:01 (0.0991 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0225 (0.0238) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39753] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0220 (0.0220) time: 0.2859 data: 0.1993 max mem: 5716\n","Epoch: [39753] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0239 (0.0241) time: 0.0947 data: 0.0167 max mem: 5716\n","Epoch: [39753] Total time: 0:00:01 (0.0988 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0239 (0.0241) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39754] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0195 (0.0195) time: 0.2872 data: 0.1993 max mem: 5716\n","Epoch: [39754] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0251 (0.0243) time: 0.0947 data: 0.0168 max mem: 5716\n","Epoch: [39754] Total time: 0:00:01 (0.0988 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0251 (0.0243) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39755] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0241 (0.0241) time: 0.2929 data: 0.2063 max mem: 5716\n","Epoch: [39755] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0214 (0.0208) time: 0.0979 data: 0.0173 max mem: 5716\n","Epoch: [39755] Total time: 0:00:01 (0.1021 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0214 (0.0208) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39756] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0238 (0.0238) time: 0.2837 data: 0.1944 max mem: 5716\n","Epoch: [39756] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0203 (0.0210) time: 0.0944 data: 0.0163 max mem: 5716\n","Epoch: [39756] Total time: 0:00:01 (0.0985 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0203 (0.0210) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39757] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0228 (0.0228) time: 0.2933 data: 0.2003 max mem: 5716\n","Epoch: [39757] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0210 (0.0204) time: 0.0954 data: 0.0168 max mem: 5716\n","Epoch: [39757] Total time: 0:00:01 (0.1010 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0210 (0.0204) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39758] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0185 (0.0185) time: 0.2925 data: 0.2044 max mem: 5716\n","Epoch: [39758] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0236 (0.0234) time: 0.0962 data: 0.0172 max mem: 5716\n","Epoch: [39758] Total time: 0:00:01 (0.1004 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0236 (0.0234) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39759] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0215 (0.0215) time: 0.2999 data: 0.2001 max mem: 5716\n","Epoch: [39759] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0227 (0.0233) time: 0.0969 data: 0.0168 max mem: 5716\n","Epoch: [39759] Total time: 0:00:01 (0.1011 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0227 (0.0233) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39760] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0277 (0.0277) time: 0.2915 data: 0.2040 max mem: 5716\n","Epoch: [39760] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0231 (0.0232) time: 0.0959 data: 0.0172 max mem: 5716\n","Epoch: [39760] Total time: 0:00:01 (0.1000 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0231 (0.0232) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39761] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0226 (0.0226) time: 0.2948 data: 0.1937 max mem: 5716\n","Epoch: [39761] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0244 (0.0243) time: 0.0962 data: 0.0163 max mem: 5716\n","Epoch: [39761] Total time: 0:00:01 (0.1004 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0244 (0.0243) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39762] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0216 (0.0216) time: 0.3055 data: 0.2035 max mem: 5716\n","Epoch: [39762] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0230 (0.0245) time: 0.0984 data: 0.0171 max mem: 5716\n","Epoch: [39762] Total time: 0:00:01 (0.1025 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0230 (0.0245) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39763] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0220 (0.0220) time: 0.2832 data: 0.1936 max mem: 5716\n","Epoch: [39763] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0230 (0.0237) time: 0.0958 data: 0.0163 max mem: 5716\n","Epoch: [39763] Total time: 0:00:01 (0.1018 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0230 (0.0237) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39764] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0189 (0.0189) time: 0.2862 data: 0.1921 max mem: 5716\n","Epoch: [39764] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0209 (0.0207) time: 0.0943 data: 0.0161 max mem: 5716\n","Epoch: [39764] Total time: 0:00:01 (0.0983 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0209 (0.0207) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39765] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0173 (0.0173) time: 0.2922 data: 0.2043 max mem: 5716\n","Epoch: [39765] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0196 (0.0208) time: 0.0965 data: 0.0172 max mem: 5716\n","Epoch: [39765] Total time: 0:00:01 (0.1006 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0196 (0.0208) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39766] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0223 (0.0223) time: 0.2860 data: 0.1958 max mem: 5716\n","Epoch: [39766] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0204 (0.0207) time: 0.0953 data: 0.0165 max mem: 5716\n","Epoch: [39766] Total time: 0:00:01 (0.0994 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0204 (0.0207) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39767] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0183 (0.0183) time: 0.2898 data: 0.1956 max mem: 5716\n","Epoch: [39767] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0213 (0.0233) time: 0.0971 data: 0.0165 max mem: 5716\n","Epoch: [39767] Total time: 0:00:01 (0.1012 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0213 (0.0233) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39768] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0231 (0.0231) time: 0.2861 data: 0.1952 max mem: 5716\n","Epoch: [39768] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0231 (0.0232) time: 0.0953 data: 0.0164 max mem: 5716\n","Epoch: [39768] Total time: 0:00:01 (0.0994 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0231 (0.0232) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39769] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0183 (0.0183) time: 0.2871 data: 0.1974 max mem: 5716\n","Epoch: [39769] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0228 (0.0231) time: 0.0953 data: 0.0166 max mem: 5716\n","Epoch: [39769] Total time: 0:00:01 (0.0995 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0228 (0.0231) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39770] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0222 (0.0222) time: 0.2891 data: 0.1982 max mem: 5716\n","Epoch: [39770] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0243 (0.0244) time: 0.0955 data: 0.0167 max mem: 5716\n","Epoch: [39770] Total time: 0:00:01 (0.0996 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0243 (0.0244) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39771] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0211 (0.0211) time: 0.2968 data: 0.2056 max mem: 5716\n","Epoch: [39771] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0232 (0.0245) time: 0.0959 data: 0.0173 max mem: 5716\n","Epoch: [39771] Total time: 0:00:01 (0.1000 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0232 (0.0245) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39772] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0239 (0.0239) time: 0.2873 data: 0.1981 max mem: 5716\n","Epoch: [39772] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0240 (0.0240) time: 0.0947 data: 0.0166 max mem: 5716\n","Epoch: [39772] Total time: 0:00:01 (0.1002 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0240 (0.0240) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39773] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0195 (0.0195) time: 0.2903 data: 0.1997 max mem: 5716\n","Epoch: [39773] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0202 (0.0209) time: 0.0954 data: 0.0168 max mem: 5716\n","Epoch: [39773] Total time: 0:00:01 (0.0995 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0202 (0.0209) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39774] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0195 (0.0195) time: 0.2829 data: 0.1906 max mem: 5716\n","Epoch: [39774] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0210 (0.0209) time: 0.0947 data: 0.0160 max mem: 5716\n","Epoch: [39774] Total time: 0:00:01 (0.0987 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0210 (0.0209) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39775] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0191 (0.0191) time: 0.2815 data: 0.1891 max mem: 5716\n","Epoch: [39775] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0200 (0.0211) time: 0.0972 data: 0.0159 max mem: 5716\n","Epoch: [39775] Total time: 0:00:01 (0.1013 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0200 (0.0211) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39776] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0232 (0.0232) time: 0.2881 data: 0.2005 max mem: 5716\n","Epoch: [39776] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0226 (0.0230) time: 0.0948 data: 0.0169 max mem: 5716\n","Epoch: [39776] Total time: 0:00:01 (0.1004 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0226 (0.0230) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39777] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0186 (0.0186) time: 0.2877 data: 0.1999 max mem: 5716\n","Epoch: [39777] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0231 (0.0234) time: 0.0947 data: 0.0168 max mem: 5716\n","Epoch: [39777] Total time: 0:00:01 (0.0988 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0231 (0.0234) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39778] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0242 (0.0242) time: 0.2887 data: 0.1970 max mem: 5716\n","Epoch: [39778] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0240 (0.0230) time: 0.0951 data: 0.0166 max mem: 5716\n","Epoch: [39778] Total time: 0:00:01 (0.0992 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0240 (0.0230) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39779] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0282 (0.0282) time: 0.2965 data: 0.2087 max mem: 5716\n","Epoch: [39779] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0235 (0.0239) time: 0.0960 data: 0.0176 max mem: 5716\n","Epoch: [39779] Total time: 0:00:01 (0.1001 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0235 (0.0239) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39780] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0191 (0.0191) time: 0.2951 data: 0.2076 max mem: 5716\n","Epoch: [39780] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0239 (0.0244) time: 0.0958 data: 0.0175 max mem: 5716\n","Epoch: [39780] Total time: 0:00:01 (0.1000 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0239 (0.0244) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39781] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0235 (0.0235) time: 0.2925 data: 0.1934 max mem: 5716\n","Epoch: [39781] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0242 (0.0244) time: 0.0955 data: 0.0163 max mem: 5716\n","Epoch: [39781] Total time: 0:00:01 (0.0996 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0242 (0.0244) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39782] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0155 (0.0155) time: 0.2866 data: 0.1912 max mem: 5716\n","Epoch: [39782] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0201 (0.0208) time: 0.0950 data: 0.0161 max mem: 5716\n","Epoch: [39782] Total time: 0:00:01 (0.0991 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0201 (0.0208) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39783] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0192 (0.0192) time: 0.2842 data: 0.1911 max mem: 5716\n","Epoch: [39783] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0197 (0.0210) time: 0.0972 data: 0.0161 max mem: 5716\n","Epoch: [39783] Total time: 0:00:01 (0.1013 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0197 (0.0210) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39784] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0186 (0.0186) time: 0.2869 data: 0.1986 max mem: 5716\n","Epoch: [39784] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0201 (0.0207) time: 0.0955 data: 0.0167 max mem: 5716\n","Epoch: [39784] Total time: 0:00:01 (0.0997 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0201 (0.0207) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39785] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0260 (0.0260) time: 0.2774 data: 0.1880 max mem: 5716\n","Epoch: [39785] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0245 (0.0237) time: 0.0937 data: 0.0158 max mem: 5716\n","Epoch: [39785] Total time: 0:00:01 (0.0978 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0245 (0.0237) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39786] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0257 (0.0257) time: 0.2872 data: 0.1961 max mem: 5716\n","Epoch: [39786] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0231 (0.0229) time: 0.0946 data: 0.0165 max mem: 5716\n","Epoch: [39786] Total time: 0:00:01 (0.0989 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0231 (0.0229) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39787] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0221 (0.0221) time: 0.2896 data: 0.1987 max mem: 5716\n","Epoch: [39787] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0229 (0.0235) time: 0.0950 data: 0.0167 max mem: 5716\n","Epoch: [39787] Total time: 0:00:01 (0.0992 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0229 (0.0235) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39788] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0210 (0.0210) time: 0.2857 data: 0.1972 max mem: 5716\n","Epoch: [39788] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0235 (0.0242) time: 0.0946 data: 0.0166 max mem: 5716\n","Epoch: [39788] Total time: 0:00:01 (0.0986 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0235 (0.0242) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39789] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0205 (0.0205) time: 0.2980 data: 0.1985 max mem: 5716\n","Epoch: [39789] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0231 (0.0240) time: 0.0962 data: 0.0167 max mem: 5716\n","Epoch: [39789] Total time: 0:00:01 (0.1019 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0231 (0.0240) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39790] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0223 (0.0223) time: 0.2838 data: 0.1941 max mem: 5716\n","Epoch: [39790] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0231 (0.0244) time: 0.0962 data: 0.0163 max mem: 5716\n","Epoch: [39790] Total time: 0:00:01 (0.1004 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0231 (0.0244) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39791] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0232 (0.0232) time: 0.2992 data: 0.2031 max mem: 5716\n","Epoch: [39791] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0200 (0.0209) time: 0.0958 data: 0.0171 max mem: 5716\n","Epoch: [39791] Total time: 0:00:01 (0.0999 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0200 (0.0209) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39792] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0289 (0.0289) time: 0.2848 data: 0.1952 max mem: 5716\n","Epoch: [39792] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0201 (0.0210) time: 0.0949 data: 0.0164 max mem: 5716\n","Epoch: [39792] Total time: 0:00:01 (0.0990 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0201 (0.0210) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39793] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0161 (0.0161) time: 0.2850 data: 0.1947 max mem: 5716\n","Epoch: [39793] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0206 (0.0209) time: 0.0940 data: 0.0164 max mem: 5716\n","Epoch: [39793] Total time: 0:00:01 (0.0981 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0206 (0.0209) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39794] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0241 (0.0241) time: 0.2865 data: 0.2002 max mem: 5716\n","Epoch: [39794] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0232 (0.0233) time: 0.0944 data: 0.0168 max mem: 5716\n","Epoch: [39794] Total time: 0:00:01 (0.0985 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0232 (0.0233) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39795] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0245 (0.0245) time: 0.2807 data: 0.1899 max mem: 5716\n","Epoch: [39795] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0228 (0.0230) time: 0.0941 data: 0.0160 max mem: 5716\n","Epoch: [39795] Total time: 0:00:01 (0.0981 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0228 (0.0230) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39796] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0225 (0.0225) time: 0.2820 data: 0.1912 max mem: 5716\n","Epoch: [39796] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0226 (0.0232) time: 0.0940 data: 0.0161 max mem: 5716\n","Epoch: [39796] Total time: 0:00:01 (0.0980 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0226 (0.0232) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39797] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0272 (0.0272) time: 0.2777 data: 0.1879 max mem: 5716\n","Epoch: [39797] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0235 (0.0244) time: 0.0942 data: 0.0158 max mem: 5716\n","Epoch: [39797] Total time: 0:00:01 (0.0982 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0235 (0.0244) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39798] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0237 (0.0237) time: 0.2971 data: 0.2022 max mem: 5716\n","Epoch: [39798] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0237 (0.0242) time: 0.0959 data: 0.0170 max mem: 5716\n","Epoch: [39798] Total time: 0:00:01 (0.1000 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0237 (0.0242) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39799] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0246 (0.0246) time: 0.2922 data: 0.2036 max mem: 5716\n","Epoch: [39799] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0243 (0.0241) time: 0.0961 data: 0.0171 max mem: 5716\n","Epoch: [39799] Total time: 0:00:01 (0.1002 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0243 (0.0241) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39800] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0218 (0.0218) time: 0.2885 data: 0.1960 max mem: 5716\n","Epoch: [39800] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0218 (0.0212) time: 0.0977 data: 0.0165 max mem: 5716\n","Epoch: [39800] Total time: 0:00:01 (0.1018 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0218 (0.0212) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39801] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0177 (0.0177) time: 0.3013 data: 0.2003 max mem: 5716\n","Epoch: [39801] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0205 (0.0206) time: 0.0970 data: 0.0169 max mem: 5716\n","Epoch: [39801] Total time: 0:00:01 (0.1011 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0205 (0.0206) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39802] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0227 (0.0227) time: 0.2892 data: 0.1984 max mem: 5716\n","Epoch: [39802] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0199 (0.0205) time: 0.0953 data: 0.0167 max mem: 5716\n","Epoch: [39802] Total time: 0:00:01 (0.0994 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0199 (0.0205) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39803] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0213 (0.0213) time: 0.2857 data: 0.1972 max mem: 5716\n","Epoch: [39803] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0227 (0.0232) time: 0.0949 data: 0.0166 max mem: 5716\n","Epoch: [39803] Total time: 0:00:01 (0.0990 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0227 (0.0232) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39804] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0243 (0.0243) time: 0.2899 data: 0.2018 max mem: 5716\n","Epoch: [39804] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0229 (0.0232) time: 0.0964 data: 0.0170 max mem: 5716\n","Epoch: [39804] Total time: 0:00:01 (0.1004 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0229 (0.0232) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39805] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0179 (0.0179) time: 0.2780 data: 0.1887 max mem: 5716\n","Epoch: [39805] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0222 (0.0229) time: 0.0936 data: 0.0159 max mem: 5716\n","Epoch: [39805] Total time: 0:00:01 (0.0976 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0222 (0.0229) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39806] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0257 (0.0257) time: 0.2890 data: 0.1990 max mem: 5716\n","Epoch: [39806] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0234 (0.0246) time: 0.0956 data: 0.0167 max mem: 5716\n","Epoch: [39806] Total time: 0:00:01 (0.0996 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0234 (0.0246) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39807] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0195 (0.0195) time: 0.2845 data: 0.1915 max mem: 5716\n","Epoch: [39807] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0231 (0.0243) time: 0.0946 data: 0.0161 max mem: 5716\n","Epoch: [39807] Total time: 0:00:01 (0.0987 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0231 (0.0243) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39808] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0222 (0.0222) time: 0.2943 data: 0.1934 max mem: 5716\n","Epoch: [39808] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0231 (0.0244) time: 0.0966 data: 0.0163 max mem: 5716\n","Epoch: [39808] Total time: 0:00:01 (0.1008 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0231 (0.0244) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39809] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0177 (0.0177) time: 0.2984 data: 0.2041 max mem: 5716\n","Epoch: [39809] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0197 (0.0210) time: 0.0969 data: 0.0171 max mem: 5716\n","Epoch: [39809] Total time: 0:00:01 (0.1014 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0197 (0.0210) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39810] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0198 (0.0198) time: 0.2904 data: 0.1978 max mem: 5716\n","Epoch: [39810] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0198 (0.0209) time: 0.0957 data: 0.0166 max mem: 5716\n","Epoch: [39810] Total time: 0:00:01 (0.0998 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0198 (0.0209) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39811] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0205 (0.0205) time: 0.2855 data: 0.1962 max mem: 5716\n","Epoch: [39811] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0205 (0.0206) time: 0.0946 data: 0.0165 max mem: 5716\n","Epoch: [39811] Total time: 0:00:01 (0.0987 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0205 (0.0206) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39812] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0222 (0.0222) time: 0.2899 data: 0.1970 max mem: 5716\n","Epoch: [39812] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0222 (0.0233) time: 0.0953 data: 0.0166 max mem: 5716\n","Epoch: [39812] Total time: 0:00:01 (0.0994 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0222 (0.0233) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39813] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0196 (0.0196) time: 0.2868 data: 0.1956 max mem: 5716\n","Epoch: [39813] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0224 (0.0233) time: 0.0964 data: 0.0165 max mem: 5716\n","Epoch: [39813] Total time: 0:00:01 (0.1005 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0224 (0.0233) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39814] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0226 (0.0226) time: 0.2991 data: 0.2016 max mem: 5716\n","Epoch: [39814] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0226 (0.0231) time: 0.0960 data: 0.0169 max mem: 5716\n","Epoch: [39814] Total time: 0:00:01 (0.1003 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0226 (0.0231) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39815] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0280 (0.0280) time: 0.2861 data: 0.1956 max mem: 5716\n","Epoch: [39815] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0239 (0.0239) time: 0.0952 data: 0.0165 max mem: 5716\n","Epoch: [39815] Total time: 0:00:01 (0.0994 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0239 (0.0239) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39816] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0227 (0.0227) time: 0.2973 data: 0.2091 max mem: 5716\n","Epoch: [39816] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0246 (0.0246) time: 0.0965 data: 0.0176 max mem: 5716\n","Epoch: [39816] Total time: 0:00:01 (0.1006 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0246 (0.0246) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39817] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0251 (0.0251) time: 0.2884 data: 0.2010 max mem: 5716\n","Epoch: [39817] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0251 (0.0245) time: 0.0958 data: 0.0169 max mem: 5716\n","Epoch: [39817] Total time: 0:00:01 (0.0999 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0251 (0.0245) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39818] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0197 (0.0197) time: 0.2827 data: 0.1920 max mem: 5716\n","Epoch: [39818] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0194 (0.0206) time: 0.0948 data: 0.0162 max mem: 5716\n","Epoch: [39818] Total time: 0:00:01 (0.0989 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0194 (0.0206) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39819] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0170 (0.0170) time: 0.2806 data: 0.1899 max mem: 5716\n","Epoch: [39819] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0206 (0.0206) time: 0.0941 data: 0.0160 max mem: 5716\n","Epoch: [39819] Total time: 0:00:01 (0.0981 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0206 (0.0206) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39820] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0180 (0.0180) time: 0.2860 data: 0.1964 max mem: 5716\n","Epoch: [39820] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0204 (0.0208) time: 0.0958 data: 0.0165 max mem: 5716\n","Epoch: [39820] Total time: 0:00:01 (0.0999 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0204 (0.0208) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39821] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0208 (0.0208) time: 0.2950 data: 0.2094 max mem: 5716\n","Epoch: [39821] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0221 (0.0234) time: 0.0950 data: 0.0176 max mem: 5716\n","Epoch: [39821] Total time: 0:00:01 (0.0992 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0221 (0.0234) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39822] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0250 (0.0250) time: 0.2899 data: 0.2039 max mem: 5716\n","Epoch: [39822] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0229 (0.0233) time: 0.0947 data: 0.0171 max mem: 5716\n","Epoch: [39822] Total time: 0:00:01 (0.0988 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0229 (0.0233) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39823] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0241 (0.0241) time: 0.2887 data: 0.2001 max mem: 5716\n","Epoch: [39823] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0241 (0.0236) time: 0.0949 data: 0.0168 max mem: 5716\n","Epoch: [39823] Total time: 0:00:01 (0.0990 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0241 (0.0236) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39824] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0208 (0.0208) time: 0.2910 data: 0.1973 max mem: 5716\n","Epoch: [39824] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0226 (0.0243) time: 0.0948 data: 0.0166 max mem: 5716\n","Epoch: [39824] Total time: 0:00:01 (0.0996 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0226 (0.0243) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39825] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0273 (0.0273) time: 0.2930 data: 0.1989 max mem: 5716\n","Epoch: [39825] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0248 (0.0246) time: 0.0979 data: 0.0167 max mem: 5716\n","Epoch: [39825] Total time: 0:00:01 (0.1020 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0248 (0.0246) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39826] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0220 (0.0220) time: 0.2873 data: 0.1956 max mem: 5716\n","Epoch: [39826] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0241 (0.0241) time: 0.0974 data: 0.0165 max mem: 5716\n","Epoch: [39826] Total time: 0:00:01 (0.1015 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0241 (0.0241) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39827] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0230 (0.0230) time: 0.2783 data: 0.1874 max mem: 5716\n","Epoch: [39827] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0203 (0.0204) time: 0.0954 data: 0.0158 max mem: 5716\n","Epoch: [39827] Total time: 0:00:01 (0.0995 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0203 (0.0204) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39828] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0162 (0.0162) time: 0.2792 data: 0.1874 max mem: 5716\n","Epoch: [39828] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0207 (0.0210) time: 0.0948 data: 0.0158 max mem: 5716\n","Epoch: [39828] Total time: 0:00:01 (0.0988 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0207 (0.0210) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39829] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0218 (0.0218) time: 0.2861 data: 0.1959 max mem: 5716\n","Epoch: [39829] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0200 (0.0206) time: 0.0956 data: 0.0165 max mem: 5716\n","Epoch: [39829] Total time: 0:00:01 (0.0997 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0200 (0.0206) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39830] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0212 (0.0212) time: 0.2837 data: 0.1928 max mem: 5716\n","Epoch: [39830] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0226 (0.0231) time: 0.0946 data: 0.0162 max mem: 5716\n","Epoch: [39830] Total time: 0:00:01 (0.0986 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0226 (0.0231) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39831] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0200 (0.0200) time: 0.2930 data: 0.2060 max mem: 5716\n","Epoch: [39831] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0212 (0.0228) time: 0.0948 data: 0.0173 max mem: 5716\n","Epoch: [39831] Total time: 0:00:01 (0.0989 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0212 (0.0228) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39832] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0180 (0.0180) time: 0.2872 data: 0.1957 max mem: 5716\n","Epoch: [39832] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0234 (0.0231) time: 0.0947 data: 0.0164 max mem: 5716\n","Epoch: [39832] Total time: 0:00:01 (0.0987 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0234 (0.0231) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39833] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0202 (0.0202) time: 0.2830 data: 0.1941 max mem: 5716\n","Epoch: [39833] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0232 (0.0244) time: 0.0951 data: 0.0163 max mem: 5716\n","Epoch: [39833] Total time: 0:00:01 (0.0992 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0232 (0.0244) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39834] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0268 (0.0268) time: 0.2839 data: 0.1925 max mem: 5716\n","Epoch: [39834] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0249 (0.0243) time: 0.0950 data: 0.0162 max mem: 5716\n","Epoch: [39834] Total time: 0:00:01 (0.0991 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0249 (0.0243) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39835] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0232 (0.0232) time: 0.2928 data: 0.2058 max mem: 5716\n","Epoch: [39835] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0239 (0.0242) time: 0.0953 data: 0.0173 max mem: 5716\n","Epoch: [39835] Total time: 0:00:01 (0.0995 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0239 (0.0242) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39836] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0152 (0.0152) time: 0.2955 data: 0.1970 max mem: 5716\n","Epoch: [39836] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0201 (0.0208) time: 0.0959 data: 0.0166 max mem: 5716\n","Epoch: [39836] Total time: 0:00:01 (0.1001 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0201 (0.0208) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39837] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0172 (0.0172) time: 0.2846 data: 0.1957 max mem: 5716\n","Epoch: [39837] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0213 (0.0209) time: 0.0944 data: 0.0164 max mem: 5716\n","Epoch: [39837] Total time: 0:00:01 (0.0986 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0213 (0.0209) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39838] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0227 (0.0227) time: 0.2891 data: 0.1980 max mem: 5716\n","Epoch: [39838] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0205 (0.0209) time: 0.0949 data: 0.0166 max mem: 5716\n","Epoch: [39838] Total time: 0:00:01 (0.0991 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0205 (0.0209) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39839] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0239 (0.0239) time: 0.2862 data: 0.1964 max mem: 5716\n","Epoch: [39839] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0231 (0.0233) time: 0.0944 data: 0.0165 max mem: 5716\n","Epoch: [39839] Total time: 0:00:01 (0.0999 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0231 (0.0233) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39840] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0256 (0.0256) time: 0.2917 data: 0.2033 max mem: 5716\n","Epoch: [39840] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0237 (0.0235) time: 0.0947 data: 0.0171 max mem: 5716\n","Epoch: [39840] Total time: 0:00:01 (0.0988 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0237 (0.0235) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39841] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0259 (0.0259) time: 0.2838 data: 0.1938 max mem: 5716\n","Epoch: [39841] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0230 (0.0233) time: 0.0942 data: 0.0163 max mem: 5716\n","Epoch: [39841] Total time: 0:00:01 (0.0983 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0230 (0.0233) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39842] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0235 (0.0235) time: 0.2871 data: 0.1959 max mem: 5716\n","Epoch: [39842] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0237 (0.0242) time: 0.0949 data: 0.0165 max mem: 5716\n","Epoch: [39842] Total time: 0:00:01 (0.0991 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0237 (0.0242) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39843] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0208 (0.0208) time: 0.2857 data: 0.1974 max mem: 5716\n","Epoch: [39843] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0241 (0.0243) time: 0.0950 data: 0.0166 max mem: 5716\n","Epoch: [39843] Total time: 0:00:01 (0.0992 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0241 (0.0243) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39844] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0255 (0.0255) time: 0.2909 data: 0.2003 max mem: 5716\n","Epoch: [39844] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0240 (0.0242) time: 0.0964 data: 0.0169 max mem: 5716\n","Epoch: [39844] Total time: 0:00:01 (0.1006 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0240 (0.0242) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39845] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0181 (0.0181) time: 0.2961 data: 0.2082 max mem: 5716\n","Epoch: [39845] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0192 (0.0209) time: 0.0987 data: 0.0175 max mem: 5716\n","Epoch: [39845] Total time: 0:00:01 (0.1028 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0192 (0.0209) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39846] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0180 (0.0180) time: 0.2933 data: 0.2058 max mem: 5716\n","Epoch: [39846] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0209 (0.0209) time: 0.0954 data: 0.0173 max mem: 5716\n","Epoch: [39846] Total time: 0:00:01 (0.0995 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0209 (0.0209) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39847] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0235 (0.0235) time: 0.2917 data: 0.2037 max mem: 5716\n","Epoch: [39847] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0204 (0.0209) time: 0.0951 data: 0.0171 max mem: 5716\n","Epoch: [39847] Total time: 0:00:01 (0.0992 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0204 (0.0209) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39848] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0234 (0.0234) time: 0.2820 data: 0.1925 max mem: 5716\n","Epoch: [39848] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0226 (0.0231) time: 0.0946 data: 0.0162 max mem: 5716\n","Epoch: [39848] Total time: 0:00:01 (0.0987 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0226 (0.0231) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39849] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0226 (0.0226) time: 0.2823 data: 0.1923 max mem: 5716\n","Epoch: [39849] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0227 (0.0232) time: 0.0944 data: 0.0162 max mem: 5716\n","Epoch: [39849] Total time: 0:00:01 (0.0985 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0227 (0.0232) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39850] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0275 (0.0275) time: 0.2834 data: 0.1916 max mem: 5716\n","Epoch: [39850] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0227 (0.0233) time: 0.0943 data: 0.0161 max mem: 5716\n","Epoch: [39850] Total time: 0:00:01 (0.0984 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0227 (0.0233) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39851] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0245 (0.0245) time: 0.2801 data: 0.1894 max mem: 5716\n","Epoch: [39851] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0245 (0.0246) time: 0.0945 data: 0.0159 max mem: 5716\n","Epoch: [39851] Total time: 0:00:01 (0.0986 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0245 (0.0246) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39852] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0253 (0.0253) time: 0.2963 data: 0.1946 max mem: 5716\n","Epoch: [39852] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0244 (0.0241) time: 0.0954 data: 0.0164 max mem: 5716\n","Epoch: [39852] Total time: 0:00:01 (0.0996 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0244 (0.0241) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39853] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0246 (0.0246) time: 0.2910 data: 0.2034 max mem: 5716\n","Epoch: [39853] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0239 (0.0244) time: 0.0950 data: 0.0171 max mem: 5716\n","Epoch: [39853] Total time: 0:00:01 (0.0990 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0239 (0.0244) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39854] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0171 (0.0171) time: 0.2869 data: 0.1983 max mem: 5716\n","Epoch: [39854] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0210 (0.0211) time: 0.0959 data: 0.0167 max mem: 5716\n","Epoch: [39854] Total time: 0:00:01 (0.1000 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0210 (0.0211) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39855] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0231 (0.0231) time: 0.2926 data: 0.2047 max mem: 5716\n","Epoch: [39855] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0201 (0.0206) time: 0.0950 data: 0.0172 max mem: 5716\n","Epoch: [39855] Total time: 0:00:01 (0.0990 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0201 (0.0206) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39856] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0165 (0.0165) time: 0.2875 data: 0.1987 max mem: 5716\n","Epoch: [39856] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0205 (0.0209) time: 0.0949 data: 0.0167 max mem: 5716\n","Epoch: [39856] Total time: 0:00:01 (0.0991 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0205 (0.0209) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39857] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0207 (0.0207) time: 0.2920 data: 0.2054 max mem: 5716\n","Epoch: [39857] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0208 (0.0228) time: 0.0950 data: 0.0173 max mem: 5716\n","Epoch: [39857] Total time: 0:00:01 (0.0991 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0208 (0.0228) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39858] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0230 (0.0230) time: 0.2959 data: 0.2079 max mem: 5716\n","Epoch: [39858] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0225 (0.0231) time: 0.0963 data: 0.0175 max mem: 5716\n","Epoch: [39858] Total time: 0:00:01 (0.1005 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0225 (0.0231) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39859] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0224 (0.0224) time: 0.2839 data: 0.1940 max mem: 5716\n","Epoch: [39859] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0224 (0.0232) time: 0.0950 data: 0.0163 max mem: 5716\n","Epoch: [39859] Total time: 0:00:01 (0.0992 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0224 (0.0232) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39860] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0239 (0.0239) time: 0.2908 data: 0.1997 max mem: 5716\n","Epoch: [39860] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0232 (0.0242) time: 0.0953 data: 0.0168 max mem: 5716\n","Epoch: [39860] Total time: 0:00:01 (0.0995 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0232 (0.0242) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39861] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0204 (0.0204) time: 0.2899 data: 0.1975 max mem: 5716\n","Epoch: [39861] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0235 (0.0244) time: 0.0991 data: 0.0166 max mem: 5716\n","Epoch: [39861] Total time: 0:00:01 (0.1032 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0235 (0.0244) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39862] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0306 (0.0306) time: 0.2937 data: 0.2056 max mem: 5716\n","Epoch: [39862] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0241 (0.0246) time: 0.0953 data: 0.0173 max mem: 5716\n","Epoch: [39862] Total time: 0:00:01 (0.0996 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0241 (0.0246) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39863] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0221 (0.0221) time: 0.2945 data: 0.2054 max mem: 5716\n","Epoch: [39863] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0199 (0.0208) time: 0.0954 data: 0.0173 max mem: 5716\n","Epoch: [39863] Total time: 0:00:01 (0.0996 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0199 (0.0208) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39864] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0173 (0.0173) time: 0.2912 data: 0.1996 max mem: 5716\n","Epoch: [39864] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0211 (0.0210) time: 0.0960 data: 0.0168 max mem: 5716\n","Epoch: [39864] Total time: 0:00:01 (0.1002 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0211 (0.0210) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39865] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0188 (0.0188) time: 0.2855 data: 0.1970 max mem: 5716\n","Epoch: [39865] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0200 (0.0212) time: 0.0942 data: 0.0166 max mem: 5716\n","Epoch: [39865] Total time: 0:00:01 (0.0984 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0200 (0.0212) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39866] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0263 (0.0263) time: 0.3080 data: 0.2177 max mem: 5716\n","Epoch: [39866] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0232 (0.0233) time: 0.0962 data: 0.0183 max mem: 5716\n","Epoch: [39866] Total time: 0:00:01 (0.1034 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0232 (0.0233) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39867] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0213 (0.0213) time: 0.2885 data: 0.2034 max mem: 5716\n","Epoch: [39867] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0225 (0.0231) time: 0.0961 data: 0.0171 max mem: 5716\n","Epoch: [39867] Total time: 0:00:01 (0.1001 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0225 (0.0231) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39868] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0197 (0.0197) time: 0.2864 data: 0.1969 max mem: 5716\n","Epoch: [39868] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0228 (0.0234) time: 0.0952 data: 0.0166 max mem: 5716\n","Epoch: [39868] Total time: 0:00:01 (0.0993 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0228 (0.0234) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39869] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0170 (0.0170) time: 0.2868 data: 0.1943 max mem: 5716\n","Epoch: [39869] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0238 (0.0243) time: 0.0986 data: 0.0163 max mem: 5716\n","Epoch: [39869] Total time: 0:00:01 (0.1036 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0238 (0.0243) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39870] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0275 (0.0275) time: 0.2971 data: 0.2026 max mem: 5716\n","Epoch: [39870] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0231 (0.0243) time: 0.0955 data: 0.0170 max mem: 5716\n","Epoch: [39870] Total time: 0:00:01 (0.0995 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0231 (0.0243) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39871] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0207 (0.0207) time: 0.2801 data: 0.1909 max mem: 5716\n","Epoch: [39871] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0236 (0.0247) time: 0.0940 data: 0.0161 max mem: 5716\n","Epoch: [39871] Total time: 0:00:01 (0.0980 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0236 (0.0247) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39872] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0250 (0.0250) time: 0.2903 data: 0.1909 max mem: 5716\n","Epoch: [39872] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0217 (0.0208) time: 0.0950 data: 0.0160 max mem: 5716\n","Epoch: [39872] Total time: 0:00:01 (0.0990 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0217 (0.0208) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39873] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0169 (0.0169) time: 0.2861 data: 0.1888 max mem: 5716\n","Epoch: [39873] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0199 (0.0208) time: 0.0941 data: 0.0159 max mem: 5716\n","Epoch: [39873] Total time: 0:00:01 (0.0994 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0199 (0.0208) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39874] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0185 (0.0185) time: 0.2919 data: 0.2028 max mem: 5716\n","Epoch: [39874] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0206 (0.0206) time: 0.0951 data: 0.0170 max mem: 5716\n","Epoch: [39874] Total time: 0:00:01 (0.0992 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0206 (0.0206) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39875] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0203 (0.0203) time: 0.2903 data: 0.2037 max mem: 5716\n","Epoch: [39875] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0226 (0.0235) time: 0.0947 data: 0.0171 max mem: 5716\n","Epoch: [39875] Total time: 0:00:01 (0.0988 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0226 (0.0235) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39876] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0200 (0.0200) time: 0.2938 data: 0.2064 max mem: 5716\n","Epoch: [39876] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0221 (0.0228) time: 0.0951 data: 0.0173 max mem: 5716\n","Epoch: [39876] Total time: 0:00:01 (0.0991 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0221 (0.0228) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39877] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0235 (0.0235) time: 0.2914 data: 0.2027 max mem: 5716\n","Epoch: [39877] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0223 (0.0231) time: 0.0980 data: 0.0170 max mem: 5716\n","Epoch: [39877] Total time: 0:00:01 (0.1021 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0223 (0.0231) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39878] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0250 (0.0250) time: 0.2920 data: 0.1980 max mem: 5716\n","Epoch: [39878] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0239 (0.0241) time: 0.0957 data: 0.0166 max mem: 5716\n","Epoch: [39878] Total time: 0:00:01 (0.0999 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0239 (0.0241) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39879] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0239 (0.0239) time: 0.2899 data: 0.2028 max mem: 5716\n","Epoch: [39879] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0239 (0.0242) time: 0.0954 data: 0.0170 max mem: 5716\n","Epoch: [39879] Total time: 0:00:01 (0.0995 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0239 (0.0242) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39880] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0246 (0.0246) time: 0.2882 data: 0.1988 max mem: 5716\n","Epoch: [39880] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0244 (0.0241) time: 0.0947 data: 0.0167 max mem: 5716\n","Epoch: [39880] Total time: 0:00:01 (0.0989 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0244 (0.0241) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39881] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0226 (0.0226) time: 0.2844 data: 0.1987 max mem: 5716\n","Epoch: [39881] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0206 (0.0207) time: 0.0970 data: 0.0167 max mem: 5716\n","Epoch: [39881] Total time: 0:00:01 (0.1012 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0206 (0.0207) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39882] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0215 (0.0215) time: 0.2916 data: 0.2046 max mem: 5716\n","Epoch: [39882] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0209 (0.0208) time: 0.0948 data: 0.0172 max mem: 5716\n","Epoch: [39882] Total time: 0:00:01 (0.0989 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0209 (0.0208) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39883] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0192 (0.0192) time: 0.2896 data: 0.2004 max mem: 5716\n","Epoch: [39883] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0205 (0.0206) time: 0.0947 data: 0.0168 max mem: 5716\n","Epoch: [39883] Total time: 0:00:01 (0.0988 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0205 (0.0206) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39884] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0253 (0.0253) time: 0.3036 data: 0.2053 max mem: 5716\n","Epoch: [39884] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0238 (0.0233) time: 0.0965 data: 0.0173 max mem: 5716\n","Epoch: [39884] Total time: 0:00:01 (0.1006 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0238 (0.0233) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39885] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0240 (0.0240) time: 0.3003 data: 0.2125 max mem: 5716\n","Epoch: [39885] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0236 (0.0236) time: 0.0969 data: 0.0179 max mem: 5716\n","Epoch: [39885] Total time: 0:00:01 (0.1010 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0236 (0.0236) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39886] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0199 (0.0199) time: 0.2989 data: 0.2111 max mem: 5716\n","Epoch: [39886] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0219 (0.0230) time: 0.0959 data: 0.0178 max mem: 5716\n","Epoch: [39886] Total time: 0:00:01 (0.1000 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0219 (0.0230) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39887] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0229 (0.0229) time: 0.2821 data: 0.1928 max mem: 5716\n","Epoch: [39887] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0252 (0.0245) time: 0.0943 data: 0.0162 max mem: 5716\n","Epoch: [39887] Total time: 0:00:01 (0.0985 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0252 (0.0245) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39888] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0224 (0.0224) time: 0.2961 data: 0.1993 max mem: 5716\n","Epoch: [39888] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0242 (0.0243) time: 0.0952 data: 0.0167 max mem: 5716\n","Epoch: [39888] Total time: 0:00:01 (0.1007 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0242 (0.0243) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39889] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0219 (0.0219) time: 0.2851 data: 0.1957 max mem: 5716\n","Epoch: [39889] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0246 (0.0245) time: 0.0949 data: 0.0165 max mem: 5716\n","Epoch: [39889] Total time: 0:00:01 (0.0989 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0246 (0.0245) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39890] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0160 (0.0160) time: 0.2920 data: 0.1973 max mem: 5716\n","Epoch: [39890] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0205 (0.0208) time: 0.0949 data: 0.0166 max mem: 5716\n","Epoch: [39890] Total time: 0:00:01 (0.0990 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0205 (0.0208) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39891] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0159 (0.0159) time: 0.2904 data: 0.2033 max mem: 5716\n","Epoch: [39891] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0208 (0.0208) time: 0.0948 data: 0.0171 max mem: 5716\n","Epoch: [39891] Total time: 0:00:01 (0.0989 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0208 (0.0208) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39892] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0215 (0.0215) time: 0.2812 data: 0.1919 max mem: 5716\n","Epoch: [39892] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0208 (0.0208) time: 0.0939 data: 0.0161 max mem: 5716\n","Epoch: [39892] Total time: 0:00:01 (0.0979 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0208 (0.0208) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39893] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0219 (0.0219) time: 0.2849 data: 0.1980 max mem: 5716\n","Epoch: [39893] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0224 (0.0230) time: 0.0942 data: 0.0167 max mem: 5716\n","Epoch: [39893] Total time: 0:00:01 (0.0983 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0224 (0.0230) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39894] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0202 (0.0202) time: 0.2939 data: 0.2006 max mem: 5716\n","Epoch: [39894] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0225 (0.0233) time: 0.0969 data: 0.0169 max mem: 5716\n","Epoch: [39894] Total time: 0:00:01 (0.1022 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0225 (0.0233) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39895] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0292 (0.0292) time: 0.2840 data: 0.1918 max mem: 5716\n","Epoch: [39895] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0231 (0.0233) time: 0.0956 data: 0.0161 max mem: 5716\n","Epoch: [39895] Total time: 0:00:01 (0.0997 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0231 (0.0233) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39896] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0261 (0.0261) time: 0.2865 data: 0.1966 max mem: 5716\n","Epoch: [39896] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0251 (0.0244) time: 0.0948 data: 0.0165 max mem: 5716\n","Epoch: [39896] Total time: 0:00:01 (0.0988 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0251 (0.0244) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39897] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0221 (0.0221) time: 0.2846 data: 0.1959 max mem: 5716\n","Epoch: [39897] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0241 (0.0241) time: 0.0946 data: 0.0165 max mem: 5716\n","Epoch: [39897] Total time: 0:00:01 (0.0987 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0241 (0.0241) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39898] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0242 (0.0242) time: 0.2873 data: 0.1970 max mem: 5716\n","Epoch: [39898] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0233 (0.0246) time: 0.0950 data: 0.0166 max mem: 5716\n","Epoch: [39898] Total time: 0:00:01 (0.0991 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0233 (0.0246) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39899] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0159 (0.0159) time: 0.2857 data: 0.1955 max mem: 5716\n","Epoch: [39899] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0203 (0.0208) time: 0.0950 data: 0.0164 max mem: 5716\n","Epoch: [39899] Total time: 0:00:01 (0.0990 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0203 (0.0208) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39900] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0206 (0.0206) time: 0.2858 data: 0.1963 max mem: 5716\n","Epoch: [39900] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0200 (0.0207) time: 0.0956 data: 0.0165 max mem: 5716\n","Epoch: [39900] Total time: 0:00:01 (0.0997 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0200 (0.0207) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39901] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0212 (0.0212) time: 0.2903 data: 0.2038 max mem: 5716\n","Epoch: [39901] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0207 (0.0211) time: 0.0948 data: 0.0171 max mem: 5716\n","Epoch: [39901] Total time: 0:00:01 (0.0989 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0207 (0.0211) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39902] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0253 (0.0253) time: 0.2925 data: 0.2059 max mem: 5716\n","Epoch: [39902] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0228 (0.0236) time: 0.0950 data: 0.0173 max mem: 5716\n","Epoch: [39902] Total time: 0:00:01 (0.0992 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0228 (0.0236) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39903] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0228 (0.0228) time: 0.2855 data: 0.1939 max mem: 5716\n","Epoch: [39903] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0238 (0.0234) time: 0.0952 data: 0.0163 max mem: 5716\n","Epoch: [39903] Total time: 0:00:01 (0.1008 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0238 (0.0234) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39904] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0245 (0.0245) time: 0.3069 data: 0.2161 max mem: 5716\n","Epoch: [39904] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0215 (0.0227) time: 0.1001 data: 0.0182 max mem: 5716\n","Epoch: [39904] Total time: 0:00:01 (0.1042 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0215 (0.0227) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39905] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0275 (0.0275) time: 0.2878 data: 0.1976 max mem: 5716\n","Epoch: [39905] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0232 (0.0238) time: 0.0958 data: 0.0166 max mem: 5716\n","Epoch: [39905] Total time: 0:00:01 (0.0999 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0232 (0.0238) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39906] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0192 (0.0192) time: 0.2968 data: 0.2001 max mem: 5716\n","Epoch: [39906] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0238 (0.0243) time: 0.0955 data: 0.0168 max mem: 5716\n","Epoch: [39906] Total time: 0:00:01 (0.0996 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0238 (0.0243) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39907] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0199 (0.0199) time: 0.2914 data: 0.2055 max mem: 5716\n","Epoch: [39907] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0248 (0.0246) time: 0.0948 data: 0.0173 max mem: 5716\n","Epoch: [39907] Total time: 0:00:01 (0.0990 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0248 (0.0246) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39908] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0173 (0.0173) time: 0.2855 data: 0.1958 max mem: 5716\n","Epoch: [39908] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0207 (0.0208) time: 0.0956 data: 0.0165 max mem: 5716\n","Epoch: [39908] Total time: 0:00:01 (0.0997 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0207 (0.0208) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39909] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0191 (0.0191) time: 0.2947 data: 0.2070 max mem: 5716\n","Epoch: [39909] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0193 (0.0207) time: 0.0954 data: 0.0174 max mem: 5716\n","Epoch: [39909] Total time: 0:00:01 (0.0994 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0193 (0.0207) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39910] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0285 (0.0285) time: 0.2918 data: 0.2030 max mem: 5716\n","Epoch: [39910] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0202 (0.0208) time: 0.0947 data: 0.0170 max mem: 5716\n","Epoch: [39910] Total time: 0:00:01 (0.0988 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0202 (0.0208) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39911] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0208 (0.0208) time: 0.2896 data: 0.1965 max mem: 5716\n","Epoch: [39911] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0224 (0.0232) time: 0.0985 data: 0.0165 max mem: 5716\n","Epoch: [39911] Total time: 0:00:01 (0.1027 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0224 (0.0232) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39912] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0301 (0.0301) time: 0.2783 data: 0.1896 max mem: 5716\n","Epoch: [39912] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0223 (0.0232) time: 0.0943 data: 0.0160 max mem: 5716\n","Epoch: [39912] Total time: 0:00:01 (0.0985 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0223 (0.0232) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39913] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0210 (0.0210) time: 0.2927 data: 0.1945 max mem: 5716\n","Epoch: [39913] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0228 (0.0232) time: 0.0949 data: 0.0164 max mem: 5716\n","Epoch: [39913] Total time: 0:00:01 (0.0991 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0228 (0.0232) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39914] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0237 (0.0237) time: 0.2910 data: 0.1938 max mem: 5716\n","Epoch: [39914] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0239 (0.0243) time: 0.0954 data: 0.0163 max mem: 5716\n","Epoch: [39914] Total time: 0:00:01 (0.0995 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0239 (0.0243) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39915] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0265 (0.0265) time: 0.2838 data: 0.1921 max mem: 5716\n","Epoch: [39915] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0240 (0.0241) time: 0.0950 data: 0.0162 max mem: 5716\n","Epoch: [39915] Total time: 0:00:01 (0.0990 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0240 (0.0241) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39916] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0249 (0.0249) time: 0.2802 data: 0.1892 max mem: 5716\n","Epoch: [39916] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0242 (0.0247) time: 0.0941 data: 0.0159 max mem: 5716\n","Epoch: [39916] Total time: 0:00:01 (0.0982 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0242 (0.0247) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39917] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0240 (0.0240) time: 0.2819 data: 0.1920 max mem: 5716\n","Epoch: [39917] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0202 (0.0206) time: 0.0943 data: 0.0161 max mem: 5716\n","Epoch: [39917] Total time: 0:00:01 (0.0983 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0202 (0.0206) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39918] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0181 (0.0181) time: 0.2849 data: 0.1963 max mem: 5716\n","Epoch: [39918] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0205 (0.0207) time: 0.0947 data: 0.0165 max mem: 5716\n","Epoch: [39918] Total time: 0:00:01 (0.0988 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0205 (0.0207) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39919] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0199 (0.0199) time: 0.2943 data: 0.2062 max mem: 5716\n","Epoch: [39919] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0196 (0.0209) time: 0.0958 data: 0.0174 max mem: 5716\n","Epoch: [39919] Total time: 0:00:01 (0.0999 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0196 (0.0209) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39920] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0219 (0.0219) time: 0.2956 data: 0.2021 max mem: 5716\n","Epoch: [39920] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0220 (0.0229) time: 0.0960 data: 0.0170 max mem: 5716\n","Epoch: [39920] Total time: 0:00:01 (0.1002 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0220 (0.0229) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39921] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0233 (0.0233) time: 0.2869 data: 0.1975 max mem: 5716\n","Epoch: [39921] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0233 (0.0237) time: 0.0961 data: 0.0166 max mem: 5716\n","Epoch: [39921] Total time: 0:00:01 (0.1002 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0233 (0.0237) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39922] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0205 (0.0205) time: 0.2975 data: 0.2094 max mem: 5716\n","Epoch: [39922] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0226 (0.0232) time: 0.0956 data: 0.0176 max mem: 5716\n","Epoch: [39922] Total time: 0:00:01 (0.0998 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0226 (0.0232) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39923] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0310 (0.0310) time: 0.2917 data: 0.2004 max mem: 5716\n","Epoch: [39923] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0240 (0.0245) time: 0.0959 data: 0.0169 max mem: 5716\n","Epoch: [39923] Total time: 0:00:01 (0.1000 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0240 (0.0245) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39924] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0221 (0.0221) time: 0.2885 data: 0.1977 max mem: 5716\n","Epoch: [39924] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0245 (0.0245) time: 0.0951 data: 0.0166 max mem: 5716\n","Epoch: [39924] Total time: 0:00:01 (0.0992 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0245 (0.0245) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39925] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0200 (0.0200) time: 0.2845 data: 0.1944 max mem: 5716\n","Epoch: [39925] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0229 (0.0242) time: 0.0948 data: 0.0164 max mem: 5716\n","Epoch: [39925] Total time: 0:00:01 (0.0989 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0229 (0.0242) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39926] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0186 (0.0186) time: 0.2945 data: 0.2040 max mem: 5716\n","Epoch: [39926] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0201 (0.0208) time: 0.0959 data: 0.0172 max mem: 5716\n","Epoch: [39926] Total time: 0:00:01 (0.1000 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0201 (0.0208) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39927] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0281 (0.0281) time: 0.2994 data: 0.2107 max mem: 5716\n","Epoch: [39927] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0200 (0.0208) time: 0.0958 data: 0.0177 max mem: 5716\n","Epoch: [39927] Total time: 0:00:01 (0.0999 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0200 (0.0208) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39928] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0241 (0.0241) time: 0.3006 data: 0.2132 max mem: 5716\n","Epoch: [39928] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0192 (0.0207) time: 0.0962 data: 0.0179 max mem: 5716\n","Epoch: [39928] Total time: 0:00:01 (0.1004 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0192 (0.0207) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39929] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0233 (0.0233) time: 0.2871 data: 0.1972 max mem: 5716\n","Epoch: [39929] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0230 (0.0232) time: 0.0949 data: 0.0166 max mem: 5716\n","Epoch: [39929] Total time: 0:00:01 (0.0990 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0230 (0.0232) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39930] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0245 (0.0245) time: 0.2902 data: 0.2019 max mem: 5716\n","Epoch: [39930] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0235 (0.0232) time: 0.0963 data: 0.0170 max mem: 5716\n","Epoch: [39930] Total time: 0:00:01 (0.1015 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0235 (0.0232) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39931] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0245 (0.0245) time: 0.2850 data: 0.1957 max mem: 5716\n","Epoch: [39931] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0228 (0.0229) time: 0.0946 data: 0.0165 max mem: 5716\n","Epoch: [39931] Total time: 0:00:01 (0.1000 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0228 (0.0229) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39932] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0278 (0.0278) time: 0.2972 data: 0.2096 max mem: 5716\n","Epoch: [39932] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0243 (0.0242) time: 0.0956 data: 0.0176 max mem: 5716\n","Epoch: [39932] Total time: 0:00:01 (0.0997 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0243 (0.0242) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39933] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0229 (0.0229) time: 0.2820 data: 0.1927 max mem: 5716\n","Epoch: [39933] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0240 (0.0244) time: 0.0942 data: 0.0162 max mem: 5716\n","Epoch: [39933] Total time: 0:00:01 (0.0983 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0240 (0.0244) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39934] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0244 (0.0244) time: 0.2879 data: 0.1984 max mem: 5716\n","Epoch: [39934] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0227 (0.0237) time: 0.0947 data: 0.0167 max mem: 5716\n","Epoch: [39934] Total time: 0:00:01 (0.0988 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0227 (0.0237) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39935] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0225 (0.0225) time: 0.2936 data: 0.2049 max mem: 5716\n","Epoch: [39935] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0207 (0.0209) time: 0.0957 data: 0.0172 max mem: 5716\n","Epoch: [39935] Total time: 0:00:01 (0.0997 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0207 (0.0209) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39936] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0219 (0.0219) time: 0.2897 data: 0.1987 max mem: 5716\n","Epoch: [39936] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0202 (0.0208) time: 0.0956 data: 0.0167 max mem: 5716\n","Epoch: [39936] Total time: 0:00:01 (0.0996 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0202 (0.0208) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39937] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0231 (0.0231) time: 0.2914 data: 0.2031 max mem: 5716\n","Epoch: [39937] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0208 (0.0208) time: 0.0954 data: 0.0171 max mem: 5716\n","Epoch: [39937] Total time: 0:00:01 (0.0996 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0208 (0.0208) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39938] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0229 (0.0229) time: 0.2989 data: 0.1956 max mem: 5716\n","Epoch: [39938] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0229 (0.0232) time: 0.0959 data: 0.0165 max mem: 5716\n","Epoch: [39938] Total time: 0:00:01 (0.1000 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0229 (0.0232) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39939] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0256 (0.0256) time: 0.2887 data: 0.1949 max mem: 5716\n","Epoch: [39939] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0226 (0.0232) time: 0.0978 data: 0.0164 max mem: 5716\n","Epoch: [39939] Total time: 0:00:01 (0.1020 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0226 (0.0232) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39940] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0284 (0.0284) time: 0.2880 data: 0.1989 max mem: 5716\n","Epoch: [39940] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0219 (0.0232) time: 0.0946 data: 0.0167 max mem: 5716\n","Epoch: [39940] Total time: 0:00:01 (0.0988 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0219 (0.0232) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39941] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0174 (0.0174) time: 0.2859 data: 0.1969 max mem: 5716\n","Epoch: [39941] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0237 (0.0240) time: 0.0951 data: 0.0166 max mem: 5716\n","Epoch: [39941] Total time: 0:00:01 (0.0993 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0237 (0.0240) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39942] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0194 (0.0194) time: 0.2897 data: 0.2033 max mem: 5716\n","Epoch: [39942] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0229 (0.0241) time: 0.0957 data: 0.0171 max mem: 5716\n","Epoch: [39942] Total time: 0:00:01 (0.0998 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0229 (0.0241) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39943] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0289 (0.0289) time: 0.2835 data: 0.1940 max mem: 5716\n","Epoch: [39943] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0248 (0.0244) time: 0.0974 data: 0.0163 max mem: 5716\n","Epoch: [39943] Total time: 0:00:01 (0.1016 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0248 (0.0244) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39944] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0221 (0.0221) time: 0.2894 data: 0.2006 max mem: 5716\n","Epoch: [39944] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0208 (0.0206) time: 0.0951 data: 0.0169 max mem: 5716\n","Epoch: [39944] Total time: 0:00:01 (0.0993 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0208 (0.0206) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39945] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0158 (0.0158) time: 0.2924 data: 0.1985 max mem: 5716\n","Epoch: [39945] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0209 (0.0206) time: 0.0958 data: 0.0167 max mem: 5716\n","Epoch: [39945] Total time: 0:00:01 (0.1000 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0209 (0.0206) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39946] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0274 (0.0274) time: 0.2913 data: 0.2048 max mem: 5716\n","Epoch: [39946] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0197 (0.0207) time: 0.0955 data: 0.0172 max mem: 5716\n","Epoch: [39946] Total time: 0:00:01 (0.0996 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0197 (0.0207) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39947] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0233 (0.0233) time: 0.2927 data: 0.2011 max mem: 5716\n","Epoch: [39947] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0233 (0.0233) time: 0.0969 data: 0.0169 max mem: 5716\n","Epoch: [39947] Total time: 0:00:01 (0.1011 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0233 (0.0233) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39948] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0241 (0.0241) time: 0.2860 data: 0.1948 max mem: 5716\n","Epoch: [39948] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0232 (0.0231) time: 0.0943 data: 0.0164 max mem: 5716\n","Epoch: [39948] Total time: 0:00:01 (0.0984 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0232 (0.0231) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39949] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0228 (0.0228) time: 0.2854 data: 0.1949 max mem: 5716\n","Epoch: [39949] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0225 (0.0232) time: 0.0944 data: 0.0164 max mem: 5716\n","Epoch: [39949] Total time: 0:00:01 (0.0985 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0225 (0.0232) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39950] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0236 (0.0236) time: 0.2852 data: 0.1960 max mem: 5716\n","Epoch: [39950] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0246 (0.0244) time: 0.0948 data: 0.0165 max mem: 5716\n","Epoch: [39950] Total time: 0:00:01 (0.0999 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0246 (0.0244) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39951] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0216 (0.0216) time: 0.2973 data: 0.1968 max mem: 5716\n","Epoch: [39951] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0241 (0.0246) time: 0.0957 data: 0.0166 max mem: 5716\n","Epoch: [39951] Total time: 0:00:01 (0.0998 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0241 (0.0246) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39952] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0257 (0.0257) time: 0.2933 data: 0.2065 max mem: 5716\n","Epoch: [39952] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0242 (0.0243) time: 0.0950 data: 0.0173 max mem: 5716\n","Epoch: [39952] Total time: 0:00:01 (0.0992 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0242 (0.0243) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39953] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0151 (0.0151) time: 0.2861 data: 0.1968 max mem: 5716\n","Epoch: [39953] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0201 (0.0207) time: 0.0950 data: 0.0165 max mem: 5716\n","Epoch: [39953] Total time: 0:00:01 (0.0991 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0201 (0.0207) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39954] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0177 (0.0177) time: 0.2907 data: 0.1996 max mem: 5716\n","Epoch: [39954] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0200 (0.0210) time: 0.0952 data: 0.0168 max mem: 5716\n","Epoch: [39954] Total time: 0:00:01 (0.0993 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0200 (0.0210) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39955] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0174 (0.0174) time: 0.2848 data: 0.1953 max mem: 5716\n","Epoch: [39955] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0198 (0.0204) time: 0.0944 data: 0.0164 max mem: 5716\n","Epoch: [39955] Total time: 0:00:01 (0.0985 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0198 (0.0204) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39956] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0263 (0.0263) time: 0.2876 data: 0.2002 max mem: 5716\n","Epoch: [39956] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0221 (0.0232) time: 0.0946 data: 0.0168 max mem: 5716\n","Epoch: [39956] Total time: 0:00:01 (0.0987 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0221 (0.0232) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39957] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0261 (0.0261) time: 0.2889 data: 0.1984 max mem: 5716\n","Epoch: [39957] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0230 (0.0237) time: 0.0955 data: 0.0167 max mem: 5716\n","Epoch: [39957] Total time: 0:00:01 (0.0997 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0230 (0.0237) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39958] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0267 (0.0267) time: 0.2839 data: 0.1946 max mem: 5716\n","Epoch: [39958] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0226 (0.0230) time: 0.0947 data: 0.0164 max mem: 5716\n","Epoch: [39958] Total time: 0:00:01 (0.0989 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0226 (0.0230) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39959] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0224 (0.0224) time: 0.2860 data: 0.1967 max mem: 5716\n","Epoch: [39959] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0224 (0.0243) time: 0.0945 data: 0.0165 max mem: 5716\n","Epoch: [39959] Total time: 0:00:01 (0.0986 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0224 (0.0243) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39960] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0271 (0.0271) time: 0.2851 data: 0.1935 max mem: 5716\n","Epoch: [39960] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0237 (0.0240) time: 0.0948 data: 0.0163 max mem: 5716\n","Epoch: [39960] Total time: 0:00:01 (0.0990 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0237 (0.0240) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39961] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0268 (0.0268) time: 0.2989 data: 0.2105 max mem: 5716\n","Epoch: [39961] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0239 (0.0245) time: 0.0967 data: 0.0177 max mem: 5716\n","Epoch: [39961] Total time: 0:00:01 (0.1022 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0239 (0.0245) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39962] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0193 (0.0193) time: 0.2939 data: 0.2054 max mem: 5716\n","Epoch: [39962] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0195 (0.0206) time: 0.0958 data: 0.0173 max mem: 5716\n","Epoch: [39962] Total time: 0:00:01 (0.1000 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0195 (0.0206) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39963] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0179 (0.0179) time: 0.2927 data: 0.2042 max mem: 5716\n","Epoch: [39963] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0186 (0.0209) time: 0.0953 data: 0.0172 max mem: 5716\n","Epoch: [39963] Total time: 0:00:01 (0.0994 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0186 (0.0209) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39964] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0207 (0.0207) time: 0.3069 data: 0.2036 max mem: 5716\n","Epoch: [39964] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0204 (0.0209) time: 0.0969 data: 0.0171 max mem: 5716\n","Epoch: [39964] Total time: 0:00:01 (0.1011 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0204 (0.0209) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39965] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0222 (0.0222) time: 0.2856 data: 0.1969 max mem: 5716\n","Epoch: [39965] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0225 (0.0228) time: 0.0941 data: 0.0165 max mem: 5716\n","Epoch: [39965] Total time: 0:00:01 (0.0995 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0225 (0.0228) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39966] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0210 (0.0210) time: 0.2983 data: 0.1982 max mem: 5716\n","Epoch: [39966] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0225 (0.0232) time: 0.0965 data: 0.0166 max mem: 5716\n","Epoch: [39966] Total time: 0:00:01 (0.1008 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0225 (0.0232) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39967] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0243 (0.0243) time: 0.2984 data: 0.2049 max mem: 5716\n","Epoch: [39967] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0226 (0.0233) time: 0.0952 data: 0.0172 max mem: 5716\n","Epoch: [39967] Total time: 0:00:01 (0.0993 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0226 (0.0233) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39968] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0262 (0.0262) time: 0.2845 data: 0.1961 max mem: 5716\n","Epoch: [39968] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0238 (0.0245) time: 0.0941 data: 0.0165 max mem: 5716\n","Epoch: [39968] Total time: 0:00:01 (0.0984 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0238 (0.0245) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39969] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0209 (0.0209) time: 0.2846 data: 0.1950 max mem: 5716\n","Epoch: [39969] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0240 (0.0244) time: 0.0943 data: 0.0164 max mem: 5716\n","Epoch: [39969] Total time: 0:00:01 (0.0985 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0240 (0.0244) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39970] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0211 (0.0211) time: 0.2852 data: 0.1950 max mem: 5716\n","Epoch: [39970] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0233 (0.0244) time: 0.0950 data: 0.0164 max mem: 5716\n","Epoch: [39970] Total time: 0:00:01 (0.0991 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0233 (0.0244) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39971] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0208 (0.0208) time: 0.3030 data: 0.2058 max mem: 5716\n","Epoch: [39971] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0198 (0.0207) time: 0.0977 data: 0.0173 max mem: 5716\n","Epoch: [39971] Total time: 0:00:01 (0.1019 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0198 (0.0207) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39972] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0205 (0.0205) time: 0.2925 data: 0.1988 max mem: 5716\n","Epoch: [39972] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0205 (0.0207) time: 0.0981 data: 0.0167 max mem: 5716\n","Epoch: [39972] Total time: 0:00:01 (0.1023 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0205 (0.0207) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39973] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0167 (0.0167) time: 0.2938 data: 0.2049 max mem: 5716\n","Epoch: [39973] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0207 (0.0207) time: 0.0987 data: 0.0172 max mem: 5716\n","Epoch: [39973] Total time: 0:00:01 (0.1028 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0207 (0.0207) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39974] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0226 (0.0226) time: 0.2919 data: 0.2046 max mem: 5716\n","Epoch: [39974] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0232 (0.0232) time: 0.0948 data: 0.0172 max mem: 5716\n","Epoch: [39974] Total time: 0:00:01 (0.0990 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0232 (0.0232) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39975] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0218 (0.0218) time: 0.2844 data: 0.1959 max mem: 5716\n","Epoch: [39975] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0224 (0.0235) time: 0.0943 data: 0.0165 max mem: 5716\n","Epoch: [39975] Total time: 0:00:01 (0.0985 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0224 (0.0235) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39976] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0216 (0.0216) time: 0.2888 data: 0.2026 max mem: 5716\n","Epoch: [39976] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0220 (0.0233) time: 0.0945 data: 0.0170 max mem: 5716\n","Epoch: [39976] Total time: 0:00:01 (0.0986 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0220 (0.0233) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39977] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0247 (0.0247) time: 0.2842 data: 0.1956 max mem: 5716\n","Epoch: [39977] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0244 (0.0242) time: 0.0944 data: 0.0164 max mem: 5716\n","Epoch: [39977] Total time: 0:00:01 (0.0985 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0244 (0.0242) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39978] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0191 (0.0191) time: 0.2922 data: 0.2048 max mem: 5716\n","Epoch: [39978] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0246 (0.0243) time: 0.0952 data: 0.0172 max mem: 5716\n","Epoch: [39978] Total time: 0:00:01 (0.0993 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0246 (0.0243) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39979] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0286 (0.0286) time: 0.2807 data: 0.1871 max mem: 5716\n","Epoch: [39979] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0236 (0.0245) time: 0.0946 data: 0.0158 max mem: 5716\n","Epoch: [39979] Total time: 0:00:01 (0.0987 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0236 (0.0245) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39980] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0223 (0.0223) time: 0.2803 data: 0.1911 max mem: 5716\n","Epoch: [39980] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0188 (0.0205) time: 0.0941 data: 0.0161 max mem: 5716\n","Epoch: [39980] Total time: 0:00:01 (0.0982 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0188 (0.0205) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39981] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0223 (0.0223) time: 0.2977 data: 0.2065 max mem: 5716\n","Epoch: [39981] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0204 (0.0208) time: 0.0962 data: 0.0174 max mem: 5716\n","Epoch: [39981] Total time: 0:00:01 (0.1004 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0204 (0.0208) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39982] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0197 (0.0197) time: 0.2786 data: 0.1891 max mem: 5716\n","Epoch: [39982] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0204 (0.0208) time: 0.0941 data: 0.0159 max mem: 5716\n","Epoch: [39982] Total time: 0:00:01 (0.0982 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0204 (0.0208) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39983] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0235 (0.0235) time: 0.2895 data: 0.2017 max mem: 5716\n","Epoch: [39983] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0229 (0.0230) time: 0.0953 data: 0.0170 max mem: 5716\n","Epoch: [39983] Total time: 0:00:01 (0.0994 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0229 (0.0230) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39984] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0242 (0.0242) time: 0.2954 data: 0.2106 max mem: 5716\n","Epoch: [39984] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0234 (0.0231) time: 0.0955 data: 0.0177 max mem: 5716\n","Epoch: [39984] Total time: 0:00:01 (0.0995 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0234 (0.0231) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39985] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0250 (0.0250) time: 0.2868 data: 0.2009 max mem: 5716\n","Epoch: [39985] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0231 (0.0234) time: 0.0946 data: 0.0169 max mem: 5716\n","Epoch: [39985] Total time: 0:00:01 (0.0987 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0231 (0.0234) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39986] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0230 (0.0230) time: 0.2831 data: 0.1945 max mem: 5716\n","Epoch: [39986] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0230 (0.0244) time: 0.0940 data: 0.0164 max mem: 5716\n","Epoch: [39986] Total time: 0:00:01 (0.0982 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0230 (0.0244) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39987] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0302 (0.0302) time: 0.2867 data: 0.1967 max mem: 5716\n","Epoch: [39987] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0234 (0.0243) time: 0.0948 data: 0.0165 max mem: 5716\n","Epoch: [39987] Total time: 0:00:01 (0.0991 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0234 (0.0243) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39988] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0286 (0.0286) time: 0.2916 data: 0.2012 max mem: 5716\n","Epoch: [39988] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0238 (0.0243) time: 0.0952 data: 0.0169 max mem: 5716\n","Epoch: [39988] Total time: 0:00:01 (0.0994 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0238 (0.0243) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39989] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0231 (0.0231) time: 0.2851 data: 0.1950 max mem: 5716\n","Epoch: [39989] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0200 (0.0207) time: 0.0948 data: 0.0164 max mem: 5716\n","Epoch: [39989] Total time: 0:00:01 (0.0990 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0200 (0.0207) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39990] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0203 (0.0203) time: 0.3000 data: 0.2131 max mem: 5716\n","Epoch: [39990] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0204 (0.0208) time: 0.0961 data: 0.0179 max mem: 5716\n","Epoch: [39990] Total time: 0:00:01 (0.1002 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0204 (0.0208) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39991] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0246 (0.0246) time: 0.2931 data: 0.2050 max mem: 5716\n","Epoch: [39991] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0210 (0.0208) time: 0.0978 data: 0.0172 max mem: 5716\n","Epoch: [39991] Total time: 0:00:01 (0.1020 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0210 (0.0208) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39992] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0255 (0.0255) time: 0.2835 data: 0.1954 max mem: 5716\n","Epoch: [39992] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0237 (0.0231) time: 0.0939 data: 0.0164 max mem: 5716\n","Epoch: [39992] Total time: 0:00:01 (0.0981 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0237 (0.0231) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39993] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0243 (0.0243) time: 0.2853 data: 0.1943 max mem: 5716\n","Epoch: [39993] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0235 (0.0234) time: 0.0943 data: 0.0164 max mem: 5716\n","Epoch: [39993] Total time: 0:00:01 (0.0984 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0235 (0.0234) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39994] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0220 (0.0220) time: 0.2834 data: 0.1945 max mem: 5716\n","Epoch: [39994] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0220 (0.0226) time: 0.0939 data: 0.0164 max mem: 5716\n","Epoch: [39994] Total time: 0:00:01 (0.0980 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0220 (0.0226) fix_position_ratio: 0.25 puzzle_patch_size: 32\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39995] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0207 (0.0207) time: 0.2875 data: 0.1968 max mem: 5716\n","Epoch: [39995] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0230 (0.0243) time: 0.0964 data: 0.0165 max mem: 5716\n","Epoch: [39995] Total time: 0:00:01 (0.1005 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0230 (0.0243) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39996] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0250 (0.0250) time: 0.2857 data: 0.1941 max mem: 5716\n","Epoch: [39996] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0249 (0.0242) time: 0.0955 data: 0.0163 max mem: 5716\n","Epoch: [39996] Total time: 0:00:01 (0.1005 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0249 (0.0242) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39997] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0232 (0.0232) time: 0.2845 data: 0.1943 max mem: 5716\n","Epoch: [39997] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0241 (0.0243) time: 0.0958 data: 0.0163 max mem: 5716\n","Epoch: [39997] Total time: 0:00:01 (0.0999 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0241 (0.0243) fix_position_ratio: 0.25 puzzle_patch_size: 112\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39998] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0228 (0.0228) time: 0.2939 data: 0.1968 max mem: 5716\n","Epoch: [39998] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0213 (0.0208) time: 0.0974 data: 0.0165 max mem: 5716\n","Epoch: [39998] Total time: 0:00:01 (0.1034 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0213 (0.0208) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","log_dir: /home/Pathology_Experiment/imaging_results/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20\n","Epoch: [39999] [ 0/12] eta: 0:00:03 lr: 0.000000 loss: 0.0227 (0.0227) time: 0.3011 data: 0.2095 max mem: 5716\n","Epoch: [39999] [11/12] eta: 0:00:00 lr: 0.000000 loss: 0.0222 (0.0211) time: 0.0963 data: 0.0176 max mem: 5716\n","Epoch: [39999] Total time: 0:00:01 (0.1004 s / it)\n","Averaged stats: lr: 0.000000 loss: 0.0222 (0.0211) fix_position_ratio: 0.25 puzzle_patch_size: 16\n","Figure(640x480)\n","Training time 17:43:58\n"]}],"source":["!python PuzzleTuning.py --model sae_vit_base_patch16 --PromptTuning Deep --batch_size 32 --group_shuffle_size 8 --strategy loop --blr 1.5e-5 --epochs 40000 --warmup_epochs 20 --accum_iter 2 --print_freq 200 --check_point_gap 10000 --input_size 224 --pin_mem --num_workers 2 --basic_state_dict timm --data_path /data/Pathology_Experiment/dataset/PuzzleTuning_demoset --output_dir /home/Pathology_Experiment/runs --log_dir /home/Pathology_Experiment/imaging_results"]},{"cell_type":"markdown","metadata":{"id":"toMbJKBKa7Sw"},"source":["Visulization"]},{"cell_type":"code","execution_count":null,"metadata":{"colab":{"background_save":true},"id":"v4jPIn7DbAaX"},"outputs":[{"name":"stdout","output_type":"stream","text":["\n","\n","Testing_PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20_b_8_hint_ratio_0.5_patch_size_16\n","\n","\n","Use 1 GPUs of idx: 0\n","job dir: /home/Pathology_Experiment/code\n","Namespace(model_idx='Testing_PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20_b_8_hint_ratio_0.5_patch_size_16',\n","batch_size=8,\n","model='sae_vit_base_patch16',\n","seg_decoder=None,\n","input_size=224,\n","num_classes=3,\n","mask_ratio=None,\n","fix_position_ratio=0.5,\n","fix_patch_size=16,\n","group_shuffle_size=-1,\n","shuffle_dataloader=False,\n","PromptTuning='Deep',\n","Prompt_Token_num=20,\n","norm_pix_loss=False,\n","data_path='/data/Pathology_Experiment/dataset/PuzzleTuning_demoset',\n","output_dir='/home/Pathology_Experiment/imaging_results',\n","log_dir='/home/Pathology_Experiment/imaging_results',\n","gpu_idx=0,\n","device='cuda',\n","seed=42,\n","checkpoint_path='/home/Pathology_Experiment/runs/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20_checkpoint-39999.pth',\n","combined_pred_illustration=False,\n","enable_visualize_check=True,\n","check_minibatch=None,\n","check_samples=1,\n","num_workers=10,\n","pin_mem=True,\n","gpu=1)\n","dataset_test Dataset ImageFolder\n"," Number of datapoints: 400\n"," Root location: /data/Pathology_Experiment/dataset/PuzzleTuning_demoset\n"," StandardTransform\n","Transform: Compose(\n"," Resize(size=224, interpolation=bilinear, max_size=None, antialias=warn)\n"," ToTensor()\n"," )\n","Testing output files will be at /home/Pathology_Experiment/imaging_results/Testing_PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20_b_8_hint_ratio_0.5_patch_size_16\n","Decoder: None\n","Start testing for Testing_PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20_b_8_hint_ratio_0.5_patch_size_16 \n"," with checkpoint: /home/Pathology_Experiment/runs/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20_checkpoint-39999.pth\n","Test index 1 of 1 minibatch with batch_size of 8 time used: 2.576171636581421\n","minibatch AVG loss: 0.026270559057593346\n","Figure(640x480)\n","Test index 2 of 1 minibatch with batch_size of 8 time used: 0.6659231185913086\n","minibatch AVG loss: 0.024316485971212387\n","Figure(640x480)\n","Test index 3 of 1 minibatch with batch_size of 8 time used: 0.34589219093322754\n","minibatch AVG loss: 0.029779721051454544\n","Figure(640x480)\n","Test index 4 of 1 minibatch with batch_size of 8 time used: 0.3440580368041992\n","minibatch AVG loss: 0.034707095474004745\n","Figure(640x480)\n","Test index 5 of 1 minibatch with batch_size of 8 time used: 0.3439669609069824\n","minibatch AVG loss: 0.029156949371099472\n","Figure(640x480)\n","Test index 6 of 1 minibatch with batch_size of 8 time used: 0.3427398204803467\n","minibatch AVG loss: 0.02971576154232025\n","Figure(640x480)\n","Test index 7 of 1 minibatch with batch_size of 8 time used: 0.5957798957824707\n","minibatch AVG loss: 0.0266494769603014\n","Figure(640x480)\n","Test index 8 of 1 minibatch with batch_size of 8 time used: 0.34395861625671387\n","minibatch AVG loss: 0.034395135939121246\n","Figure(640x480)\n","Test index 9 of 1 minibatch with batch_size of 8 time used: 0.3422093391418457\n","minibatch AVG loss: 0.01643659919500351\n","Figure(640x480)\n","Test index 10 of 1 minibatch with batch_size of 8 time used: 0.34267401695251465\n","minibatch AVG loss: 0.027027731761336327\n","Figure(640x480)\n","Test index 11 of 1 minibatch with batch_size of 8 time used: 0.34317874908447266\n","minibatch AVG loss: 0.03650519251823425\n","Figure(640x480)\n","Test index 12 of 1 minibatch with batch_size of 8 time used: 0.34625768661499023\n","minibatch AVG loss: 0.023865383118391037\n","Figure(640x480)\n","Test index 13 of 1 minibatch with batch_size of 8 time used: 0.34453797340393066\n","minibatch AVG loss: 0.027605310082435608\n","Figure(640x480)\n","Test index 14 of 1 minibatch with batch_size of 8 time used: 0.35005617141723633\n","minibatch AVG loss: 0.05249357223510742\n","Figure(640x480)\n","Test index 15 of 1 minibatch with batch_size of 8 time used: 0.34470367431640625\n","minibatch AVG loss: 0.06539571285247803\n","Figure(640x480)\n","Test index 16 of 1 minibatch with batch_size of 8 time used: 0.34235501289367676\n","minibatch AVG loss: 0.0607786625623703\n","Figure(640x480)\n","Test index 17 of 1 minibatch with batch_size of 8 time used: 0.5056579113006592\n","minibatch AVG loss: 0.0522107295691967\n","Figure(640x480)\n","Test index 18 of 1 minibatch with batch_size of 8 time used: 0.3416411876678467\n","minibatch AVG loss: 0.04164537042379379\n","Figure(640x480)\n","Test index 19 of 1 minibatch with batch_size of 8 time used: 0.341935396194458\n","minibatch AVG loss: 0.05334985628724098\n","Figure(640x480)\n","Test index 20 of 1 minibatch with batch_size of 8 time used: 0.34108638763427734\n","minibatch AVG loss: 0.04166930913925171\n","Figure(640x480)\n","Test index 21 of 1 minibatch with batch_size of 8 time used: 0.34204626083374023\n","minibatch AVG loss: 0.0406920425593853\n","Figure(640x480)\n","Test index 22 of 1 minibatch with batch_size of 8 time used: 0.3456096649169922\n","minibatch AVG loss: 0.04499432444572449\n","Figure(640x480)\n","Test index 23 of 1 minibatch with batch_size of 8 time used: 0.3513031005859375\n","minibatch AVG loss: 0.049177490174770355\n","Figure(640x480)\n","Test index 24 of 1 minibatch with batch_size of 8 time used: 0.34375739097595215\n","minibatch AVG loss: 0.0517561100423336\n","Figure(640x480)\n","Test index 25 of 1 minibatch with batch_size of 8 time used: 0.35756635665893555\n","minibatch AVG loss: 0.053525157272815704\n","Figure(640x480)\n","Test index 26 of 1 minibatch with batch_size of 8 time used: 0.3438384532928467\n","minibatch AVG loss: 0.016326481476426125\n","Figure(640x480)\n","Test index 27 of 1 minibatch with batch_size of 8 time used: 0.5202908515930176\n","minibatch AVG loss: 0.023099487647414207\n","Figure(640x480)\n","Test index 28 of 1 minibatch with batch_size of 8 time used: 0.3466987609863281\n","minibatch AVG loss: 0.020996764302253723\n","Figure(640x480)\n","Test index 29 of 1 minibatch with batch_size of 8 time used: 0.3557114601135254\n","minibatch AVG loss: 0.02975727617740631\n","Figure(640x480)\n","Test index 30 of 1 minibatch with batch_size of 8 time used: 0.35158228874206543\n","minibatch AVG loss: 0.022020038217306137\n","Figure(640x480)\n","Test index 31 of 1 minibatch with batch_size of 8 time used: 0.3453495502471924\n","minibatch AVG loss: 0.02332591824233532\n","Figure(640x480)\n","Test index 32 of 1 minibatch with batch_size of 8 time used: 0.353748083114624\n","minibatch AVG loss: 0.022864310070872307\n","Figure(640x480)\n","Test index 33 of 1 minibatch with batch_size of 8 time used: 0.3469088077545166\n","minibatch AVG loss: 0.027498576790094376\n","Figure(640x480)\n","Test index 34 of 1 minibatch with batch_size of 8 time used: 0.3442854881286621\n","minibatch AVG loss: 0.028304098173975945\n","Figure(640x480)\n","Test index 35 of 1 minibatch with batch_size of 8 time used: 0.3444187641143799\n","minibatch AVG loss: 0.024217385798692703\n","Figure(640x480)\n","Test index 36 of 1 minibatch with batch_size of 8 time used: 0.34152936935424805\n","minibatch AVG loss: 0.020597632974386215\n","Figure(640x480)\n","Test index 37 of 1 minibatch with batch_size of 8 time used: 0.34096765518188477\n","minibatch AVG loss: 0.025661714375019073\n","Figure(640x480)\n","Test index 38 of 1 minibatch with batch_size of 8 time used: 0.5249478816986084\n","minibatch AVG loss: 0.03880901634693146\n","Figure(640x480)\n","Test index 39 of 1 minibatch with batch_size of 8 time used: 0.35788869857788086\n","minibatch AVG loss: 0.04646195098757744\n","Figure(640x480)\n","Test index 40 of 1 minibatch with batch_size of 8 time used: 0.34569787979125977\n","minibatch AVG loss: 0.054550252854824066\n","Figure(640x480)\n","Test index 41 of 1 minibatch with batch_size of 8 time used: 0.3424832820892334\n","minibatch AVG loss: 0.04401148483157158\n","Figure(640x480)\n","Test index 42 of 1 minibatch with batch_size of 8 time used: 0.3472878932952881\n","minibatch AVG loss: 0.053878482431173325\n","Figure(640x480)\n","Test index 43 of 1 minibatch with batch_size of 8 time used: 0.3536717891693115\n","minibatch AVG loss: 0.04746308550238609\n","Figure(640x480)\n","Test index 44 of 1 minibatch with batch_size of 8 time used: 0.343564510345459\n","minibatch AVG loss: 0.04708326607942581\n","Figure(640x480)\n","Test index 45 of 1 minibatch with batch_size of 8 time used: 0.3419811725616455\n","minibatch AVG loss: 0.04378387704491615\n","Figure(640x480)\n","Test index 46 of 1 minibatch with batch_size of 8 time used: 0.3454432487487793\n","minibatch AVG loss: 0.043106887489557266\n","Figure(640x480)\n","Test index 47 of 1 minibatch with batch_size of 8 time used: 0.34154748916625977\n","minibatch AVG loss: 0.06279397755861282\n","Figure(640x480)\n","Test index 48 of 1 minibatch with batch_size of 8 time used: 0.5151286125183105\n","minibatch AVG loss: 0.05888595059514046\n","Figure(640x480)\n","Test index 49 of 1 minibatch with batch_size of 8 time used: 0.3433067798614502\n","minibatch AVG loss: 0.04294142872095108\n","Figure(640x480)\n","Test index 50 of 1 minibatch with batch_size of 8 time used: 0.34302759170532227\n","minibatch AVG loss: 0.056246597319841385\n","Figure(640x480)\n","\n","Test_dataset_size: 400 \n","Avg Loss: 0.0380\n","Testing time 0:00:21\n"]}],"source":["!python PuzzleTesting.py --model sae_vit_base_patch16 --PromptTuning Deep --Prompt_Token_num 20 --batch_size 8 --fix_position_ratio 0.5 --fix_patch_size 16 --enable_visualize_check --data_path /data/Pathology_Experiment/dataset/PuzzleTuning_demoset --output_dir /home/Pathology_Experiment/imaging_results --log_dir /home/Pathology_Experiment/imaging_results --checkpoint_path /home/Pathology_Experiment/runs/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20_checkpoint-39999.pth"]},{"cell_type":"markdown","metadata":{"id":"SbLcZyoHbBLR"},"source":["Load-up the ViT prompt weight from pre-trained checkpoint"]},{"cell_type":"code","execution_count":null,"metadata":{"colab":{"background_save":true},"id":"cECU8Q9XqAB1"},"outputs":[],"source":["os.chdir(\"/home/Pathology_Experiment/code/utils\")"]},{"cell_type":"code","execution_count":null,"metadata":{"colab":{"background_save":true},"id":"vhoXesRYbEal"},"outputs":[{"name":"stdout","output_type":"stream","text":["model forward cheacked\n","model is ready now!\n","checkpoint epoch 39999\n","DataParallel model loaded\n","model : ViT\n","prompt obtained\n","model trained by multi-GPUs has its single GPU copy saved at /home/Pathology_Experiment/saved_models/ViT_b16_224_timm_PuzzleTuning_SAE_CPIAm_Prompt_Deep_tokennum_20_promptstate.pth\n"]}],"source":["!python transfermodel.py --given_name ViT_b16_224_timm_PuzzleTuning_SAE_CPIAm_Prompt_Deep_tokennum_20_promptstate.pth --model_idx ViT --PromptTuning Deep --Prompt_Token_num 20 --edge_size 224 --checkpoint_path /home/Pathology_Experiment/runs/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20/PuzzleTuning_sae_vit_base_patch16_Prompt_Deep_tokennum_20_checkpoint-39999.pth --save_model_path /home/Pathology_Experiment/saved_models"]},{"cell_type":"markdown","metadata":{"id":"Ia9qphxi86wH"},"source":["# Finetuning and comparison\n","* set up path by command line\n","* use argparse to set down hyper-parameter"]},{"cell_type":"markdown","metadata":{"id":"akuwL6GlbF8h"},"source":["## Finetuning without PuzzleTuning"]},{"cell_type":"code","execution_count":null,"metadata":{"colab":{"background_save":true},"id":"yvoJWsQNrzhP"},"outputs":[],"source":["os.chdir(\"/home/Pathology_Experiment/code\")"]},{"cell_type":"markdown","metadata":{"id":"5cfIDQpn2L5H"},"source":["### ViT (with timm weight)"]},{"cell_type":"markdown","metadata":{"id":"0pgSCO1EbNSm"},"source":["Train"]},{"cell_type":"code","execution_count":null,"metadata":{"colab":{"background_save":true},"id":"xTNPSavybFTm"},"outputs":[{"name":"stdout","output_type":"stream","text":["class_names: ['benign', 'malignant']\n","*********************************setting*************************************\n","Namespace(model_idx='ViT_base_timm_401_lf15_finetuning_warwick_CLS', drop_rate=0.0, attn_drop_rate=0.0, drop_path_rate=0.0, cls_token_off=False, pos_embedding_off=False, att_module='SimAM', backbone_PT_off=False, gpu_idx=-1, dataroot='/data/Pathology_Experiment/dataset/warwick_CLS', model_path='/home/Pathology_Experiment/saved_models', draw_root='/home/Pathology_Experiment/runs/ViT_finetuning_with_timm', paint=True, enable_tensorboard=True, enable_attention_check=False, enable_visualize_check=False, PromptTuning=None, Prompt_Token_num=20, PromptUnFreeze=False, linearprobing=False, Pre_Trained_model_path=None, Prompt_state_path=None, enable_sam=False, augmentation_name=None, ratio_strategy=None, patch_strategy=None, loss_drive_threshold=4.0, fix_position_ratio=0.5, fix_patch_size=None, patch_size_jump=None, num_classes=0, edge_size=224, data_augmentation_mode=3, batch_size=8, num_epochs=50, intake_epochs=0, lr=1e-05, lrf=0.15, opt_name='Adam', check_minibatch=None, num_workers=2)\n","we dont have more GPU idx here, try to use gpu_idx=0\n","['convit_base',\n"," 'convit_small',\n"," 'convit_tiny',\n"," 'crossvit_9_240',\n"," 'crossvit_9_dagger_240',\n"," 'crossvit_15_240',\n"," 'crossvit_15_dagger_240',\n"," 'crossvit_15_dagger_408',\n"," 'crossvit_18_240',\n"," 'crossvit_18_dagger_240',\n"," 'crossvit_18_dagger_408',\n"," 'crossvit_base_240',\n"," 'crossvit_small_240',\n"," 'crossvit_tiny_240',\n"," 'levit_128',\n"," 'levit_128s',\n"," 'levit_192',\n"," 'levit_256',\n"," 'levit_384',\n"," 'vit_base_patch8_224',\n"," 'vit_base_patch8_224_in21k',\n"," 'vit_base_patch16_224',\n"," 'vit_base_patch16_224_in21k',\n"," 'vit_base_patch16_224_miil',\n"," 'vit_base_patch16_224_miil_in21k',\n"," 'vit_base_patch16_384',\n"," 'vit_base_patch16_sam_224',\n"," 'vit_base_patch32_224',\n"," 'vit_base_patch32_224_in21k',\n"," 'vit_base_patch32_384',\n"," 'vit_base_patch32_sam_224',\n"," 'vit_base_r26_s32_224',\n"," 'vit_base_r50_s16_224',\n"," 'vit_base_r50_s16_224_in21k',\n"," 'vit_base_r50_s16_384',\n"," 'vit_base_resnet26d_224',\n"," 'vit_base_resnet50_224_in21k',\n"," 'vit_base_resnet50_384',\n"," 'vit_base_resnet50d_224',\n"," 'vit_giant_patch14_224',\n"," 'vit_gigantic_patch14_224',\n"," 'vit_huge_patch14_224',\n"," 'vit_huge_patch14_224_in21k',\n"," 'vit_large_patch16_224',\n"," 'vit_large_patch16_224_in21k',\n"," 'vit_large_patch16_384',\n"," 'vit_large_patch32_224',\n"," 'vit_large_patch32_224_in21k',\n"," 'vit_large_patch32_384',\n"," 'vit_large_r50_s32_224',\n"," 'vit_large_r50_s32_224_in21k',\n"," 'vit_large_r50_s32_384',\n"," 'vit_small_patch16_224',\n"," 'vit_small_patch16_224_in21k',\n"," 'vit_small_patch16_384',\n"," 'vit_small_patch32_224',\n"," 'vit_small_patch32_224_in21k',\n"," 'vit_small_patch32_384',\n"," 'vit_small_r26_s32_224',\n"," 'vit_small_r26_s32_224_in21k',\n"," 'vit_small_r26_s32_384',\n"," 'vit_small_resnet26d_224',\n"," 'vit_small_resnet50d_s16_224',\n"," 'vit_tiny_patch16_224',\n"," 'vit_tiny_patch16_224_in21k',\n"," 'vit_tiny_patch16_384',\n"," 'vit_tiny_r_s16_p8_224',\n"," 'vit_tiny_r_s16_p8_224_in21k',\n"," 'vit_tiny_r_s16_p8_384']\n","test model output： tensor([[-0.4719, 2.0119]], grad_fn=\u003cAddmmBackward0\u003e)\n","model is ready now!\n","building model (no-prompt) with pretrained_backbone status: True\n","timm loaded\n","GPU: 0\n","----------------------------------------------------------------\n"," Layer (type) Output Shape Param #\n","================================================================\n"," Conv2d-1 [-1, 768, 14, 14] 590,592\n"," Identity-2 [-1, 196, 768] 0\n"," PatchEmbed-3 [-1, 196, 768] 0\n"," Dropout-4 [-1, 197, 768] 0\n"," LayerNorm-5 [-1, 197, 768] 1,536\n"," Linear-6 [-1, 197, 2304] 1,771,776\n"," Dropout-7 [-1, 12, 197, 197] 0\n"," Linear-8 [-1, 197, 768] 590,592\n"," Dropout-9 [-1, 197, 768] 0\n"," Attention-10 [-1, 197, 768] 0\n"," Identity-11 [-1, 197, 768] 0\n"," LayerNorm-12 [-1, 197, 768] 1,536\n"," Linear-13 [-1, 197, 3072] 2,362,368\n"," GELU-14 [-1, 197, 3072] 0\n"," Dropout-15 [-1, 197, 3072] 0\n"," Linear-16 [-1, 197, 768] 2,360,064\n"," Dropout-17 [-1, 197, 768] 0\n"," Mlp-18 [-1, 197, 768] 0\n"," Identity-19 [-1, 197, 768] 0\n"," Block-20 [-1, 197, 768] 0\n"," LayerNorm-21 [-1, 197, 768] 1,536\n"," Linear-22 [-1, 197, 2304] 1,771,776\n"," Dropout-23 [-1, 12, 197, 197] 0\n"," Linear-24 [-1, 197, 768] 590,592\n"," Dropout-25 [-1, 197, 768] 0\n"," Attention-26 [-1, 197, 768] 0\n"," Identity-27 [-1, 197, 768] 0\n"," LayerNorm-28 [-1, 197, 768] 1,536\n"," Linear-29 [-1, 197, 3072] 2,362,368\n"," GELU-30 [-1, 197, 3072] 0\n"," Dropout-31 [-1, 197, 3072] 0\n"," Linear-32 [-1, 197, 768] 2,360,064\n"," Dropout-33 [-1, 197, 768] 0\n"," Mlp-34 [-1, 197, 768] 0\n"," Identity-35 [-1, 197, 768] 0\n"," Block-36 [-1, 197, 768] 0\n"," LayerNorm-37 [-1, 197, 768] 1,536\n"," Linear-38 [-1, 197, 2304] 1,771,776\n"," Dropout-39 [-1, 12, 197, 197] 0\n"," Linear-40 [-1, 197, 768] 590,592\n"," Dropout-41 [-1, 197, 768] 0\n"," Attention-42 [-1, 197, 768] 0\n"," Identity-43 [-1, 197, 768] 0\n"," LayerNorm-44 [-1, 197, 768] 1,536\n"," Linear-45 [-1, 197, 3072] 2,362,368\n"," GELU-46 [-1, 197, 3072] 0\n"," Dropout-47 [-1, 197, 3072] 0\n"," Linear-48 [-1, 197, 768] 2,360,064\n"," Dropout-49 [-1, 197, 768] 0\n"," Mlp-50 [-1, 197, 768] 0\n"," Identity-51 [-1, 197, 768] 0\n"," Block-52 [-1, 197, 768] 0\n"," LayerNorm-53 [-1, 197, 768] 1,536\n"," Linear-54 [-1, 197, 2304] 1,771,776\n"," Dropout-55 [-1, 12, 197, 197] 0\n"," Linear-56 [-1, 197, 768] 590,592\n"," Dropout-57 [-1, 197, 768] 0\n"," Attention-58 [-1, 197, 768] 0\n"," Identity-59 [-1, 197, 768] 0\n"," LayerNorm-60 [-1, 197, 768] 1,536\n"," Linear-61 [-1, 197, 3072] 2,362,368\n"," GELU-62 [-1, 197, 3072] 0\n"," Dropout-63 [-1, 197, 3072] 0\n"," Linear-64 [-1, 197, 768] 2,360,064\n"," Dropout-65 [-1, 197, 768] 0\n"," Mlp-66 [-1, 197, 768] 0\n"," Identity-67 [-1, 197, 768] 0\n"," Block-68 [-1, 197, 768] 0\n"," LayerNorm-69 [-1, 197, 768] 1,536\n"," Linear-70 [-1, 197, 2304] 1,771,776\n"," Dropout-71 [-1, 12, 197, 197] 0\n"," Linear-72 [-1, 197, 768] 590,592\n"," Dropout-73 [-1, 197, 768] 0\n"," Attention-74 [-1, 197, 768] 0\n"," Identity-75 [-1, 197, 768] 0\n"," LayerNorm-76 [-1, 197, 768] 1,536\n"," Linear-77 [-1, 197, 3072] 2,362,368\n"," GELU-78 [-1, 197, 3072] 0\n"," Dropout-79 [-1, 197, 3072] 0\n"," Linear-80 [-1, 197, 768] 2,360,064\n"," Dropout-81 [-1, 197, 768] 0\n"," Mlp-82 [-1, 197, 768] 0\n"," Identity-83 [-1, 197, 768] 0\n"," Block-84 [-1, 197, 768] 0\n"," LayerNorm-85 [-1, 197, 768] 1,536\n"," Linear-86 [-1, 197, 2304] 1,771,776\n"," Dropout-87 [-1, 12, 197, 197] 0\n"," Linear-88 [-1, 197, 768] 590,592\n"," Dropout-89 [-1, 197, 768] 0\n"," Attention-90 [-1, 197, 768] 0\n"," Identity-91 [-1, 197, 768] 0\n"," LayerNorm-92 [-1, 197, 768] 1,536\n"," Linear-93 [-1, 197, 3072] 2,362,368\n"," GELU-94 [-1, 197, 3072] 0\n"," Dropout-95 [-1, 197, 3072] 0\n"," Linear-96 [-1, 197, 768] 2,360,064\n"," Dropout-97 [-1, 197, 768] 0\n"," Mlp-98 [-1, 197, 768] 0\n"," Identity-99 [-1, 197, 768] 0\n"," Block-100 [-1, 197, 768] 0\n"," LayerNorm-101 [-1, 197, 768] 1,536\n"," Linear-102 [-1, 197, 2304] 1,771,776\n"," Dropout-103 [-1, 12, 197, 197] 0\n"," Linear-104 [-1, 197, 768] 590,592\n"," Dropout-105 [-1, 197, 768] 0\n"," Attention-106 [-1, 197, 768] 0\n"," Identity-107 [-1, 197, 768] 0\n"," LayerNorm-108 [-1, 197, 768] 1,536\n"," Linear-109 [-1, 197, 3072] 2,362,368\n"," GELU-110 [-1, 197, 3072] 0\n"," Dropout-111 [-1, 197, 3072] 0\n"," Linear-112 [-1, 197, 768] 2,360,064\n"," Dropout-113 [-1, 197, 768] 0\n"," Mlp-114 [-1, 197, 768] 0\n"," Identity-115 [-1, 197, 768] 0\n"," Block-116 [-1, 197, 768] 0\n"," LayerNorm-117 [-1, 197, 768] 1,536\n"," Linear-118 [-1, 197, 2304] 1,771,776\n"," Dropout-119 [-1, 12, 197, 197] 0\n"," Linear-120 [-1, 197, 768] 590,592\n"," Dropout-121 [-1, 197, 768] 0\n"," Attention-122 [-1, 197, 768] 0\n"," Identity-123 [-1, 197, 768] 0\n"," LayerNorm-124 [-1, 197, 768] 1,536\n"," Linear-125 [-1, 197, 3072] 2,362,368\n"," GELU-126 [-1, 197, 3072] 0\n"," Dropout-127 [-1, 197, 3072] 0\n"," Linear-128 [-1, 197, 768] 2,360,064\n"," Dropout-129 [-1, 197, 768] 0\n"," Mlp-130 [-1, 197, 768] 0\n"," Identity-131 [-1, 197, 768] 0\n"," Block-132 [-1, 197, 768] 0\n"," LayerNorm-133 [-1, 197, 768] 1,536\n"," Linear-134 [-1, 197, 2304] 1,771,776\n"," Dropout-135 [-1, 12, 197, 197] 0\n"," Linear-136 [-1, 197, 768] 590,592\n"," Dropout-137 [-1, 197, 768] 0\n"," Attention-138 [-1, 197, 768] 0\n"," Identity-139 [-1, 197, 768] 0\n"," LayerNorm-140 [-1, 197, 768] 1,536\n"," Linear-141 [-1, 197, 3072] 2,362,368\n"," GELU-142 [-1, 197, 3072] 0\n"," Dropout-143 [-1, 197, 3072] 0\n"," Linear-144 [-1, 197, 768] 2,360,064\n"," Dropout-145 [-1, 197, 768] 0\n"," Mlp-146 [-1, 197, 768] 0\n"," Identity-147 [-1, 197, 768] 0\n"," Block-148 [-1, 197, 768] 0\n"," LayerNorm-149 [-1, 197, 768] 1,536\n"," Linear-150 [-1, 197, 2304] 1,771,776\n"," Dropout-151 [-1, 12, 197, 197] 0\n"," Linear-152 [-1, 197, 768] 590,592\n"," Dropout-153 [-1, 197, 768] 0\n"," Attention-154 [-1, 197, 768] 0\n"," Identity-155 [-1, 197, 768] 0\n"," LayerNorm-156 [-1, 197, 768] 1,536\n"," Linear-157 [-1, 197, 3072] 2,362,368\n"," GELU-158 [-1, 197, 3072] 0\n"," Dropout-159 [-1, 197, 3072] 0\n"," Linear-160 [-1, 197, 768] 2,360,064\n"," Dropout-161 [-1, 197, 768] 0\n"," Mlp-162 [-1, 197, 768] 0\n"," Identity-163 [-1, 197, 768] 0\n"," Block-164 [-1, 197, 768] 0\n"," LayerNorm-165 [-1, 197, 768] 1,536\n"," Linear-166 [-1, 197, 2304] 1,771,776\n"," Dropout-167 [-1, 12, 197, 197] 0\n"," Linear-168 [-1, 197, 768] 590,592\n"," Dropout-169 [-1, 197, 768] 0\n"," Attention-170 [-1, 197, 768] 0\n"," Identity-171 [-1, 197, 768] 0\n"," LayerNorm-172 [-1, 197, 768] 1,536\n"," Linear-173 [-1, 197, 3072] 2,362,368\n"," GELU-174 [-1, 197, 3072] 0\n"," Dropout-175 [-1, 197, 3072] 0\n"," Linear-176 [-1, 197, 768] 2,360,064\n"," Dropout-177 [-1, 197, 768] 0\n"," Mlp-178 [-1, 197, 768] 0\n"," Identity-179 [-1, 197, 768] 0\n"," Block-180 [-1, 197, 768] 0\n"," LayerNorm-181 [-1, 197, 768] 1,536\n"," Linear-182 [-1, 197, 2304] 1,771,776\n"," Dropout-183 [-1, 12, 197, 197] 0\n"," Linear-184 [-1, 197, 768] 590,592\n"," Dropout-185 [-1, 197, 768] 0\n"," Attention-186 [-1, 197, 768] 0\n"," Identity-187 [-1, 197, 768] 0\n"," LayerNorm-188 [-1, 197, 768] 1,536\n"," Linear-189 [-1, 197, 3072] 2,362,368\n"," GELU-190 [-1, 197, 3072] 0\n"," Dropout-191 [-1, 197, 3072] 0\n"," Linear-192 [-1, 197, 768] 2,360,064\n"," Dropout-193 [-1, 197, 768] 0\n"," Mlp-194 [-1, 197, 768] 0\n"," Identity-195 [-1, 197, 768] 0\n"," Block-196 [-1, 197, 768] 0\n"," LayerNorm-197 [-1, 197, 768] 1,536\n"," Identity-198 [-1, 768] 0\n"," Linear-199 [-1, 2] 1,538\n","================================================================\n","Total params: 85,648,130\n","Trainable params: 85,648,130\n","Non-trainable params: 0\n","----------------------------------------------------------------\n","Input size (MB): 0.57\n","Forward/backward pass size (MB): 408.54\n","Params size (MB): 326.72\n","Estimated Total Size (MB): 735.83\n","----------------------------------------------------------------\n","model : ViT_base_timm_401_lf15_finetuning_warwick_CLS\n","no valid counterparts augmentation selected\n","Epoch 1/50\n","----------\n","\n","Epoch: 1 train \n","Loss: 0.4487 Acc: 71.0145\n","benign precision: 76.9231 recall: 68.9655\n","benign sensitivity: 68.9655 specificity: 82.8571\n","benign FPR: 17.1429 NPV: 76.3158\n","benign TP: 20.0\n","benign TN: 29.0\n","benign FP: 6.0\n","benign FN: 9.0\n","malignant precision: 76.3158 recall: 82.8571\n","malignant sensitivity: 82.8571 specificity: 68.9655\n","malignant FPR: 31.0345 NPV: 76.9231\n","malignant TP: 29.0\n","malignant TN: 20.0\n","malignant FP: 9.0\n","malignant FN: 6.0\n","\n","\n","\n","Epoch: 1 val \n","Loss: 0.0832 Acc: 93.7500\n","benign precision: 87.5000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 88.8889\n","benign FPR: 11.1111 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 8.0\n","benign FP: 1.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 88.8889\n","malignant sensitivity: 88.8889 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 87.5000\n","malignant TP: 8.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 1.0\n","\n","\n","\n","Epoch 2/50\n","----------\n","\n","Epoch: 2 train \n","Loss: 0.0566 Acc: 91.3043\n","benign precision: 96.4286 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 97.2973\n","benign FPR: 2.7027 NPV: 100.0000\n","benign TP: 27.0\n","benign TN: 36.0\n","benign FP: 1.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 97.2973\n","malignant sensitivity: 97.2973 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 96.4286\n","malignant TP: 36.0\n","malignant TN: 27.0\n","malignant FP: 0.0\n","malignant FN: 1.0\n","\n","\n","\n","Epoch: 2 val \n","Loss: 0.2076 Acc: 87.5000\n","benign precision: 100.0000 recall: 71.4286\n","benign sensitivity: 71.4286 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 81.8182\n","benign TP: 5.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 2.0\n","malignant precision: 81.8182 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 71.4286\n","malignant FPR: 28.5714 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 5.0\n","malignant FP: 2.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 3/50\n","----------\n","\n","Epoch: 3 train \n","Loss: 0.0412 Acc: 89.8551\n","benign precision: 100.0000 recall: 93.1034\n","benign sensitivity: 93.1034 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 94.5946\n","benign TP: 27.0\n","benign TN: 35.0\n","benign FP: 0.0\n","benign FN: 2.0\n","malignant precision: 94.5946 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 93.1034\n","malignant FPR: 6.8966 NPV: 100.0000\n","malignant TP: 35.0\n","malignant TN: 27.0\n","malignant FP: 2.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 3 val \n","Loss: 0.0047 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 4/50\n","----------\n","\n","Epoch: 4 train \n","Loss: 0.0056 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 28.0\n","benign TN: 36.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 36.0\n","malignant TN: 28.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 4 val \n","Loss: 0.0107 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 5/50\n","----------\n","\n","Epoch: 5 train \n","Loss: 0.0021 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 26.0\n","benign TN: 38.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 38.0\n","malignant TN: 26.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 5 val \n","Loss: 0.0044 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 6/50\n","----------\n","\n","Epoch: 6 train \n","Loss: 0.0006 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 27.0\n","benign TN: 37.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 37.0\n","malignant TN: 27.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 6 val \n","Loss: 0.0027 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 7/50\n","----------\n","\n","Epoch: 7 train \n","Loss: 0.0004 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 28.0\n","benign TN: 36.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 36.0\n","malignant TN: 28.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 7 val \n","Loss: 0.0024 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 8/50\n","----------\n","\n","Epoch: 8 train \n","Loss: 0.0004 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 26.0\n","benign TN: 38.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 38.0\n","malignant TN: 26.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 8 val \n","Loss: 0.0025 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 9/50\n","----------\n","\n","Epoch: 9 train \n","Loss: 0.0002 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 27.0\n","benign TN: 37.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 37.0\n","malignant TN: 27.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 9 val \n","Loss: 0.0026 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 10/50\n","----------\n","\n","Epoch: 10 train \n","Loss: 0.0002 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 29.0\n","benign TN: 35.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 35.0\n","malignant TN: 29.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 10 val \n","Loss: 0.0028 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 11/50\n","----------\n","\n","Epoch: 11 train \n","Loss: 0.0007 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 27.0\n","benign TN: 37.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 37.0\n","malignant TN: 27.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 11 val \n","Loss: 0.0027 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 12/50\n","----------\n","\n","Epoch: 12 train \n","Loss: 0.0003 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 28.0\n","benign TN: 36.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 36.0\n","malignant TN: 28.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 12 val \n","Loss: 0.0024 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 13/50\n","----------\n","\n","Epoch: 13 train \n","Loss: 0.0003 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 27.0\n","benign TN: 37.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 37.0\n","malignant TN: 27.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 13 val \n","Loss: 0.0024 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 14/50\n","----------\n","\n","Epoch: 14 train \n","Loss: 0.0004 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 29.0\n","benign TN: 35.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 35.0\n","malignant TN: 29.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 14 val \n","Loss: 0.0024 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 15/50\n","----------\n","\n","Epoch: 15 train \n","Loss: 0.0002 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 28.0\n","benign TN: 36.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 36.0\n","malignant TN: 28.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 15 val \n","Loss: 0.0024 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 16/50\n","----------\n","\n","Epoch: 16 train \n","Loss: 0.0005 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 28.0\n","benign TN: 36.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 36.0\n","malignant TN: 28.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 16 val \n","Loss: 0.0024 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 17/50\n","----------\n","\n","Epoch: 17 train \n","Loss: 0.0003 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 28.0\n","benign TN: 36.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 36.0\n","malignant TN: 28.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 17 val \n","Loss: 0.0024 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 18/50\n","----------\n","\n","Epoch: 18 train \n","Loss: 0.0002 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 26.0\n","benign TN: 38.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 38.0\n","malignant TN: 26.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 18 val \n","Loss: 0.0024 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 19/50\n","----------\n","\n","Epoch: 19 train \n","Loss: 0.0002 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 27.0\n","benign TN: 37.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 37.0\n","malignant TN: 27.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 19 val \n","Loss: 0.0025 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 20/50\n","----------\n","\n","Epoch: 20 train \n","Loss: 0.0002 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 28.0\n","benign TN: 36.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 36.0\n","malignant TN: 28.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 20 val \n","Loss: 0.0025 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 21/50\n","----------\n","\n","Epoch: 21 train \n","Loss: 0.0005 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 29.0\n","benign TN: 35.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 35.0\n","malignant TN: 29.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 21 val \n","Loss: 0.0024 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 22/50\n","----------\n","\n","Epoch: 22 train \n","Loss: 0.0003 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 27.0\n","benign TN: 37.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 37.0\n","malignant TN: 27.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 22 val \n","Loss: 0.0025 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 23/50\n","----------\n","\n","Epoch: 23 train \n","Loss: 0.0003 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 27.0\n","benign TN: 37.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 37.0\n","malignant TN: 27.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 23 val \n","Loss: 0.0025 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 24/50\n","----------\n","\n","Epoch: 24 train \n","Loss: 0.0002 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 28.0\n","benign TN: 36.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 36.0\n","malignant TN: 28.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 24 val \n","Loss: 0.0026 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 25/50\n","----------\n","\n","Epoch: 25 train \n","Loss: 0.0002 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 27.0\n","benign TN: 37.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 37.0\n","malignant TN: 27.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 25 val \n","Loss: 0.0026 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 26/50\n","----------\n","\n","Epoch: 26 train \n","Loss: 0.0002 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 28.0\n","benign TN: 36.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 36.0\n","malignant TN: 28.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 26 val \n","Loss: 0.0026 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 27/50\n","----------\n","\n","Epoch: 27 train \n","Loss: 0.0002 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 28.0\n","benign TN: 36.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 36.0\n","malignant TN: 28.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 27 val \n","Loss: 0.0026 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 28/50\n","----------\n","\n","Epoch: 28 train \n","Loss: 0.0002 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 27.0\n","benign TN: 37.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 37.0\n","malignant TN: 27.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 28 val \n","Loss: 0.0026 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 29/50\n","----------\n","\n","Epoch: 29 train \n","Loss: 0.0002 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 27.0\n","benign TN: 37.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 37.0\n","malignant TN: 27.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 29 val \n","Loss: 0.0026 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 30/50\n","----------\n","\n","Epoch: 30 train \n","Loss: 0.0003 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 27.0\n","benign TN: 37.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 37.0\n","malignant TN: 27.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 30 val \n","Loss: 0.0026 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 31/50\n","----------\n","\n","Epoch: 31 train \n","Loss: 0.0003 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 28.0\n","benign TN: 36.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 36.0\n","malignant TN: 28.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 31 val \n","Loss: 0.0025 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 32/50\n","----------\n","\n","Epoch: 32 train \n","Loss: 0.0002 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 28.0\n","benign TN: 36.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 36.0\n","malignant TN: 28.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 32 val \n","Loss: 0.0025 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 33/50\n","----------\n","\n","Epoch: 33 train \n","Loss: 0.0002 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 29.0\n","benign TN: 35.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 35.0\n","malignant TN: 29.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 33 val \n","Loss: 0.0025 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 34/50\n","----------\n","\n","Epoch: 34 train \n","Loss: 0.0003 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 28.0\n","benign TN: 36.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 36.0\n","malignant TN: 28.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 34 val \n","Loss: 0.0025 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 35/50\n","----------\n","\n","Epoch: 35 train \n","Loss: 0.0002 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 29.0\n","benign TN: 35.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 35.0\n","malignant TN: 29.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 35 val \n","Loss: 0.0025 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 36/50\n","----------\n","\n","Epoch: 36 train \n","Loss: 0.0002 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 28.0\n","benign TN: 36.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 36.0\n","malignant TN: 28.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 36 val \n","Loss: 0.0024 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 37/50\n","----------\n","\n","Epoch: 37 train \n","Loss: 0.0002 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 29.0\n","benign TN: 35.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 35.0\n","malignant TN: 29.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 37 val \n","Loss: 0.0024 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 38/50\n","----------\n","\n","Epoch: 38 train \n","Loss: 0.0003 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 27.0\n","benign TN: 37.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 37.0\n","malignant TN: 27.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 38 val \n","Loss: 0.0024 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 39/50\n","----------\n","\n","Epoch: 39 train \n","Loss: 0.0004 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 27.0\n","benign TN: 37.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 37.0\n","malignant TN: 27.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 39 val \n","Loss: 0.0024 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 40/50\n","----------\n","\n","Epoch: 40 train \n","Loss: 0.0003 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 29.0\n","benign TN: 35.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 35.0\n","malignant TN: 29.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 40 val \n","Loss: 0.0023 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 41/50\n","----------\n","\n","Epoch: 41 train \n","Loss: 0.0002 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 27.0\n","benign TN: 37.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 37.0\n","malignant TN: 27.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 41 val \n","Loss: 0.0023 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 42/50\n","----------\n","\n","Epoch: 42 train \n","Loss: 0.0002 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 27.0\n","benign TN: 37.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 37.0\n","malignant TN: 27.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 42 val \n","Loss: 0.0023 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 43/50\n","----------\n","\n","Epoch: 43 train \n","Loss: 0.0002 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 28.0\n","benign TN: 36.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 36.0\n","malignant TN: 28.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 43 val \n","Loss: 0.0023 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 44/50\n","----------\n","\n","Epoch: 44 train \n","Loss: 0.0002 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 30.0\n","benign TN: 34.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 34.0\n","malignant TN: 30.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 44 val \n","Loss: 0.0023 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 45/50\n","----------\n","\n","Epoch: 45 train \n","Loss: 0.0002 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 27.0\n","benign TN: 37.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 37.0\n","malignant TN: 27.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 45 val \n","Loss: 0.0023 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 46/50\n","----------\n","\n","Epoch: 46 train \n","Loss: 0.0003 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 29.0\n","benign TN: 35.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 35.0\n","malignant TN: 29.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 46 val \n","Loss: 0.0023 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 47/50\n","----------\n","\n","Epoch: 47 train \n","Loss: 0.0002 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 28.0\n","benign TN: 36.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 36.0\n","malignant TN: 28.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 47 val \n","Loss: 0.0023 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 48/50\n","----------\n","\n","Epoch: 48 train \n","Loss: 0.0003 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 29.0\n","benign TN: 35.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 35.0\n","malignant TN: 29.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 48 val \n","Loss: 0.0023 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 49/50\n","----------\n","\n","Epoch: 49 train \n","Loss: 0.0003 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 28.0\n","benign TN: 36.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 36.0\n","malignant TN: 28.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 49 val \n","Loss: 0.0023 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 50/50\n","----------\n","\n","Epoch: 50 train \n","Loss: 0.0003 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 27.0\n","benign TN: 37.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 37.0\n","malignant TN: 27.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 50 val \n","Loss: 0.0023 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Training complete in 0m 53s\n","Best epoch idx: 50\n","Best epoch train Acc: 92.753623\n","Best epoch val Acc: 100.000000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","model trained by GPU (idx:0) has been saved at /home/Pathology_Experiment/saved_models/CLS_ViT_base_timm_401_lf15_finetuning_warwick_CLS.pth\n"]}],"source":["!python Train.py --edge_size 224 --data_augmentation_mode 3 --lr 1e-05 --lrf 0.15 --enable_tensorboard --model_idx ViT_base_timm_401_lf15_finetuning_warwick_CLS --dataroot /data/Pathology_Experiment/dataset/warwick_CLS --draw_root /home/Pathology_Experiment/runs/ViT_finetuning_with_timm --model_path /home/Pathology_Experiment/saved_models"]},{"cell_type":"markdown","metadata":{"id":"Di0tovUQbPb1"},"source":["Test"]},{"cell_type":"code","execution_count":null,"metadata":{"colab":{"background_save":true},"id":"3HeuBzgsbQJ6"},"outputs":[{"name":"stdout","output_type":"stream","text":["class_names: ['benign', 'malignant']\n","['convit_base',\n"," 'convit_small',\n"," 'convit_tiny',\n"," 'crossvit_9_240',\n"," 'crossvit_9_dagger_240',\n"," 'crossvit_15_240',\n"," 'crossvit_15_dagger_240',\n"," 'crossvit_15_dagger_408',\n"," 'crossvit_18_240',\n"," 'crossvit_18_dagger_240',\n"," 'crossvit_18_dagger_408',\n"," 'crossvit_base_240',\n"," 'crossvit_small_240',\n"," 'crossvit_tiny_240',\n"," 'levit_128',\n"," 'levit_128s',\n"," 'levit_192',\n"," 'levit_256',\n"," 'levit_384',\n"," 'vit_base_patch8_224',\n"," 'vit_base_patch8_224_in21k',\n"," 'vit_base_patch16_224',\n"," 'vit_base_patch16_224_in21k',\n"," 'vit_base_patch16_224_miil',\n"," 'vit_base_patch16_224_miil_in21k',\n"," 'vit_base_patch16_384',\n"," 'vit_base_patch16_sam_224',\n"," 'vit_base_patch32_224',\n"," 'vit_base_patch32_224_in21k',\n"," 'vit_base_patch32_384',\n"," 'vit_base_patch32_sam_224',\n"," 'vit_base_r26_s32_224',\n"," 'vit_base_r50_s16_224',\n"," 'vit_base_r50_s16_224_in21k',\n"," 'vit_base_r50_s16_384',\n"," 'vit_base_resnet26d_224',\n"," 'vit_base_resnet50_224_in21k',\n"," 'vit_base_resnet50_384',\n"," 'vit_base_resnet50d_224',\n"," 'vit_giant_patch14_224',\n"," 'vit_gigantic_patch14_224',\n"," 'vit_huge_patch14_224',\n"," 'vit_huge_patch14_224_in21k',\n"," 'vit_large_patch16_224',\n"," 'vit_large_patch16_224_in21k',\n"," 'vit_large_patch16_384',\n"," 'vit_large_patch32_224',\n"," 'vit_large_patch32_224_in21k',\n"," 'vit_large_patch32_384',\n"," 'vit_large_r50_s32_224',\n"," 'vit_large_r50_s32_224_in21k',\n"," 'vit_large_r50_s32_384',\n"," 'vit_small_patch16_224',\n"," 'vit_small_patch16_224_in21k',\n"," 'vit_small_patch16_384',\n"," 'vit_small_patch32_224',\n"," 'vit_small_patch32_224_in21k',\n"," 'vit_small_patch32_384',\n"," 'vit_small_r26_s32_224',\n"," 'vit_small_r26_s32_224_in21k',\n"," 'vit_small_r26_s32_384',\n"," 'vit_small_resnet26d_224',\n"," 'vit_small_resnet50d_s16_224',\n"," 'vit_tiny_patch16_224',\n"," 'vit_tiny_patch16_224_in21k',\n"," 'vit_tiny_patch16_384',\n"," 'vit_tiny_r_s16_p8_224',\n"," 'vit_tiny_r_s16_p8_224_in21k',\n"," 'vit_tiny_r_s16_p8_384']\n","test model output： tensor([[-0.2566, -0.2077]], grad_fn=\u003cAddmmBackward0\u003e)\n","model is ready now!\n","model loaded\n","model : ViT_base_timm_401_lf15_finetuning_warwick_CLS\n","*********************************setting*************************************\n","Namespace(model_idx='ViT_base_timm_401_lf15_finetuning_warwick_CLS', drop_rate=0.0, attn_drop_rate=0.0, drop_path_rate=0.0, cls_token_off=False, pos_embedding_off=False, att_module='SimAM', gpu_idx=0, dataroot='/data/Pathology_Experiment/dataset/warwick_CLS', model_path='/home/Pathology_Experiment/saved_models', draw_root='/home/Pathology_Experiment/runs/ViT_finetuning_with_timm', model_path_by_hand=None, paint=True, enable_tensorboard=False, enable_attention_check=False, enable_visualize_check=False, data_augmentation_mode=3, PromptTuning=None, Prompt_Token_num=20, PromptUnFreeze=False, Pre_Trained_model_path=None, num_classes=0, edge_size=224, batch_size=1, check_minibatch=None)\n","Epoch: Test\n","----------\n","Epoch: test test index of 4 minibatch: 1 time used: 2.0843310356140137\n","minibatch AVG loss: 0.049242537235841155\n","Epoch: test test index of 4 minibatch: 2 time used: 0.04948902130126953\n","minibatch AVG loss: 0.0026592123062982864\n","Epoch: test test index of 4 minibatch: 3 time used: 0.049538612365722656\n","minibatch AVG loss: 7.384463651760598e-05\n","Epoch: test test index of 4 minibatch: 4 time used: 0.04914069175720215\n","minibatch AVG loss: 0.03960687841677668\n","Epoch: test test index of 4 minibatch: 5 time used: 0.04950857162475586\n","minibatch AVG loss: 0.20808867284495136\n","Epoch: test test index of 4 minibatch: 6 time used: 0.04882478713989258\n","minibatch AVG loss: 0.00309721480675762\n","Epoch: test test index of 4 minibatch: 7 time used: 0.05091118812561035\n","minibatch AVG loss: 0.09648202347295864\n","Epoch: test test index of 4 minibatch: 8 time used: 0.047635555267333984\n","minibatch AVG loss: 0.000145436038110347\n","Epoch: test test index of 4 minibatch: 9 time used: 0.04693150520324707\n","minibatch AVG loss: 0.0013968248640594538\n","Epoch: test test index of 4 minibatch: 10 time used: 0.04672741889953613\n","minibatch AVG loss: 0.001999404456000775\n","Epoch: test test index of 4 minibatch: 11 time used: 0.04696464538574219\n","minibatch AVG loss: 0.012991284020245075\n","Epoch: test test index of 4 minibatch: 12 time used: 0.04732871055603027\n","minibatch AVG loss: 0.0032983069049805636\n","Epoch: test test index of 4 minibatch: 13 time used: 0.04779481887817383\n","minibatch AVG loss: 0.0027486889557621907\n","Epoch: test test index of 4 minibatch: 14 time used: 0.04719042778015137\n","minibatch AVG loss: 0.002299645588209387\n","Epoch: test test index of 4 minibatch: 15 time used: 0.04710078239440918\n","minibatch AVG loss: 0.0003831974645436276\n","Epoch: test test index of 4 minibatch: 16 time used: 0.04697871208190918\n","minibatch AVG loss: 0.0005818266072310507\n","Epoch: test test index of 4 minibatch: 17 time used: 0.048592329025268555\n","minibatch AVG loss: 0.0008116918361338321\n","Epoch: test test index of 4 minibatch: 18 time used: 0.048664093017578125\n","minibatch AVG loss: 0.012041694470099173\n","Epoch: test test index of 4 minibatch: 19 time used: 0.04766678810119629\n","minibatch AVG loss: 6.261242378968745e-05\n","Epoch: test test index of 4 minibatch: 20 time used: 0.0470576286315918\n","minibatch AVG loss: 0.022635395129327662\n","\n","Epoch: test \n","Loss: 0.0230 Acc: 98.7500\n","benign precision: 100.0000 recall: 97.2973\n","benign sensitivity: 97.2973 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 97.7273\n","benign TP: 36.0\n","benign TN: 43.0\n","benign FP: 0.0\n","benign FN: 1.0\n","malignant precision: 97.7273 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 97.2973\n","malignant FPR: 2.7027 NPV: 100.0000\n","malignant TP: 43.0\n","malignant TN: 36.0\n","malignant FP: 1.0\n","malignant FN: 0.0\n","\n","\n","Testing complete in 0m 3s\n"]}],"source":["!python Test.py --edge_size 224 --data_augmentation_mode 3 --model_idx ViT_base_timm_401_lf15_finetuning_warwick_CLS --dataroot /data/Pathology_Experiment/dataset/warwick_CLS --draw_root /home/Pathology_Experiment/runs/ViT_finetuning_with_timm --model_path /home/Pathology_Experiment/saved_models"]},{"cell_type":"markdown","metadata":{"id":"I4siigu52Od8"},"source":["### VPT + finetuning (with timm weight)"]},{"cell_type":"markdown","metadata":{"id":"j8tEUJf22XL-"},"source":["Train"]},{"cell_type":"code","execution_count":null,"metadata":{"colab":{"background_save":true},"id":"3m2pR6ba2QWf"},"outputs":[{"name":"stdout","output_type":"stream","text":["class_names: ['benign', 'malignant']\n","*********************************setting*************************************\n","Namespace(model_idx='ViT_base_timm_PromptDeep_20_401_lf15_finetuning_warwick_CLS', drop_rate=0.0, attn_drop_rate=0.0, drop_path_rate=0.0, cls_token_off=False, pos_embedding_off=False, att_module='SimAM', backbone_PT_off=False, gpu_idx=-1, dataroot='/data/Pathology_Experiment/dataset/warwick_CLS', model_path='/home/Pathology_Experiment/saved_models', draw_root='/home/Pathology_Experiment/runs/VPT_finetuning_with_timm', paint=True, enable_tensorboard=True, enable_attention_check=False, enable_visualize_check=False, PromptTuning='Deep', Prompt_Token_num=20, PromptUnFreeze=False, linearprobing=False, Pre_Trained_model_path=None, Prompt_state_path=None, enable_sam=False, augmentation_name=None, ratio_strategy=None, patch_strategy=None, loss_drive_threshold=4.0, fix_position_ratio=0.5, fix_patch_size=None, patch_size_jump=None, num_classes=0, edge_size=224, data_augmentation_mode=3, batch_size=8, num_epochs=50, intake_epochs=0, lr=1e-05, lrf=0.15, opt_name='Adam', check_minibatch=None, num_workers=2)\n","we dont have more GPU idx here, try to use gpu_idx=0\n","PromptTuning of ViT_base_timm_PromptDeep_20_401_lf15_finetuning_warwick_CLS\n","Prompt VPT type: Deep\n","backbone base_state_dict of timm\n","prompting with empty prompt_state: prompt_state of None\n","in prompt model building, timm ViT loaded for base_state_dict\n","model forward cheacked\n","model is ready now!\n","GPU: 0\n","----------------------------------------------------------------\n"," Layer (type) Output Shape Param #\n","================================================================\n"," Conv2d-1 [-1, 768, 14, 14] 590,592\n"," Identity-2 [-1, 196, 768] 0\n"," PatchEmbed-3 [-1, 196, 768] 0\n"," Dropout-4 [-1, 197, 768] 0\n"," LayerNorm-5 [-1, 217, 768] 1,536\n"," Linear-6 [-1, 217, 2304] 1,771,776\n"," Dropout-7 [-1, 12, 217, 217] 0\n"," Linear-8 [-1, 217, 768] 590,592\n"," Dropout-9 [-1, 217, 768] 0\n"," Attention-10 [-1, 217, 768] 0\n"," Identity-11 [-1, 217, 768] 0\n"," LayerNorm-12 [-1, 217, 768] 1,536\n"," Linear-13 [-1, 217, 3072] 2,362,368\n"," GELU-14 [-1, 217, 3072] 0\n"," Dropout-15 [-1, 217, 3072] 0\n"," Linear-16 [-1, 217, 768] 2,360,064\n"," Dropout-17 [-1, 217, 768] 0\n"," Mlp-18 [-1, 217, 768] 0\n"," Identity-19 [-1, 217, 768] 0\n"," Block-20 [-1, 217, 768] 0\n"," LayerNorm-21 [-1, 217, 768] 1,536\n"," Linear-22 [-1, 217, 2304] 1,771,776\n"," Dropout-23 [-1, 12, 217, 217] 0\n"," Linear-24 [-1, 217, 768] 590,592\n"," Dropout-25 [-1, 217, 768] 0\n"," Attention-26 [-1, 217, 768] 0\n"," Identity-27 [-1, 217, 768] 0\n"," LayerNorm-28 [-1, 217, 768] 1,536\n"," Linear-29 [-1, 217, 3072] 2,362,368\n"," GELU-30 [-1, 217, 3072] 0\n"," Dropout-31 [-1, 217, 3072] 0\n"," Linear-32 [-1, 217, 768] 2,360,064\n"," Dropout-33 [-1, 217, 768] 0\n"," Mlp-34 [-1, 217, 768] 0\n"," Identity-35 [-1, 217, 768] 0\n"," Block-36 [-1, 217, 768] 0\n"," LayerNorm-37 [-1, 217, 768] 1,536\n"," Linear-38 [-1, 217, 2304] 1,771,776\n"," Dropout-39 [-1, 12, 217, 217] 0\n"," Linear-40 [-1, 217, 768] 590,592\n"," Dropout-41 [-1, 217, 768] 0\n"," Attention-42 [-1, 217, 768] 0\n"," Identity-43 [-1, 217, 768] 0\n"," LayerNorm-44 [-1, 217, 768] 1,536\n"," Linear-45 [-1, 217, 3072] 2,362,368\n"," GELU-46 [-1, 217, 3072] 0\n"," Dropout-47 [-1, 217, 3072] 0\n"," Linear-48 [-1, 217, 768] 2,360,064\n"," Dropout-49 [-1, 217, 768] 0\n"," Mlp-50 [-1, 217, 768] 0\n"," Identity-51 [-1, 217, 768] 0\n"," Block-52 [-1, 217, 768] 0\n"," LayerNorm-53 [-1, 217, 768] 1,536\n"," Linear-54 [-1, 217, 2304] 1,771,776\n"," Dropout-55 [-1, 12, 217, 217] 0\n"," Linear-56 [-1, 217, 768] 590,592\n"," Dropout-57 [-1, 217, 768] 0\n"," Attention-58 [-1, 217, 768] 0\n"," Identity-59 [-1, 217, 768] 0\n"," LayerNorm-60 [-1, 217, 768] 1,536\n"," Linear-61 [-1, 217, 3072] 2,362,368\n"," GELU-62 [-1, 217, 3072] 0\n"," Dropout-63 [-1, 217, 3072] 0\n"," Linear-64 [-1, 217, 768] 2,360,064\n"," Dropout-65 [-1, 217, 768] 0\n"," Mlp-66 [-1, 217, 768] 0\n"," Identity-67 [-1, 217, 768] 0\n"," Block-68 [-1, 217, 768] 0\n"," LayerNorm-69 [-1, 217, 768] 1,536\n"," Linear-70 [-1, 217, 2304] 1,771,776\n"," Dropout-71 [-1, 12, 217, 217] 0\n"," Linear-72 [-1, 217, 768] 590,592\n"," Dropout-73 [-1, 217, 768] 0\n"," Attention-74 [-1, 217, 768] 0\n"," Identity-75 [-1, 217, 768] 0\n"," LayerNorm-76 [-1, 217, 768] 1,536\n"," Linear-77 [-1, 217, 3072] 2,362,368\n"," GELU-78 [-1, 217, 3072] 0\n"," Dropout-79 [-1, 217, 3072] 0\n"," Linear-80 [-1, 217, 768] 2,360,064\n"," Dropout-81 [-1, 217, 768] 0\n"," Mlp-82 [-1, 217, 768] 0\n"," Identity-83 [-1, 217, 768] 0\n"," Block-84 [-1, 217, 768] 0\n"," LayerNorm-85 [-1, 217, 768] 1,536\n"," Linear-86 [-1, 217, 2304] 1,771,776\n"," Dropout-87 [-1, 12, 217, 217] 0\n"," Linear-88 [-1, 217, 768] 590,592\n"," Dropout-89 [-1, 217, 768] 0\n"," Attention-90 [-1, 217, 768] 0\n"," Identity-91 [-1, 217, 768] 0\n"," LayerNorm-92 [-1, 217, 768] 1,536\n"," Linear-93 [-1, 217, 3072] 2,362,368\n"," GELU-94 [-1, 217, 3072] 0\n"," Dropout-95 [-1, 217, 3072] 0\n"," Linear-96 [-1, 217, 768] 2,360,064\n"," Dropout-97 [-1, 217, 768] 0\n"," Mlp-98 [-1, 217, 768] 0\n"," Identity-99 [-1, 217, 768] 0\n"," Block-100 [-1, 217, 768] 0\n"," LayerNorm-101 [-1, 217, 768] 1,536\n"," Linear-102 [-1, 217, 2304] 1,771,776\n"," Dropout-103 [-1, 12, 217, 217] 0\n"," Linear-104 [-1, 217, 768] 590,592\n"," Dropout-105 [-1, 217, 768] 0\n"," Attention-106 [-1, 217, 768] 0\n"," Identity-107 [-1, 217, 768] 0\n"," LayerNorm-108 [-1, 217, 768] 1,536\n"," Linear-109 [-1, 217, 3072] 2,362,368\n"," GELU-110 [-1, 217, 3072] 0\n"," Dropout-111 [-1, 217, 3072] 0\n"," Linear-112 [-1, 217, 768] 2,360,064\n"," Dropout-113 [-1, 217, 768] 0\n"," Mlp-114 [-1, 217, 768] 0\n"," Identity-115 [-1, 217, 768] 0\n"," Block-116 [-1, 217, 768] 0\n"," LayerNorm-117 [-1, 217, 768] 1,536\n"," Linear-118 [-1, 217, 2304] 1,771,776\n"," Dropout-119 [-1, 12, 217, 217] 0\n"," Linear-120 [-1, 217, 768] 590,592\n"," Dropout-121 [-1, 217, 768] 0\n"," Attention-122 [-1, 217, 768] 0\n"," Identity-123 [-1, 217, 768] 0\n"," LayerNorm-124 [-1, 217, 768] 1,536\n"," Linear-125 [-1, 217, 3072] 2,362,368\n"," GELU-126 [-1, 217, 3072] 0\n"," Dropout-127 [-1, 217, 3072] 0\n"," Linear-128 [-1, 217, 768] 2,360,064\n"," Dropout-129 [-1, 217, 768] 0\n"," Mlp-130 [-1, 217, 768] 0\n"," Identity-131 [-1, 217, 768] 0\n"," Block-132 [-1, 217, 768] 0\n"," LayerNorm-133 [-1, 217, 768] 1,536\n"," Linear-134 [-1, 217, 2304] 1,771,776\n"," Dropout-135 [-1, 12, 217, 217] 0\n"," Linear-136 [-1, 217, 768] 590,592\n"," Dropout-137 [-1, 217, 768] 0\n"," Attention-138 [-1, 217, 768] 0\n"," Identity-139 [-1, 217, 768] 0\n"," LayerNorm-140 [-1, 217, 768] 1,536\n"," Linear-141 [-1, 217, 3072] 2,362,368\n"," GELU-142 [-1, 217, 3072] 0\n"," Dropout-143 [-1, 217, 3072] 0\n"," Linear-144 [-1, 217, 768] 2,360,064\n"," Dropout-145 [-1, 217, 768] 0\n"," Mlp-146 [-1, 217, 768] 0\n"," Identity-147 [-1, 217, 768] 0\n"," Block-148 [-1, 217, 768] 0\n"," LayerNorm-149 [-1, 217, 768] 1,536\n"," Linear-150 [-1, 217, 2304] 1,771,776\n"," Dropout-151 [-1, 12, 217, 217] 0\n"," Linear-152 [-1, 217, 768] 590,592\n"," Dropout-153 [-1, 217, 768] 0\n"," Attention-154 [-1, 217, 768] 0\n"," Identity-155 [-1, 217, 768] 0\n"," LayerNorm-156 [-1, 217, 768] 1,536\n"," Linear-157 [-1, 217, 3072] 2,362,368\n"," GELU-158 [-1, 217, 3072] 0\n"," Dropout-159 [-1, 217, 3072] 0\n"," Linear-160 [-1, 217, 768] 2,360,064\n"," Dropout-161 [-1, 217, 768] 0\n"," Mlp-162 [-1, 217, 768] 0\n"," Identity-163 [-1, 217, 768] 0\n"," Block-164 [-1, 217, 768] 0\n"," LayerNorm-165 [-1, 217, 768] 1,536\n"," Linear-166 [-1, 217, 2304] 1,771,776\n"," Dropout-167 [-1, 12, 217, 217] 0\n"," Linear-168 [-1, 217, 768] 590,592\n"," Dropout-169 [-1, 217, 768] 0\n"," Attention-170 [-1, 217, 768] 0\n"," Identity-171 [-1, 217, 768] 0\n"," LayerNorm-172 [-1, 217, 768] 1,536\n"," Linear-173 [-1, 217, 3072] 2,362,368\n"," GELU-174 [-1, 217, 3072] 0\n"," Dropout-175 [-1, 217, 3072] 0\n"," Linear-176 [-1, 217, 768] 2,360,064\n"," Dropout-177 [-1, 217, 768] 0\n"," Mlp-178 [-1, 217, 768] 0\n"," Identity-179 [-1, 217, 768] 0\n"," Block-180 [-1, 217, 768] 0\n"," LayerNorm-181 [-1, 217, 768] 1,536\n"," Linear-182 [-1, 217, 2304] 1,771,776\n"," Dropout-183 [-1, 12, 217, 217] 0\n"," Linear-184 [-1, 217, 768] 590,592\n"," Dropout-185 [-1, 217, 768] 0\n"," Attention-186 [-1, 217, 768] 0\n"," Identity-187 [-1, 217, 768] 0\n"," LayerNorm-188 [-1, 217, 768] 1,536\n"," Linear-189 [-1, 217, 3072] 2,362,368\n"," GELU-190 [-1, 217, 3072] 0\n"," Dropout-191 [-1, 217, 3072] 0\n"," Linear-192 [-1, 217, 768] 2,360,064\n"," Dropout-193 [-1, 217, 768] 0\n"," Mlp-194 [-1, 217, 768] 0\n"," Identity-195 [-1, 217, 768] 0\n"," Block-196 [-1, 217, 768] 0\n"," LayerNorm-197 [-1, 197, 768] 1,536\n"," Identity-198 [-1, 768] 0\n"," Linear-199 [-1, 2] 1,538\n","================================================================\n","Total params: 85,648,130\n","Trainable params: 1,538\n","Non-trainable params: 85,646,592\n","----------------------------------------------------------------\n","Input size (MB): 0.57\n","Forward/backward pass size (MB): 454.20\n","Params size (MB): 326.72\n","Estimated Total Size (MB): 781.49\n","----------------------------------------------------------------\n","model : ViT_base_timm_PromptDeep_20_401_lf15_finetuning_warwick_CLS\n","no valid counterparts augmentation selected\n","Epoch 1/50\n","----------\n","\n","Epoch: 1 train \n","Loss: 0.7798 Acc: 55.0725\n","benign precision: 55.5556 recall: 51.7241\n","benign sensitivity: 51.7241 specificity: 65.7143\n","benign FPR: 34.2857 NPV: 62.1622\n","benign TP: 15.0\n","benign TN: 23.0\n","benign FP: 12.0\n","benign FN: 14.0\n","malignant precision: 62.1622 recall: 65.7143\n","malignant sensitivity: 65.7143 specificity: 51.7241\n","malignant FPR: 48.2759 NPV: 55.5556\n","malignant TP: 23.0\n","malignant TN: 15.0\n","malignant FP: 14.0\n","malignant FN: 12.0\n","\n","\n","\n","Epoch: 1 val \n","Loss: 0.6996 Acc: 62.5000\n","benign precision: 60.0000 recall: 42.8571\n","benign sensitivity: 42.8571 specificity: 77.7778\n","benign FPR: 22.2222 NPV: 63.6364\n","benign TP: 3.0\n","benign TN: 7.0\n","benign FP: 2.0\n","benign FN: 4.0\n","malignant precision: 63.6364 recall: 77.7778\n","malignant sensitivity: 77.7778 specificity: 42.8571\n","malignant FPR: 57.1429 NPV: 60.0000\n","malignant TP: 7.0\n","malignant TN: 3.0\n","malignant FP: 4.0\n","malignant FN: 2.0\n","\n","\n","\n","Epoch 2/50\n","----------\n","\n","Epoch: 2 train \n","Loss: 0.5416 Acc: 62.3188\n","benign precision: 60.8696 recall: 53.8462\n","benign sensitivity: 53.8462 specificity: 76.3158\n","benign FPR: 23.6842 NPV: 70.7317\n","benign TP: 14.0\n","benign TN: 29.0\n","benign FP: 9.0\n","benign FN: 12.0\n","malignant precision: 70.7317 recall: 76.3158\n","malignant sensitivity: 76.3158 specificity: 53.8462\n","malignant FPR: 46.1538 NPV: 60.8696\n","malignant TP: 29.0\n","malignant TN: 14.0\n","malignant FP: 12.0\n","malignant FN: 9.0\n","\n","\n","\n","Epoch: 2 val \n","Loss: 0.5944 Acc: 75.0000\n","benign precision: 80.0000 recall: 57.1429\n","benign sensitivity: 57.1429 specificity: 88.8889\n","benign FPR: 11.1111 NPV: 72.7273\n","benign TP: 4.0\n","benign TN: 8.0\n","benign FP: 1.0\n","benign FN: 3.0\n","malignant precision: 72.7273 recall: 88.8889\n","malignant sensitivity: 88.8889 specificity: 57.1429\n","malignant FPR: 42.8571 NPV: 80.0000\n","malignant TP: 8.0\n","malignant TN: 4.0\n","malignant FP: 3.0\n","malignant FN: 1.0\n","\n","\n","\n","Epoch 3/50\n","----------\n","\n","Epoch: 3 train \n","Loss: 0.4691 Acc: 71.0145\n","benign precision: 78.9474 recall: 57.6923\n","benign sensitivity: 57.6923 specificity: 89.4737\n","benign FPR: 10.5263 NPV: 75.5556\n","benign TP: 15.0\n","benign TN: 34.0\n","benign FP: 4.0\n","benign FN: 11.0\n","malignant precision: 75.5556 recall: 89.4737\n","malignant sensitivity: 89.4737 specificity: 57.6923\n","malignant FPR: 42.3077 NPV: 78.9474\n","malignant TP: 34.0\n","malignant TN: 15.0\n","malignant FP: 11.0\n","malignant FN: 4.0\n","\n","\n","\n","Epoch: 3 val \n","Loss: 0.5269 Acc: 81.2500\n","benign precision: 100.0000 recall: 57.1429\n","benign sensitivity: 57.1429 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 75.0000\n","benign TP: 4.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 3.0\n","malignant precision: 75.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 57.1429\n","malignant FPR: 42.8571 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 4.0\n","malignant FP: 3.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 4/50\n","----------\n","\n","Epoch: 4 train \n","Loss: 0.3390 Acc: 81.1594\n","benign precision: 88.8889 recall: 82.7586\n","benign sensitivity: 82.7586 specificity: 91.4286\n","benign FPR: 8.5714 NPV: 86.4865\n","benign TP: 24.0\n","benign TN: 32.0\n","benign FP: 3.0\n","benign FN: 5.0\n","malignant precision: 86.4865 recall: 91.4286\n","malignant sensitivity: 91.4286 specificity: 82.7586\n","malignant FPR: 17.2414 NPV: 88.8889\n","malignant TP: 32.0\n","malignant TN: 24.0\n","malignant FP: 5.0\n","malignant FN: 3.0\n","\n","\n","\n","Epoch: 4 val \n","Loss: 0.4431 Acc: 81.2500\n","benign precision: 100.0000 recall: 57.1429\n","benign sensitivity: 57.1429 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 75.0000\n","benign TP: 4.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 3.0\n","malignant precision: 75.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 57.1429\n","malignant FPR: 42.8571 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 4.0\n","malignant FP: 3.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 5/50\n","----------\n","\n","Epoch: 5 train \n","Loss: 0.2642 Acc: 84.0580\n","benign precision: 88.8889 recall: 88.8889\n","benign sensitivity: 88.8889 specificity: 91.8919\n","benign FPR: 8.1081 NPV: 91.8919\n","benign TP: 24.0\n","benign TN: 34.0\n","benign FP: 3.0\n","benign FN: 3.0\n","malignant precision: 91.8919 recall: 91.8919\n","malignant sensitivity: 91.8919 specificity: 88.8889\n","malignant FPR: 11.1111 NPV: 88.8889\n","malignant TP: 34.0\n","malignant TN: 24.0\n","malignant FP: 3.0\n","malignant FN: 3.0\n","\n","\n","\n","Epoch: 5 val \n","Loss: 0.4339 Acc: 81.2500\n","benign precision: 100.0000 recall: 57.1429\n","benign sensitivity: 57.1429 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 75.0000\n","benign TP: 4.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 3.0\n","malignant precision: 75.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 57.1429\n","malignant FPR: 42.8571 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 4.0\n","malignant FP: 3.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 6/50\n","----------\n","\n","Epoch: 6 train \n","Loss: 0.2274 Acc: 88.4058\n","benign precision: 100.0000 recall: 88.4615\n","benign sensitivity: 88.4615 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 92.6829\n","benign TP: 23.0\n","benign TN: 38.0\n","benign FP: 0.0\n","benign FN: 3.0\n","malignant precision: 92.6829 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 88.4615\n","malignant FPR: 11.5385 NPV: 100.0000\n","malignant TP: 38.0\n","malignant TN: 23.0\n","malignant FP: 3.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 6 val \n","Loss: 0.3520 Acc: 81.2500\n","benign precision: 100.0000 recall: 57.1429\n","benign sensitivity: 57.1429 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 75.0000\n","benign TP: 4.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 3.0\n","malignant precision: 75.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 57.1429\n","malignant FPR: 42.8571 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 4.0\n","malignant FP: 3.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 7/50\n","----------\n","\n","Epoch: 7 train \n","Loss: 0.2065 Acc: 88.4058\n","benign precision: 96.1538 recall: 92.5926\n","benign sensitivity: 92.5926 specificity: 97.2973\n","benign FPR: 2.7027 NPV: 94.7368\n","benign TP: 25.0\n","benign TN: 36.0\n","benign FP: 1.0\n","benign FN: 2.0\n","malignant precision: 94.7368 recall: 97.2973\n","malignant sensitivity: 97.2973 specificity: 92.5926\n","malignant FPR: 7.4074 NPV: 96.1538\n","malignant TP: 36.0\n","malignant TN: 25.0\n","malignant FP: 2.0\n","malignant FN: 1.0\n","\n","\n","\n","Epoch: 7 val \n","Loss: 0.2767 Acc: 81.2500\n","benign precision: 100.0000 recall: 57.1429\n","benign sensitivity: 57.1429 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 75.0000\n","benign TP: 4.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 3.0\n","malignant precision: 75.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 57.1429\n","malignant FPR: 42.8571 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 4.0\n","malignant FP: 3.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 8/50\n","----------\n","\n","Epoch: 8 train \n","Loss: 0.1894 Acc: 88.4058\n","benign precision: 100.0000 recall: 90.0000\n","benign sensitivity: 90.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 91.8919\n","benign TP: 27.0\n","benign TN: 34.0\n","benign FP: 0.0\n","benign FN: 3.0\n","malignant precision: 91.8919 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 90.0000\n","malignant FPR: 10.0000 NPV: 100.0000\n","malignant TP: 34.0\n","malignant TN: 27.0\n","malignant FP: 3.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 8 val \n","Loss: 0.3026 Acc: 81.2500\n","benign precision: 100.0000 recall: 57.1429\n","benign sensitivity: 57.1429 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 75.0000\n","benign TP: 4.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 3.0\n","malignant precision: 75.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 57.1429\n","malignant FPR: 42.8571 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 4.0\n","malignant FP: 3.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 9/50\n","----------\n","\n","Epoch: 9 train \n","Loss: 0.1697 Acc: 88.4058\n","benign precision: 96.1538 recall: 92.5926\n","benign sensitivity: 92.5926 specificity: 97.2973\n","benign FPR: 2.7027 NPV: 94.7368\n","benign TP: 25.0\n","benign TN: 36.0\n","benign FP: 1.0\n","benign FN: 2.0\n","malignant precision: 94.7368 recall: 97.2973\n","malignant sensitivity: 97.2973 specificity: 92.5926\n","malignant FPR: 7.4074 NPV: 96.1538\n","malignant TP: 36.0\n","malignant TN: 25.0\n","malignant FP: 2.0\n","malignant FN: 1.0\n","\n","\n","\n","Epoch: 9 val \n","Loss: 0.1931 Acc: 93.7500\n","benign precision: 100.0000 recall: 85.7143\n","benign sensitivity: 85.7143 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 90.0000\n","benign TP: 6.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 1.0\n","malignant precision: 90.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 85.7143\n","malignant FPR: 14.2857 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 6.0\n","malignant FP: 1.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 10/50\n","----------\n","\n","Epoch: 10 train \n","Loss: 0.1084 Acc: 89.8551\n","benign precision: 96.4286 recall: 96.4286\n","benign sensitivity: 96.4286 specificity: 97.2222\n","benign FPR: 2.7778 NPV: 97.2222\n","benign TP: 27.0\n","benign TN: 35.0\n","benign FP: 1.0\n","benign FN: 1.0\n","malignant precision: 97.2222 recall: 97.2222\n","malignant sensitivity: 97.2222 specificity: 96.4286\n","malignant FPR: 3.5714 NPV: 96.4286\n","malignant TP: 35.0\n","malignant TN: 27.0\n","malignant FP: 1.0\n","malignant FN: 1.0\n","\n","\n","\n","Epoch: 10 val \n","Loss: 0.2491 Acc: 87.5000\n","benign precision: 100.0000 recall: 71.4286\n","benign sensitivity: 71.4286 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 81.8182\n","benign TP: 5.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 2.0\n","malignant precision: 81.8182 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 71.4286\n","malignant FPR: 28.5714 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 5.0\n","malignant FP: 2.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 11/50\n","----------\n","\n","Epoch: 11 train \n","Loss: 0.0966 Acc: 91.3043\n","benign precision: 100.0000 recall: 96.2963\n","benign sensitivity: 96.2963 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 97.3684\n","benign TP: 26.0\n","benign TN: 37.0\n","benign FP: 0.0\n","benign FN: 1.0\n","malignant precision: 97.3684 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 96.2963\n","malignant FPR: 3.7037 NPV: 100.0000\n","malignant TP: 37.0\n","malignant TN: 26.0\n","malignant FP: 1.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 11 val \n","Loss: 0.1859 Acc: 93.7500\n","benign precision: 100.0000 recall: 85.7143\n","benign sensitivity: 85.7143 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 90.0000\n","benign TP: 6.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 1.0\n","malignant precision: 90.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 85.7143\n","malignant FPR: 14.2857 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 6.0\n","malignant FP: 1.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 12/50\n","----------\n","\n","Epoch: 12 train \n","Loss: 0.0863 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 29.0\n","benign TN: 35.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 35.0\n","malignant TN: 29.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 12 val \n","Loss: 0.1140 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 13/50\n","----------\n","\n","Epoch: 13 train \n","Loss: 0.0857 Acc: 91.3043\n","benign precision: 100.0000 recall: 96.2963\n","benign sensitivity: 96.2963 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 97.3684\n","benign TP: 26.0\n","benign TN: 37.0\n","benign FP: 0.0\n","benign FN: 1.0\n","malignant precision: 97.3684 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 96.2963\n","malignant FPR: 3.7037 NPV: 100.0000\n","malignant TP: 37.0\n","malignant TN: 26.0\n","malignant FP: 1.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 13 val \n","Loss: 0.1308 Acc: 93.7500\n","benign precision: 100.0000 recall: 85.7143\n","benign sensitivity: 85.7143 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 90.0000\n","benign TP: 6.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 1.0\n","malignant precision: 90.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 85.7143\n","malignant FPR: 14.2857 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 6.0\n","malignant FP: 1.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 14/50\n","----------\n","\n","Epoch: 14 train \n","Loss: 0.0749 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 27.0\n","benign TN: 37.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 37.0\n","malignant TN: 27.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 14 val \n","Loss: 0.1053 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 15/50\n","----------\n","\n","Epoch: 15 train \n","Loss: 0.0503 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 26.0\n","benign TN: 38.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 38.0\n","malignant TN: 26.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 15 val \n","Loss: 0.1226 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 16/50\n","----------\n","\n","Epoch: 16 train \n","Loss: 0.0510 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 28.0\n","benign TN: 36.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 36.0\n","malignant TN: 28.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 16 val \n","Loss: 0.0832 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 17/50\n","----------\n","\n","Epoch: 17 train \n","Loss: 0.0495 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 27.0\n","benign TN: 37.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 37.0\n","malignant TN: 27.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 17 val \n","Loss: 0.0738 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 18/50\n","----------\n","\n","Epoch: 18 train \n","Loss: 0.0476 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 28.0\n","benign TN: 36.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 36.0\n","malignant TN: 28.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 18 val \n","Loss: 0.0692 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 19/50\n","----------\n","\n","Epoch: 19 train \n","Loss: 0.0376 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 27.0\n","benign TN: 37.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 37.0\n","malignant TN: 27.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 19 val \n","Loss: 0.0681 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 20/50\n","----------\n","\n","Epoch: 20 train \n","Loss: 0.0319 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 27.0\n","benign TN: 37.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 37.0\n","malignant TN: 27.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 20 val \n","Loss: 0.0694 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 21/50\n","----------\n","\n","Epoch: 21 train \n","Loss: 0.0264 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 27.0\n","benign TN: 37.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 37.0\n","malignant TN: 27.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 21 val \n","Loss: 0.0643 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 22/50\n","----------\n","\n","Epoch: 22 train \n","Loss: 0.0258 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 28.0\n","benign TN: 36.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 36.0\n","malignant TN: 28.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 22 val \n","Loss: 0.0568 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 23/50\n","----------\n","\n","Epoch: 23 train \n","Loss: 0.0238 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 29.0\n","benign TN: 35.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 35.0\n","malignant TN: 29.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 23 val \n","Loss: 0.0567 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 24/50\n","----------\n","\n","Epoch: 24 train \n","Loss: 0.0212 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 28.0\n","benign TN: 36.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 36.0\n","malignant TN: 28.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 24 val \n","Loss: 0.0572 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 25/50\n","----------\n","\n","Epoch: 25 train \n","Loss: 0.0195 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 28.0\n","benign TN: 36.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 36.0\n","malignant TN: 28.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 25 val \n","Loss: 0.0650 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 26/50\n","----------\n","\n","Epoch: 26 train \n","Loss: 0.0256 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 30.0\n","benign TN: 34.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 34.0\n","malignant TN: 30.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 26 val \n","Loss: 0.0390 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 27/50\n","----------\n","\n","Epoch: 27 train \n","Loss: 0.0197 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 26.0\n","benign TN: 38.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 38.0\n","malignant TN: 26.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 27 val \n","Loss: 0.0506 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 28/50\n","----------\n","\n","Epoch: 28 train \n","Loss: 0.0260 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 27.0\n","benign TN: 37.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 37.0\n","malignant TN: 27.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 28 val \n","Loss: 0.0452 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 29/50\n","----------\n","\n","Epoch: 29 train \n","Loss: 0.0164 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 28.0\n","benign TN: 36.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 36.0\n","malignant TN: 28.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 29 val \n","Loss: 0.0368 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 30/50\n","----------\n","\n","Epoch: 30 train \n","Loss: 0.0166 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 26.0\n","benign TN: 38.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 38.0\n","malignant TN: 26.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 30 val \n","Loss: 0.0475 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 31/50\n","----------\n","\n","Epoch: 31 train \n","Loss: 0.0150 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 26.0\n","benign TN: 38.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 38.0\n","malignant TN: 26.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 31 val \n","Loss: 0.0456 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 32/50\n","----------\n","\n","Epoch: 32 train \n","Loss: 0.0183 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 29.0\n","benign TN: 35.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 35.0\n","malignant TN: 29.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 32 val \n","Loss: 0.0325 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 33/50\n","----------\n","\n","Epoch: 33 train \n","Loss: 0.0151 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 28.0\n","benign TN: 36.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 36.0\n","malignant TN: 28.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 33 val \n","Loss: 0.0345 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 34/50\n","----------\n","\n","Epoch: 34 train \n","Loss: 0.0171 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 29.0\n","benign TN: 35.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 35.0\n","malignant TN: 29.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 34 val \n","Loss: 0.0338 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 35/50\n","----------\n","\n","Epoch: 35 train \n","Loss: 0.0119 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 26.0\n","benign TN: 38.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 38.0\n","malignant TN: 26.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 35 val \n","Loss: 0.0363 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 36/50\n","----------\n","\n","Epoch: 36 train \n","Loss: 0.0127 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 29.0\n","benign TN: 35.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 35.0\n","malignant TN: 29.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 36 val \n","Loss: 0.0330 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 37/50\n","----------\n","\n","Epoch: 37 train \n","Loss: 0.0155 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 28.0\n","benign TN: 36.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 36.0\n","malignant TN: 28.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 37 val \n","Loss: 0.0273 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 38/50\n","----------\n","\n","Epoch: 38 train \n","Loss: 0.0097 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 28.0\n","benign TN: 36.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 36.0\n","malignant TN: 28.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 38 val \n","Loss: 0.0256 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 39/50\n","----------\n","\n","Epoch: 39 train \n","Loss: 0.0122 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 28.0\n","benign TN: 36.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 36.0\n","malignant TN: 28.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 39 val \n","Loss: 0.0268 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 40/50\n","----------\n","\n","Epoch: 40 train \n","Loss: 0.0106 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 28.0\n","benign TN: 36.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 36.0\n","malignant TN: 28.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 40 val \n","Loss: 0.0289 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 41/50\n","----------\n","\n","Epoch: 41 train \n","Loss: 0.0095 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 27.0\n","benign TN: 37.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 37.0\n","malignant TN: 27.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 41 val \n","Loss: 0.0293 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 42/50\n","----------\n","\n","Epoch: 42 train \n","Loss: 0.0093 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 29.0\n","benign TN: 35.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 35.0\n","malignant TN: 29.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 42 val \n","Loss: 0.0299 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 43/50\n","----------\n","\n","Epoch: 43 train \n","Loss: 0.0066 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 27.0\n","benign TN: 37.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 37.0\n","malignant TN: 27.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 43 val \n","Loss: 0.0290 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 44/50\n","----------\n","\n","Epoch: 44 train \n","Loss: 0.0105 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 27.0\n","benign TN: 37.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 37.0\n","malignant TN: 27.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 44 val \n","Loss: 0.0268 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 45/50\n","----------\n","\n","Epoch: 45 train \n","Loss: 0.0096 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 27.0\n","benign TN: 37.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 37.0\n","malignant TN: 27.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 45 val \n","Loss: 0.0287 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 46/50\n","----------\n","\n","Epoch: 46 train \n","Loss: 0.0093 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 28.0\n","benign TN: 36.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 36.0\n","malignant TN: 28.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 46 val \n","Loss: 0.0282 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 47/50\n","----------\n","\n","Epoch: 47 train \n","Loss: 0.0103 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 27.0\n","benign TN: 37.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 37.0\n","malignant TN: 27.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 47 val \n","Loss: 0.0255 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 48/50\n","----------\n","\n","Epoch: 48 train \n","Loss: 0.0100 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 26.0\n","benign TN: 38.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 38.0\n","malignant TN: 26.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 48 val \n","Loss: 0.0256 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 49/50\n","----------\n","\n","Epoch: 49 train \n","Loss: 0.0074 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 28.0\n","benign TN: 36.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 36.0\n","malignant TN: 28.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 49 val \n","Loss: 0.0256 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 50/50\n","----------\n","\n","Epoch: 50 train \n","Loss: 0.0099 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 27.0\n","benign TN: 37.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 37.0\n","malignant TN: 27.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 50 val \n","Loss: 0.0294 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Training complete in 0m 46s\n","Best epoch idx: 50\n","Best epoch train Acc: 92.753623\n","Best epoch val Acc: 100.000000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","model trained by GPU (idx:0) has been saved at /home/Pathology_Experiment/saved_models/CLS_ViT_base_timm_PromptDeep_20_401_lf15_finetuning_warwick_CLS.pth\n"]}],"source":["!python Train.py --edge_size 224 --data_augmentation_mode 3 --lr 1e-05 --lrf 0.15 --enable_tensorboard --model_idx ViT_base_timm_PromptDeep_20_401_lf15_finetuning_warwick_CLS --PromptTuning Deep --dataroot /data/Pathology_Experiment/dataset/warwick_CLS --draw_root /home/Pathology_Experiment/runs/VPT_finetuning_with_timm --model_path /home/Pathology_Experiment/saved_models"]},{"cell_type":"markdown","metadata":{"id":"q2mnI-UW2YFS"},"source":["Test"]},{"cell_type":"code","execution_count":null,"metadata":{"colab":{"background_save":true},"id":"98WKJutR2QtY"},"outputs":[{"name":"stdout","output_type":"stream","text":["class_names: ['benign', 'malignant']\n","base_state_dict of timm\n","Test the PromptTuning of ViT_base_timm_PromptDeep_20_401_lf15_finetuning_warwick_CLS\n","Prompt VPT type: Deep\n","in prompt model building, timm ViT loaded for base_state_dict\n","model forward cheacked\n","model is ready now!\n","prompt head match\n","model loaded\n","model : ViT_base_timm_PromptDeep_20_401_lf15_finetuning_warwick_CLS\n","*********************************setting*************************************\n","Namespace(model_idx='ViT_base_timm_PromptDeep_20_401_lf15_finetuning_warwick_CLS', drop_rate=0.0, attn_drop_rate=0.0, drop_path_rate=0.0, cls_token_off=False, pos_embedding_off=False, att_module='SimAM', gpu_idx=0, dataroot='/data/Pathology_Experiment/dataset/warwick_CLS', model_path='/home/Pathology_Experiment/saved_models', draw_root='/home/Pathology_Experiment/runs/VPT_finetuning_with_timm', model_path_by_hand=None, paint=True, enable_tensorboard=False, enable_attention_check=False, enable_visualize_check=False, data_augmentation_mode=3, PromptTuning='Deep', Prompt_Token_num=20, PromptUnFreeze=False, Pre_Trained_model_path=None, num_classes=0, edge_size=224, batch_size=1, check_minibatch=None)\n","Epoch: Test\n","----------\n","Epoch: test test index of 4 minibatch: 1 time used: 2.232135534286499\n","minibatch AVG loss: 0.26816506078466773\n","Epoch: test test index of 4 minibatch: 2 time used: 0.05264568328857422\n","minibatch AVG loss: 0.05344134452752769\n","Epoch: test test index of 4 minibatch: 3 time used: 0.05270862579345703\n","minibatch AVG loss: 0.0027116276614833623\n","Epoch: test test index of 4 minibatch: 4 time used: 0.052893638610839844\n","minibatch AVG loss: 0.4669480860720796\n","Epoch: test test index of 4 minibatch: 5 time used: 0.2150881290435791\n","minibatch AVG loss: 0.6584409326897003\n","Epoch: test test index of 4 minibatch: 6 time used: 0.07256197929382324\n","minibatch AVG loss: 0.14450758622115245\n","Epoch: test test index of 4 minibatch: 7 time used: 0.06723260879516602\n","minibatch AVG loss: 0.20112267805961892\n","Epoch: test test index of 4 minibatch: 8 time used: 0.0691368579864502\n","minibatch AVG loss: 0.014065294861211441\n","Epoch: test test index of 4 minibatch: 9 time used: 0.06417989730834961\n","minibatch AVG loss: 0.01810028008185327\n","Epoch: test test index of 4 minibatch: 10 time used: 0.0646204948425293\n","minibatch AVG loss: 0.10914140564273112\n","Epoch: test test index of 4 minibatch: 11 time used: 0.052018165588378906\n","minibatch AVG loss: 0.025396305602043867\n","Epoch: test test index of 4 minibatch: 12 time used: 0.0520014762878418\n","minibatch AVG loss: 0.13099558325484395\n","Epoch: test test index of 4 minibatch: 13 time used: 0.05219769477844238\n","minibatch AVG loss: 0.010371054049755912\n","Epoch: test test index of 4 minibatch: 14 time used: 0.05182027816772461\n","minibatch AVG loss: 0.010890420817304403\n","Epoch: test test index of 4 minibatch: 15 time used: 0.05169200897216797\n","minibatch AVG loss: 0.005727577343350276\n","Epoch: test test index of 4 minibatch: 16 time used: 0.0532376766204834\n","minibatch AVG loss: 0.001175819052150473\n","Epoch: test test index of 4 minibatch: 17 time used: 0.05185651779174805\n","minibatch AVG loss: 0.015627381930244155\n","Epoch: test test index of 4 minibatch: 18 time used: 0.05151867866516113\n","minibatch AVG loss: 0.011185463983565569\n","Epoch: test test index of 4 minibatch: 19 time used: 0.05146026611328125\n","minibatch AVG loss: 0.0034086240502801957\n","Epoch: test test index of 4 minibatch: 20 time used: 0.05474138259887695\n","minibatch AVG loss: 0.11933412203507032\n","\n","Epoch: test \n","Loss: 0.1135 Acc: 95.0000\n","benign precision: 100.0000 recall: 89.1892\n","benign sensitivity: 89.1892 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 91.4894\n","benign TP: 33.0\n","benign TN: 43.0\n","benign FP: 0.0\n","benign FN: 4.0\n","malignant precision: 91.4894 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 89.1892\n","malignant FPR: 10.8108 NPV: 100.0000\n","malignant TP: 43.0\n","malignant TN: 33.0\n","malignant FP: 4.0\n","malignant FN: 0.0\n","\n","\n","Testing complete in 0m 4s\n"]}],"source":["!python Test.py --edge_size 224 --data_augmentation_mode 3 --model_idx ViT_base_timm_PromptDeep_20_401_lf15_finetuning_warwick_CLS --PromptTuning Deep --dataroot /data/Pathology_Experiment/dataset/warwick_CLS --draw_root /home/Pathology_Experiment/runs/VPT_finetuning_with_timm --model_path /home/Pathology_Experiment/saved_models"]},{"cell_type":"markdown","metadata":{"id":"P5rRq1HhbSiC"},"source":["## Finetuning with PuzzleTuning Prompt\n","VPT + finetuning (with timm weight \u0026 PuzzleTuning Prompt)"]},{"cell_type":"markdown","metadata":{"id":"viVkMdz5bVQ_"},"source":["Train"]},{"cell_type":"code","execution_count":null,"metadata":{"colab":{"background_save":true},"id":"UUYpNJ74bV4n"},"outputs":[{"name":"stdout","output_type":"stream","text":["class_names: ['benign', 'malignant']\n","*********************************setting*************************************\n","Namespace(model_idx='ViT_base_timm_PuzzleTuning_SAE_promptstate_PromptDeep_20_401_lf15_finetuning_warwick_CLS', drop_rate=0.0, attn_drop_rate=0.0, drop_path_rate=0.0, cls_token_off=False, pos_embedding_off=False, att_module='SimAM', backbone_PT_off=False, gpu_idx=-1, dataroot='/data/Pathology_Experiment/dataset/warwick_CLS', model_path='/home/Pathology_Experiment/saved_models', draw_root='/home/Pathology_Experiment/runs/SAE-timm-start_promptstate_VPT_finetuning_with_timm', paint=True, enable_tensorboard=True, enable_attention_check=False, enable_visualize_check=False, PromptTuning='Deep', Prompt_Token_num=20, PromptUnFreeze=True, linearprobing=False, Pre_Trained_model_path=None, Prompt_state_path='/home/Pathology_Experiment/saved_models/ViT_b16_224_timm_PuzzleTuning_SAE_CPIAm_Prompt_Deep_tokennum_20_promptstate.pth', enable_sam=False, augmentation_name=None, ratio_strategy=None, patch_strategy=None, loss_drive_threshold=4.0, fix_position_ratio=0.5, fix_patch_size=None, patch_size_jump=None, num_classes=0, edge_size=224, data_augmentation_mode=3, batch_size=8, num_epochs=50, intake_epochs=0, lr=1e-05, lrf=0.15, opt_name='Adam', check_minibatch=None, num_workers=2)\n","we dont have more GPU idx here, try to use gpu_idx=0\n","PromptTuning of ViT_base_timm_PuzzleTuning_SAE_promptstate_PromptDeep_20_401_lf15_finetuning_warwick_CLS\n","Prompt VPT type: Deep\n","backbone base_state_dict of timm\n","prompting with prompt_state at: /home/Pathology_Experiment/saved_models/ViT_b16_224_timm_PuzzleTuning_SAE_CPIAm_Prompt_Deep_tokennum_20_promptstate.pth\n","in prompt model building, timm ViT loaded for base_state_dict\n","head not match, so skip head\n","in prompt model building, a .pth prompt_state_dict loaded\n","model forward cheacked\n","model is ready now!\n","prompt tuning with all parameaters un-freezed\n","GPU: 0\n","----------------------------------------------------------------\n"," Layer (type) Output Shape Param #\n","================================================================\n"," Conv2d-1 [-1, 768, 14, 14] 590,592\n"," Identity-2 [-1, 196, 768] 0\n"," PatchEmbed-3 [-1, 196, 768] 0\n"," Dropout-4 [-1, 197, 768] 0\n"," LayerNorm-5 [-1, 217, 768] 1,536\n"," Linear-6 [-1, 217, 2304] 1,771,776\n"," Dropout-7 [-1, 12, 217, 217] 0\n"," Linear-8 [-1, 217, 768] 590,592\n"," Dropout-9 [-1, 217, 768] 0\n"," Attention-10 [-1, 217, 768] 0\n"," Identity-11 [-1, 217, 768] 0\n"," LayerNorm-12 [-1, 217, 768] 1,536\n"," Linear-13 [-1, 217, 3072] 2,362,368\n"," GELU-14 [-1, 217, 3072] 0\n"," Dropout-15 [-1, 217, 3072] 0\n"," Linear-16 [-1, 217, 768] 2,360,064\n"," Dropout-17 [-1, 217, 768] 0\n"," Mlp-18 [-1, 217, 768] 0\n"," Identity-19 [-1, 217, 768] 0\n"," Block-20 [-1, 217, 768] 0\n"," LayerNorm-21 [-1, 217, 768] 1,536\n"," Linear-22 [-1, 217, 2304] 1,771,776\n"," Dropout-23 [-1, 12, 217, 217] 0\n"," Linear-24 [-1, 217, 768] 590,592\n"," Dropout-25 [-1, 217, 768] 0\n"," Attention-26 [-1, 217, 768] 0\n"," Identity-27 [-1, 217, 768] 0\n"," LayerNorm-28 [-1, 217, 768] 1,536\n"," Linear-29 [-1, 217, 3072] 2,362,368\n"," GELU-30 [-1, 217, 3072] 0\n"," Dropout-31 [-1, 217, 3072] 0\n"," Linear-32 [-1, 217, 768] 2,360,064\n"," Dropout-33 [-1, 217, 768] 0\n"," Mlp-34 [-1, 217, 768] 0\n"," Identity-35 [-1, 217, 768] 0\n"," Block-36 [-1, 217, 768] 0\n"," LayerNorm-37 [-1, 217, 768] 1,536\n"," Linear-38 [-1, 217, 2304] 1,771,776\n"," Dropout-39 [-1, 12, 217, 217] 0\n"," Linear-40 [-1, 217, 768] 590,592\n"," Dropout-41 [-1, 217, 768] 0\n"," Attention-42 [-1, 217, 768] 0\n"," Identity-43 [-1, 217, 768] 0\n"," LayerNorm-44 [-1, 217, 768] 1,536\n"," Linear-45 [-1, 217, 3072] 2,362,368\n"," GELU-46 [-1, 217, 3072] 0\n"," Dropout-47 [-1, 217, 3072] 0\n"," Linear-48 [-1, 217, 768] 2,360,064\n"," Dropout-49 [-1, 217, 768] 0\n"," Mlp-50 [-1, 217, 768] 0\n"," Identity-51 [-1, 217, 768] 0\n"," Block-52 [-1, 217, 768] 0\n"," LayerNorm-53 [-1, 217, 768] 1,536\n"," Linear-54 [-1, 217, 2304] 1,771,776\n"," Dropout-55 [-1, 12, 217, 217] 0\n"," Linear-56 [-1, 217, 768] 590,592\n"," Dropout-57 [-1, 217, 768] 0\n"," Attention-58 [-1, 217, 768] 0\n"," Identity-59 [-1, 217, 768] 0\n"," LayerNorm-60 [-1, 217, 768] 1,536\n"," Linear-61 [-1, 217, 3072] 2,362,368\n"," GELU-62 [-1, 217, 3072] 0\n"," Dropout-63 [-1, 217, 3072] 0\n"," Linear-64 [-1, 217, 768] 2,360,064\n"," Dropout-65 [-1, 217, 768] 0\n"," Mlp-66 [-1, 217, 768] 0\n"," Identity-67 [-1, 217, 768] 0\n"," Block-68 [-1, 217, 768] 0\n"," LayerNorm-69 [-1, 217, 768] 1,536\n"," Linear-70 [-1, 217, 2304] 1,771,776\n"," Dropout-71 [-1, 12, 217, 217] 0\n"," Linear-72 [-1, 217, 768] 590,592\n"," Dropout-73 [-1, 217, 768] 0\n"," Attention-74 [-1, 217, 768] 0\n"," Identity-75 [-1, 217, 768] 0\n"," LayerNorm-76 [-1, 217, 768] 1,536\n"," Linear-77 [-1, 217, 3072] 2,362,368\n"," GELU-78 [-1, 217, 3072] 0\n"," Dropout-79 [-1, 217, 3072] 0\n"," Linear-80 [-1, 217, 768] 2,360,064\n"," Dropout-81 [-1, 217, 768] 0\n"," Mlp-82 [-1, 217, 768] 0\n"," Identity-83 [-1, 217, 768] 0\n"," Block-84 [-1, 217, 768] 0\n"," LayerNorm-85 [-1, 217, 768] 1,536\n"," Linear-86 [-1, 217, 2304] 1,771,776\n"," Dropout-87 [-1, 12, 217, 217] 0\n"," Linear-88 [-1, 217, 768] 590,592\n"," Dropout-89 [-1, 217, 768] 0\n"," Attention-90 [-1, 217, 768] 0\n"," Identity-91 [-1, 217, 768] 0\n"," LayerNorm-92 [-1, 217, 768] 1,536\n"," Linear-93 [-1, 217, 3072] 2,362,368\n"," GELU-94 [-1, 217, 3072] 0\n"," Dropout-95 [-1, 217, 3072] 0\n"," Linear-96 [-1, 217, 768] 2,360,064\n"," Dropout-97 [-1, 217, 768] 0\n"," Mlp-98 [-1, 217, 768] 0\n"," Identity-99 [-1, 217, 768] 0\n"," Block-100 [-1, 217, 768] 0\n"," LayerNorm-101 [-1, 217, 768] 1,536\n"," Linear-102 [-1, 217, 2304] 1,771,776\n"," Dropout-103 [-1, 12, 217, 217] 0\n"," Linear-104 [-1, 217, 768] 590,592\n"," Dropout-105 [-1, 217, 768] 0\n"," Attention-106 [-1, 217, 768] 0\n"," Identity-107 [-1, 217, 768] 0\n"," LayerNorm-108 [-1, 217, 768] 1,536\n"," Linear-109 [-1, 217, 3072] 2,362,368\n"," GELU-110 [-1, 217, 3072] 0\n"," Dropout-111 [-1, 217, 3072] 0\n"," Linear-112 [-1, 217, 768] 2,360,064\n"," Dropout-113 [-1, 217, 768] 0\n"," Mlp-114 [-1, 217, 768] 0\n"," Identity-115 [-1, 217, 768] 0\n"," Block-116 [-1, 217, 768] 0\n"," LayerNorm-117 [-1, 217, 768] 1,536\n"," Linear-118 [-1, 217, 2304] 1,771,776\n"," Dropout-119 [-1, 12, 217, 217] 0\n"," Linear-120 [-1, 217, 768] 590,592\n"," Dropout-121 [-1, 217, 768] 0\n"," Attention-122 [-1, 217, 768] 0\n"," Identity-123 [-1, 217, 768] 0\n"," LayerNorm-124 [-1, 217, 768] 1,536\n"," Linear-125 [-1, 217, 3072] 2,362,368\n"," GELU-126 [-1, 217, 3072] 0\n"," Dropout-127 [-1, 217, 3072] 0\n"," Linear-128 [-1, 217, 768] 2,360,064\n"," Dropout-129 [-1, 217, 768] 0\n"," Mlp-130 [-1, 217, 768] 0\n"," Identity-131 [-1, 217, 768] 0\n"," Block-132 [-1, 217, 768] 0\n"," LayerNorm-133 [-1, 217, 768] 1,536\n"," Linear-134 [-1, 217, 2304] 1,771,776\n"," Dropout-135 [-1, 12, 217, 217] 0\n"," Linear-136 [-1, 217, 768] 590,592\n"," Dropout-137 [-1, 217, 768] 0\n"," Attention-138 [-1, 217, 768] 0\n"," Identity-139 [-1, 217, 768] 0\n"," LayerNorm-140 [-1, 217, 768] 1,536\n"," Linear-141 [-1, 217, 3072] 2,362,368\n"," GELU-142 [-1, 217, 3072] 0\n"," Dropout-143 [-1, 217, 3072] 0\n"," Linear-144 [-1, 217, 768] 2,360,064\n"," Dropout-145 [-1, 217, 768] 0\n"," Mlp-146 [-1, 217, 768] 0\n"," Identity-147 [-1, 217, 768] 0\n"," Block-148 [-1, 217, 768] 0\n"," LayerNorm-149 [-1, 217, 768] 1,536\n"," Linear-150 [-1, 217, 2304] 1,771,776\n"," Dropout-151 [-1, 12, 217, 217] 0\n"," Linear-152 [-1, 217, 768] 590,592\n"," Dropout-153 [-1, 217, 768] 0\n"," Attention-154 [-1, 217, 768] 0\n"," Identity-155 [-1, 217, 768] 0\n"," LayerNorm-156 [-1, 217, 768] 1,536\n"," Linear-157 [-1, 217, 3072] 2,362,368\n"," GELU-158 [-1, 217, 3072] 0\n"," Dropout-159 [-1, 217, 3072] 0\n"," Linear-160 [-1, 217, 768] 2,360,064\n"," Dropout-161 [-1, 217, 768] 0\n"," Mlp-162 [-1, 217, 768] 0\n"," Identity-163 [-1, 217, 768] 0\n"," Block-164 [-1, 217, 768] 0\n"," LayerNorm-165 [-1, 217, 768] 1,536\n"," Linear-166 [-1, 217, 2304] 1,771,776\n"," Dropout-167 [-1, 12, 217, 217] 0\n"," Linear-168 [-1, 217, 768] 590,592\n"," Dropout-169 [-1, 217, 768] 0\n"," Attention-170 [-1, 217, 768] 0\n"," Identity-171 [-1, 217, 768] 0\n"," LayerNorm-172 [-1, 217, 768] 1,536\n"," Linear-173 [-1, 217, 3072] 2,362,368\n"," GELU-174 [-1, 217, 3072] 0\n"," Dropout-175 [-1, 217, 3072] 0\n"," Linear-176 [-1, 217, 768] 2,360,064\n"," Dropout-177 [-1, 217, 768] 0\n"," Mlp-178 [-1, 217, 768] 0\n"," Identity-179 [-1, 217, 768] 0\n"," Block-180 [-1, 217, 768] 0\n"," LayerNorm-181 [-1, 217, 768] 1,536\n"," Linear-182 [-1, 217, 2304] 1,771,776\n"," Dropout-183 [-1, 12, 217, 217] 0\n"," Linear-184 [-1, 217, 768] 590,592\n"," Dropout-185 [-1, 217, 768] 0\n"," Attention-186 [-1, 217, 768] 0\n"," Identity-187 [-1, 217, 768] 0\n"," LayerNorm-188 [-1, 217, 768] 1,536\n"," Linear-189 [-1, 217, 3072] 2,362,368\n"," GELU-190 [-1, 217, 3072] 0\n"," Dropout-191 [-1, 217, 3072] 0\n"," Linear-192 [-1, 217, 768] 2,360,064\n"," Dropout-193 [-1, 217, 768] 0\n"," Mlp-194 [-1, 217, 768] 0\n"," Identity-195 [-1, 217, 768] 0\n"," Block-196 [-1, 217, 768] 0\n"," LayerNorm-197 [-1, 197, 768] 1,536\n"," Identity-198 [-1, 768] 0\n"," Linear-199 [-1, 2] 1,538\n","================================================================\n","Total params: 85,648,130\n","Trainable params: 85,648,130\n","Non-trainable params: 0\n","----------------------------------------------------------------\n","Input size (MB): 0.57\n","Forward/backward pass size (MB): 454.20\n","Params size (MB): 326.72\n","Estimated Total Size (MB): 781.49\n","----------------------------------------------------------------\n","model : ViT_base_timm_PuzzleTuning_SAE_promptstate_PromptDeep_20_401_lf15_finetuning_warwick_CLS\n","no valid counterparts augmentation selected\n","Epoch 1/50\n","----------\n","\n","Epoch: 1 train \n","Loss: 0.9057 Acc: 47.8261\n","benign precision: 47.5000 recall: 65.5172\n","benign sensitivity: 65.5172 specificity: 40.0000\n","benign FPR: 60.0000 NPV: 58.3333\n","benign TP: 19.0\n","benign TN: 14.0\n","benign FP: 21.0\n","benign FN: 10.0\n","malignant precision: 58.3333 recall: 40.0000\n","malignant sensitivity: 40.0000 specificity: 65.5172\n","malignant FPR: 34.4828 NPV: 47.5000\n","malignant TP: 14.0\n","malignant TN: 19.0\n","malignant FP: 10.0\n","malignant FN: 21.0\n","\n","\n","\n","Epoch: 1 val \n","Loss: 0.6906 Acc: 56.2500\n","benign precision: 0.0000 recall: 0.0000\n","benign sensitivity: 0.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 56.2500\n","benign TP: 0.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 7.0\n","malignant precision: 56.2500 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 0.0000\n","malignant FPR: 100.0000 NPV: 0.0000\n","malignant TP: 9.0\n","malignant TN: 0.0\n","malignant FP: 7.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 2/50\n","----------\n","\n","Epoch: 2 train \n","Loss: 0.7041 Acc: 55.0725\n","benign precision: 0.0000 recall: 0.0000\n","benign sensitivity: 0.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 59.3750\n","benign TP: 0.0\n","benign TN: 38.0\n","benign FP: 0.0\n","benign FN: 26.0\n","malignant precision: 59.3750 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 0.0000\n","malignant FPR: 100.0000 NPV: 0.0000\n","malignant TP: 38.0\n","malignant TN: 0.0\n","malignant FP: 26.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 2 val \n","Loss: 0.6821 Acc: 56.2500\n","benign precision: 0.0000 recall: 0.0000\n","benign sensitivity: 0.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 56.2500\n","benign TP: 0.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 7.0\n","malignant precision: 56.2500 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 0.0000\n","malignant FPR: 100.0000 NPV: 0.0000\n","malignant TP: 9.0\n","malignant TN: 0.0\n","malignant FP: 7.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 3/50\n","----------\n","\n","Epoch: 3 train \n","Loss: 0.6266 Acc: 55.0725\n","benign precision: 0.0000 recall: 0.0000\n","benign sensitivity: 0.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 59.3750\n","benign TP: 0.0\n","benign TN: 38.0\n","benign FP: 0.0\n","benign FN: 26.0\n","malignant precision: 59.3750 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 0.0000\n","malignant FPR: 100.0000 NPV: 0.0000\n","malignant TP: 38.0\n","malignant TN: 0.0\n","malignant FP: 26.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 3 val \n","Loss: 0.6837 Acc: 56.2500\n","benign precision: 0.0000 recall: 0.0000\n","benign sensitivity: 0.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 56.2500\n","benign TP: 0.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 7.0\n","malignant precision: 56.2500 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 0.0000\n","malignant FPR: 100.0000 NPV: 0.0000\n","malignant TP: 9.0\n","malignant TN: 0.0\n","malignant FP: 7.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 4/50\n","----------\n","\n","Epoch: 4 train \n","Loss: 0.6440 Acc: 50.7246\n","benign precision: 0.0000 recall: 0.0000\n","benign sensitivity: 0.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 54.6875\n","benign TP: 0.0\n","benign TN: 35.0\n","benign FP: 0.0\n","benign FN: 29.0\n","malignant precision: 54.6875 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 0.0000\n","malignant FPR: 100.0000 NPV: 0.0000\n","malignant TP: 35.0\n","malignant TN: 0.0\n","malignant FP: 29.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 4 val \n","Loss: 0.6855 Acc: 56.2500\n","benign precision: 0.0000 recall: 0.0000\n","benign sensitivity: 0.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 56.2500\n","benign TP: 0.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 7.0\n","malignant precision: 56.2500 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 0.0000\n","malignant FPR: 100.0000 NPV: 0.0000\n","malignant TP: 9.0\n","malignant TN: 0.0\n","malignant FP: 7.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 5/50\n","----------\n","\n","Epoch: 5 train \n","Loss: 0.6487 Acc: 44.9275\n","benign precision: 36.3636 recall: 29.6296\n","benign sensitivity: 29.6296 specificity: 62.1622\n","benign FPR: 37.8378 NPV: 54.7619\n","benign TP: 8.0\n","benign TN: 23.0\n","benign FP: 14.0\n","benign FN: 19.0\n","malignant precision: 54.7619 recall: 62.1622\n","malignant sensitivity: 62.1622 specificity: 29.6296\n","malignant FPR: 70.3704 NPV: 36.3636\n","malignant TP: 23.0\n","malignant TN: 8.0\n","malignant FP: 19.0\n","malignant FN: 14.0\n","\n","\n","\n","Epoch: 5 val \n","Loss: 0.7125 Acc: 56.2500\n","benign precision: 0.0000 recall: 0.0000\n","benign sensitivity: 0.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 56.2500\n","benign TP: 0.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 7.0\n","malignant precision: 56.2500 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 0.0000\n","malignant FPR: 100.0000 NPV: 0.0000\n","malignant TP: 9.0\n","malignant TN: 0.0\n","malignant FP: 7.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 6/50\n","----------\n","\n","Epoch: 6 train \n","Loss: 0.6396 Acc: 55.0725\n","benign precision: 0.0000 recall: 0.0000\n","benign sensitivity: 0.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 59.3750\n","benign TP: 0.0\n","benign TN: 38.0\n","benign FP: 0.0\n","benign FN: 26.0\n","malignant precision: 59.3750 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 0.0000\n","malignant FPR: 100.0000 NPV: 0.0000\n","malignant TP: 38.0\n","malignant TN: 0.0\n","malignant FP: 26.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 6 val \n","Loss: 0.6673 Acc: 56.2500\n","benign precision: 0.0000 recall: 0.0000\n","benign sensitivity: 0.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 56.2500\n","benign TP: 0.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 7.0\n","malignant precision: 56.2500 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 0.0000\n","malignant FPR: 100.0000 NPV: 0.0000\n","malignant TP: 9.0\n","malignant TN: 0.0\n","malignant FP: 7.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 7/50\n","----------\n","\n","Epoch: 7 train \n","Loss: 0.6158 Acc: 49.2754\n","benign precision: 40.0000 recall: 22.2222\n","benign sensitivity: 22.2222 specificity: 75.6757\n","benign FPR: 24.3243 NPV: 57.1429\n","benign TP: 6.0\n","benign TN: 28.0\n","benign FP: 9.0\n","benign FN: 21.0\n","malignant precision: 57.1429 recall: 75.6757\n","malignant sensitivity: 75.6757 specificity: 22.2222\n","malignant FPR: 77.7778 NPV: 40.0000\n","malignant TP: 28.0\n","malignant TN: 6.0\n","malignant FP: 21.0\n","malignant FN: 9.0\n","\n","\n","\n","Epoch: 7 val \n","Loss: 0.6687 Acc: 75.0000\n","benign precision: 66.6667 recall: 85.7143\n","benign sensitivity: 85.7143 specificity: 66.6667\n","benign FPR: 33.3333 NPV: 85.7143\n","benign TP: 6.0\n","benign TN: 6.0\n","benign FP: 3.0\n","benign FN: 1.0\n","malignant precision: 85.7143 recall: 66.6667\n","malignant sensitivity: 66.6667 specificity: 85.7143\n","malignant FPR: 14.2857 NPV: 66.6667\n","malignant TP: 6.0\n","malignant TN: 6.0\n","malignant FP: 1.0\n","malignant FN: 3.0\n","\n","\n","\n","Epoch 8/50\n","----------\n","\n","Epoch: 8 train \n","Loss: 0.5457 Acc: 69.5652\n","benign precision: 81.8182 recall: 60.0000\n","benign sensitivity: 60.0000 specificity: 88.2353\n","benign FPR: 11.7647 NPV: 71.4286\n","benign TP: 18.0\n","benign TN: 30.0\n","benign FP: 4.0\n","benign FN: 12.0\n","malignant precision: 71.4286 recall: 88.2353\n","malignant sensitivity: 88.2353 specificity: 60.0000\n","malignant FPR: 40.0000 NPV: 81.8182\n","malignant TP: 30.0\n","malignant TN: 18.0\n","malignant FP: 12.0\n","malignant FN: 4.0\n","\n","\n","\n","Epoch: 8 val \n","Loss: 0.5382 Acc: 81.2500\n","benign precision: 70.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 66.6667\n","benign FPR: 33.3333 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 6.0\n","benign FP: 3.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 66.6667\n","malignant sensitivity: 66.6667 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 70.0000\n","malignant TP: 6.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 3.0\n","\n","\n","\n","Epoch 9/50\n","----------\n","\n","Epoch: 9 train \n","Loss: 0.5411 Acc: 59.4203\n","benign precision: 55.5556 recall: 74.0741\n","benign sensitivity: 74.0741 specificity: 56.7568\n","benign FPR: 43.2432 NPV: 75.0000\n","benign TP: 20.0\n","benign TN: 21.0\n","benign FP: 16.0\n","benign FN: 7.0\n","malignant precision: 75.0000 recall: 56.7568\n","malignant sensitivity: 56.7568 specificity: 74.0741\n","malignant FPR: 25.9259 NPV: 55.5556\n","malignant TP: 21.0\n","malignant TN: 20.0\n","malignant FP: 7.0\n","malignant FN: 16.0\n","\n","\n","\n","Epoch: 9 val \n","Loss: 0.7515 Acc: 37.5000\n","benign precision: 38.4615 recall: 71.4286\n","benign sensitivity: 71.4286 specificity: 11.1111\n","benign FPR: 88.8889 NPV: 33.3333\n","benign TP: 5.0\n","benign TN: 1.0\n","benign FP: 8.0\n","benign FN: 2.0\n","malignant precision: 33.3333 recall: 11.1111\n","malignant sensitivity: 11.1111 specificity: 71.4286\n","malignant FPR: 28.5714 NPV: 38.4615\n","malignant TP: 1.0\n","malignant TN: 5.0\n","malignant FP: 2.0\n","malignant FN: 8.0\n","\n","\n","\n","Epoch 10/50\n","----------\n","\n","Epoch: 10 train \n","Loss: 0.5343 Acc: 59.4203\n","benign precision: 56.0976 recall: 82.1429\n","benign sensitivity: 82.1429 specificity: 50.0000\n","benign FPR: 50.0000 NPV: 78.2609\n","benign TP: 23.0\n","benign TN: 18.0\n","benign FP: 18.0\n","benign FN: 5.0\n","malignant precision: 78.2609 recall: 50.0000\n","malignant sensitivity: 50.0000 specificity: 82.1429\n","malignant FPR: 17.8571 NPV: 56.0976\n","malignant TP: 18.0\n","malignant TN: 23.0\n","malignant FP: 5.0\n","malignant FN: 18.0\n","\n","\n","\n","Epoch: 10 val \n","Loss: 0.6291 Acc: 56.2500\n","benign precision: 0.0000 recall: 0.0000\n","benign sensitivity: 0.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 56.2500\n","benign TP: 0.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 7.0\n","malignant precision: 56.2500 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 0.0000\n","malignant FPR: 100.0000 NPV: 0.0000\n","malignant TP: 9.0\n","malignant TN: 0.0\n","malignant FP: 7.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 11/50\n","----------\n","\n","Epoch: 11 train \n","Loss: 0.3603 Acc: 68.1159\n","benign precision: 91.6667 recall: 40.7407\n","benign sensitivity: 40.7407 specificity: 97.2973\n","benign FPR: 2.7027 NPV: 69.2308\n","benign TP: 11.0\n","benign TN: 36.0\n","benign FP: 1.0\n","benign FN: 16.0\n","malignant precision: 69.2308 recall: 97.2973\n","malignant sensitivity: 97.2973 specificity: 40.7407\n","malignant FPR: 59.2593 NPV: 91.6667\n","malignant TP: 36.0\n","malignant TN: 11.0\n","malignant FP: 16.0\n","malignant FN: 1.0\n","\n","\n","\n","Epoch: 11 val \n","Loss: 0.1934 Acc: 93.7500\n","benign precision: 100.0000 recall: 85.7143\n","benign sensitivity: 85.7143 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 90.0000\n","benign TP: 6.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 1.0\n","malignant precision: 90.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 85.7143\n","malignant FPR: 14.2857 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 6.0\n","malignant FP: 1.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 12/50\n","----------\n","\n","Epoch: 12 train \n","Loss: 0.1909 Acc: 85.5072\n","benign precision: 90.0000 recall: 93.1034\n","benign sensitivity: 93.1034 specificity: 91.4286\n","benign FPR: 8.5714 NPV: 94.1176\n","benign TP: 27.0\n","benign TN: 32.0\n","benign FP: 3.0\n","benign FN: 2.0\n","malignant precision: 94.1176 recall: 91.4286\n","malignant sensitivity: 91.4286 specificity: 93.1034\n","malignant FPR: 6.8966 NPV: 90.0000\n","malignant TP: 32.0\n","malignant TN: 27.0\n","malignant FP: 2.0\n","malignant FN: 3.0\n","\n","\n","\n","Epoch: 12 val \n","Loss: 0.1050 Acc: 93.7500\n","benign precision: 100.0000 recall: 85.7143\n","benign sensitivity: 85.7143 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 90.0000\n","benign TP: 6.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 1.0\n","malignant precision: 90.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 85.7143\n","malignant FPR: 14.2857 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 6.0\n","malignant FP: 1.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 13/50\n","----------\n","\n","Epoch: 13 train \n","Loss: 0.0564 Acc: 89.8551\n","benign precision: 100.0000 recall: 92.5926\n","benign sensitivity: 92.5926 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 94.8718\n","benign TP: 25.0\n","benign TN: 37.0\n","benign FP: 0.0\n","benign FN: 2.0\n","malignant precision: 94.8718 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 92.5926\n","malignant FPR: 7.4074 NPV: 100.0000\n","malignant TP: 37.0\n","malignant TN: 25.0\n","malignant FP: 2.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 13 val \n","Loss: 0.1332 Acc: 93.7500\n","benign precision: 87.5000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 88.8889\n","benign FPR: 11.1111 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 8.0\n","benign FP: 1.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 88.8889\n","malignant sensitivity: 88.8889 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 87.5000\n","malignant TP: 8.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 1.0\n","\n","\n","\n","Epoch 14/50\n","----------\n","\n","Epoch: 14 train \n","Loss: 0.0390 Acc: 91.3043\n","benign precision: 96.4286 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 97.2973\n","benign FPR: 2.7027 NPV: 100.0000\n","benign TP: 27.0\n","benign TN: 36.0\n","benign FP: 1.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 97.2973\n","malignant sensitivity: 97.2973 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 96.4286\n","malignant TP: 36.0\n","malignant TN: 27.0\n","malignant FP: 0.0\n","malignant FN: 1.0\n","\n","\n","\n","Epoch: 14 val \n","Loss: 0.0150 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 15/50\n","----------\n","\n","Epoch: 15 train \n","Loss: 0.0162 Acc: 91.3043\n","benign precision: 100.0000 recall: 96.1538\n","benign sensitivity: 96.1538 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 97.4359\n","benign TP: 25.0\n","benign TN: 38.0\n","benign FP: 0.0\n","benign FN: 1.0\n","malignant precision: 97.4359 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 96.1538\n","malignant FPR: 3.8462 NPV: 100.0000\n","malignant TP: 38.0\n","malignant TN: 25.0\n","malignant FP: 1.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 15 val \n","Loss: 0.0762 Acc: 93.7500\n","benign precision: 87.5000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 88.8889\n","benign FPR: 11.1111 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 8.0\n","benign FP: 1.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 88.8889\n","malignant sensitivity: 88.8889 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 87.5000\n","malignant TP: 8.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 1.0\n","\n","\n","\n","Epoch 16/50\n","----------\n","\n","Epoch: 16 train \n","Loss: 0.0214 Acc: 91.3043\n","benign precision: 96.5517 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 97.2222\n","benign FPR: 2.7778 NPV: 100.0000\n","benign TP: 28.0\n","benign TN: 35.0\n","benign FP: 1.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 97.2222\n","malignant sensitivity: 97.2222 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 96.5517\n","malignant TP: 35.0\n","malignant TN: 28.0\n","malignant FP: 0.0\n","malignant FN: 1.0\n","\n","\n","\n","Epoch: 16 val \n","Loss: 0.0315 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 17/50\n","----------\n","\n","Epoch: 17 train \n","Loss: 0.0052 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 27.0\n","benign TN: 37.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 37.0\n","malignant TN: 27.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 17 val \n","Loss: 0.1970 Acc: 93.7500\n","benign precision: 100.0000 recall: 85.7143\n","benign sensitivity: 85.7143 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 90.0000\n","benign TP: 6.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 1.0\n","malignant precision: 90.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 85.7143\n","malignant FPR: 14.2857 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 6.0\n","malignant FP: 1.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 18/50\n","----------\n","\n","Epoch: 18 train \n","Loss: 0.0092 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 28.0\n","benign TN: 36.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 36.0\n","malignant TN: 28.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 18 val \n","Loss: 0.3976 Acc: 87.5000\n","benign precision: 77.7778 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 77.7778\n","benign FPR: 22.2222 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 7.0\n","benign FP: 2.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 77.7778\n","malignant sensitivity: 77.7778 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 77.7778\n","malignant TP: 7.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 2.0\n","\n","\n","\n","Epoch 19/50\n","----------\n","\n","Epoch: 19 train \n","Loss: 0.0221 Acc: 91.3043\n","benign precision: 96.4286 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 97.2973\n","benign FPR: 2.7027 NPV: 100.0000\n","benign TP: 27.0\n","benign TN: 36.0\n","benign FP: 1.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 97.2973\n","malignant sensitivity: 97.2973 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 96.4286\n","malignant TP: 36.0\n","malignant TN: 27.0\n","malignant FP: 0.0\n","malignant FN: 1.0\n","\n","\n","\n","Epoch: 19 val \n","Loss: 0.0045 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 20/50\n","----------\n","\n","Epoch: 20 train \n","Loss: 0.0001 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 27.0\n","benign TN: 37.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 37.0\n","malignant TN: 27.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 20 val \n","Loss: 0.0233 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 21/50\n","----------\n","\n","Epoch: 21 train \n","Loss: 0.0004 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 27.0\n","benign TN: 37.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 37.0\n","malignant TN: 27.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 21 val \n","Loss: 0.0371 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 22/50\n","----------\n","\n","Epoch: 22 train \n","Loss: 0.0001 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 28.0\n","benign TN: 36.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 36.0\n","malignant TN: 28.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 22 val \n","Loss: 0.0309 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 23/50\n","----------\n","\n","Epoch: 23 train \n","Loss: 0.0001 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 29.0\n","benign TN: 35.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 35.0\n","malignant TN: 29.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 23 val \n","Loss: 0.0265 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 24/50\n","----------\n","\n","Epoch: 24 train \n","Loss: 0.0000 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 28.0\n","benign TN: 36.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 36.0\n","malignant TN: 28.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 24 val \n","Loss: 0.0246 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 25/50\n","----------\n","\n","Epoch: 25 train \n","Loss: 0.0001 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 28.0\n","benign TN: 36.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 36.0\n","malignant TN: 28.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 25 val \n","Loss: 0.0212 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 26/50\n","----------\n","\n","Epoch: 26 train \n","Loss: 0.0000 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 30.0\n","benign TN: 34.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 34.0\n","malignant TN: 30.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 26 val \n","Loss: 0.0198 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 27/50\n","----------\n","\n","Epoch: 27 train \n","Loss: 0.0000 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 26.0\n","benign TN: 38.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 38.0\n","malignant TN: 26.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 27 val \n","Loss: 0.0195 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 28/50\n","----------\n","\n","Epoch: 28 train \n","Loss: 0.0001 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 27.0\n","benign TN: 37.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 37.0\n","malignant TN: 27.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 28 val \n","Loss: 0.0182 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 29/50\n","----------\n","\n","Epoch: 29 train \n","Loss: 0.0001 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 28.0\n","benign TN: 36.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 36.0\n","malignant TN: 28.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 29 val \n","Loss: 0.0163 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 30/50\n","----------\n","\n","Epoch: 30 train \n","Loss: 0.0000 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 26.0\n","benign TN: 38.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 38.0\n","malignant TN: 26.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 30 val \n","Loss: 0.0156 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 31/50\n","----------\n","\n","Epoch: 31 train \n","Loss: 0.0000 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 26.0\n","benign TN: 38.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 38.0\n","malignant TN: 26.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 31 val \n","Loss: 0.0153 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 32/50\n","----------\n","\n","Epoch: 32 train \n","Loss: 0.0001 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 29.0\n","benign TN: 35.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 35.0\n","malignant TN: 29.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 32 val \n","Loss: 0.0150 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 33/50\n","----------\n","\n","Epoch: 33 train \n","Loss: 0.0001 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 28.0\n","benign TN: 36.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 36.0\n","malignant TN: 28.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 33 val \n","Loss: 0.0145 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 34/50\n","----------\n","\n","Epoch: 34 train \n","Loss: 0.0001 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 29.0\n","benign TN: 35.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 35.0\n","malignant TN: 29.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 34 val \n","Loss: 0.0141 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 35/50\n","----------\n","\n","Epoch: 35 train \n","Loss: 0.0000 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 26.0\n","benign TN: 38.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 38.0\n","malignant TN: 26.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 35 val \n","Loss: 0.0140 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 36/50\n","----------\n","\n","Epoch: 36 train \n","Loss: 0.0001 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 29.0\n","benign TN: 35.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 35.0\n","malignant TN: 29.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 36 val \n","Loss: 0.0133 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 37/50\n","----------\n","\n","Epoch: 37 train \n","Loss: 0.0001 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 28.0\n","benign TN: 36.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 36.0\n","malignant TN: 28.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 37 val \n","Loss: 0.0127 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 38/50\n","----------\n","\n","Epoch: 38 train \n","Loss: 0.0001 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 28.0\n","benign TN: 36.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 36.0\n","malignant TN: 28.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 38 val \n","Loss: 0.0123 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 39/50\n","----------\n","\n","Epoch: 39 train \n","Loss: 0.0000 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 28.0\n","benign TN: 36.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 36.0\n","malignant TN: 28.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 39 val \n","Loss: 0.0121 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 40/50\n","----------\n","\n","Epoch: 40 train \n","Loss: 0.0001 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 28.0\n","benign TN: 36.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 36.0\n","malignant TN: 28.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 40 val \n","Loss: 0.0119 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 41/50\n","----------\n","\n","Epoch: 41 train \n","Loss: 0.0000 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 27.0\n","benign TN: 37.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 37.0\n","malignant TN: 27.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 41 val \n","Loss: 0.0119 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 42/50\n","----------\n","\n","Epoch: 42 train \n","Loss: 0.0001 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 29.0\n","benign TN: 35.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 35.0\n","malignant TN: 29.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 42 val \n","Loss: 0.0117 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 43/50\n","----------\n","\n","Epoch: 43 train \n","Loss: 0.0000 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 27.0\n","benign TN: 37.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 37.0\n","malignant TN: 27.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 43 val \n","Loss: 0.0117 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 44/50\n","----------\n","\n","Epoch: 44 train \n","Loss: 0.0000 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 27.0\n","benign TN: 37.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 37.0\n","malignant TN: 27.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 44 val \n","Loss: 0.0117 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 45/50\n","----------\n","\n","Epoch: 45 train \n","Loss: 0.0000 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 27.0\n","benign TN: 37.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 37.0\n","malignant TN: 27.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 45 val \n","Loss: 0.0118 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 46/50\n","----------\n","\n","Epoch: 46 train \n","Loss: 0.0000 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 28.0\n","benign TN: 36.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 36.0\n","malignant TN: 28.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 46 val \n","Loss: 0.0119 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 47/50\n","----------\n","\n","Epoch: 47 train \n","Loss: 0.0001 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 27.0\n","benign TN: 37.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 37.0\n","malignant TN: 27.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 47 val \n","Loss: 0.0119 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 48/50\n","----------\n","\n","Epoch: 48 train \n","Loss: 0.0000 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 26.0\n","benign TN: 38.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 38.0\n","malignant TN: 26.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 48 val \n","Loss: 0.0120 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 49/50\n","----------\n","\n","Epoch: 49 train \n","Loss: 0.0002 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 28.0\n","benign TN: 36.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 36.0\n","malignant TN: 28.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 49 val \n","Loss: 0.0111 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch 50/50\n","----------\n","\n","Epoch: 50 train \n","Loss: 0.0000 Acc: 92.7536\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 27.0\n","benign TN: 37.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 37.0\n","malignant TN: 27.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Epoch: 50 val \n","Loss: 0.0108 Acc: 100.0000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","benign TP: 7.0\n","benign TN: 9.0\n","benign FP: 0.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","malignant TP: 9.0\n","malignant TN: 7.0\n","malignant FP: 0.0\n","malignant FN: 0.0\n","\n","\n","\n","Training complete in 0m 56s\n","Best epoch idx: 50\n","Best epoch train Acc: 92.753623\n","Best epoch val Acc: 100.000000\n","benign precision: 100.0000 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 100.0000\n","benign FPR: 0.0000 NPV: 100.0000\n","malignant precision: 100.0000 recall: 100.0000\n","malignant sensitivity: 100.0000 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 100.0000\n","model trained by GPU (idx:0) has been saved at /home/Pathology_Experiment/saved_models/CLS_ViT_base_timm_PuzzleTuning_SAE_promptstate_PromptDeep_20_401_lf15_finetuning_warwick_CLS.pth\n"]}],"source":["!python Train.py --edge_size 224 --data_augmentation_mode 3 --lr 1e-05 --lrf 0.15 --enable_tensorboard --model_idx ViT_base_timm_PuzzleTuning_SAE_promptstate_PromptDeep_20_401_lf15_finetuning_warwick_CLS --PromptTuning Deep --Prompt_Token_num 20 --PromptUnFreeze --dataroot /data/Pathology_Experiment/dataset/warwick_CLS --draw_root /home/Pathology_Experiment/runs/SAE-timm-start_promptstate_VPT_finetuning_with_timm --Prompt_state_path /home/Pathology_Experiment/saved_models/ViT_b16_224_timm_PuzzleTuning_SAE_CPIAm_Prompt_Deep_tokennum_20_promptstate.pth --model_path /home/Pathology_Experiment/saved_models"]},{"cell_type":"markdown","metadata":{"id":"tjdLl1IgbWJA"},"source":["Test"]},{"cell_type":"code","execution_count":null,"metadata":{"colab":{"background_save":true},"id":"JWODC-3dbWy5"},"outputs":[{"name":"stdout","output_type":"stream","text":["class_names: ['benign', 'malignant']\n","base_state_dict of timm\n","Test the PromptTuning of ViT_base_timm_PuzzleTuning_SAE_promptstate_PromptDeep_20_401_lf15_finetuning_warwick_CLS\n","Prompt VPT type: Deep\n","in prompt model building, timm ViT loaded for base_state_dict\n","model forward cheacked\n","model is ready now!\n","model loaded\n","model : ViT_base_timm_PuzzleTuning_SAE_promptstate_PromptDeep_20_401_lf15_finetuning_warwick_CLS\n","*********************************setting*************************************\n","Namespace(model_idx='ViT_base_timm_PuzzleTuning_SAE_promptstate_PromptDeep_20_401_lf15_finetuning_warwick_CLS', drop_rate=0.0, attn_drop_rate=0.0, drop_path_rate=0.0, cls_token_off=False, pos_embedding_off=False, att_module='SimAM', gpu_idx=0, dataroot='/data/Pathology_Experiment/dataset/warwick_CLS', model_path='/home/Pathology_Experiment/saved_models', draw_root='/home/Pathology_Experiment/runs/SAE-timm-start_promptstate_VPT_finetuning_with_timm', model_path_by_hand=None, paint=True, enable_tensorboard=False, enable_attention_check=False, enable_visualize_check=False, data_augmentation_mode=3, PromptTuning='Deep', Prompt_Token_num=20, PromptUnFreeze=True, Pre_Trained_model_path=None, num_classes=0, edge_size=224, batch_size=1, check_minibatch=None)\n","Epoch: Test\n","----------\n","Epoch: test test index of 4 minibatch: 1 time used: 2.460519790649414\n","minibatch AVG loss: 0.0005482856868184172\n","Epoch: test test index of 4 minibatch: 2 time used: 0.05422377586364746\n","minibatch AVG loss: 0.028580010335645056\n","Epoch: test test index of 4 minibatch: 3 time used: 0.05495309829711914\n","minibatch AVG loss: 0.00031065010671227355\n","Epoch: test test index of 4 minibatch: 4 time used: 0.05390286445617676\n","minibatch AVG loss: 0.0004322398812064421\n","Epoch: test test index of 4 minibatch: 5 time used: 0.05517458915710449\n","minibatch AVG loss: 0.12173168856133998\n","Epoch: test test index of 4 minibatch: 6 time used: 0.056728363037109375\n","minibatch AVG loss: 0.0001147254761235672\n","Epoch: test test index of 4 minibatch: 7 time used: 0.055054664611816406\n","minibatch AVG loss: 0.00036354226699586434\n","Epoch: test test index of 4 minibatch: 8 time used: 0.05412697792053223\n","minibatch AVG loss: 0.00014341383098326332\n","Epoch: test test index of 4 minibatch: 9 time used: 0.05386781692504883\n","minibatch AVG loss: 0.006190998042256979\n","Epoch: test test index of 4 minibatch: 10 time used: 0.05511641502380371\n","minibatch AVG loss: 0.003244622026613797\n","Epoch: test test index of 4 minibatch: 11 time used: 0.055419206619262695\n","minibatch AVG loss: 0.04551573219941929\n","Epoch: test test index of 4 minibatch: 12 time used: 0.0545496940612793\n","minibatch AVG loss: 0.07759279117362894\n","Epoch: test test index of 4 minibatch: 13 time used: 0.05438709259033203\n","minibatch AVG loss: 1.6769601333962783\n","Epoch: test test index of 4 minibatch: 14 time used: 0.0557103157043457\n","minibatch AVG loss: 0.021024980960646644\n","Epoch: test test index of 4 minibatch: 15 time used: 0.055322885513305664\n","minibatch AVG loss: 0.003789418142332579\n","Epoch: test test index of 4 minibatch: 16 time used: 0.05902862548828125\n","minibatch AVG loss: 0.0001979180588023155\n","Epoch: test test index of 4 minibatch: 17 time used: 0.057543039321899414\n","minibatch AVG loss: 0.003576442887720077\n","Epoch: test test index of 4 minibatch: 18 time used: 0.05739569664001465\n","minibatch AVG loss: 0.0008242135859291011\n","Epoch: test test index of 4 minibatch: 19 time used: 0.05773782730102539\n","minibatch AVG loss: 0.0002545509980791394\n","Epoch: test test index of 4 minibatch: 20 time used: 0.05846238136291504\n","minibatch AVG loss: 0.0012478914995881496\n","\n","Epoch: test \n","Loss: 0.0996 Acc: 98.7500\n","benign precision: 97.3684 recall: 100.0000\n","benign sensitivity: 100.0000 specificity: 97.6744\n","benign FPR: 2.3256 NPV: 100.0000\n","benign TP: 37.0\n","benign TN: 42.0\n","benign FP: 1.0\n","benign FN: 0.0\n","malignant precision: 100.0000 recall: 97.6744\n","malignant sensitivity: 97.6744 specificity: 100.0000\n","malignant FPR: 0.0000 NPV: 97.3684\n","malignant TP: 42.0\n","malignant TN: 37.0\n","malignant FP: 0.0\n","malignant FN: 1.0\n","\n","\n","Testing complete in 0m 4s\n"]}],"source":["!python Test.py --edge_size 224 --data_augmentation_mode 3 --model_idx ViT_base_timm_PuzzleTuning_SAE_promptstate_PromptDeep_20_401_lf15_finetuning_warwick_CLS --PromptTuning Deep --Prompt_Token_num 20 --PromptUnFreeze --dataroot /data/Pathology_Experiment/dataset/warwick_CLS --draw_root /home/Pathology_Experiment/runs/SAE-timm-start_promptstate_VPT_finetuning_with_timm --model_path /home/Pathology_Experiment/saved_models"]},{"cell_type":"markdown","metadata":{"id":"XX6Vjy9ec2b2"},"source":["# check the Tensorboard output"]},{"cell_type":"code","execution_count":null,"metadata":{"colab":{"background_save":true},"id":"MWtYyRI1ff0q"},"outputs":[{"data":{"application/javascript":["\n"," (async () =\u003e {\n"," const url = new URL(await google.colab.kernel.proxyPort(6006, {'cache': true}));\n"," url.searchParams.set('tensorboardColab', 'true');\n"," const iframe = document.createElement('iframe');\n"," iframe.src = url;\n"," iframe.setAttribute('width', '100%');\n"," iframe.setAttribute('height', '800');\n"," iframe.setAttribute('frameborder', 0);\n"," document.body.appendChild(iframe);\n"," })();\n"," "],"text/plain":["\u003cIPython.core.display.Javascript object\u003e"]},"metadata":{},"output_type":"display_data"}],"source":["%load_ext tensorboard\n","%tensorboard --logdir '/home/Pathology_Experiment/runs'"]},{"cell_type":"markdown","metadata":{"id":"XSGgbUQ3E0H5"},"source":["# After the task, save the output to google drive\n"]},{"cell_type":"code","execution_count":null,"metadata":{"colab":{"background_save":true},"id":"ZQlei_AVLknG"},"outputs":[{"name":"stdout","output_type":"stream","text":["usage: check_log_json.py [-h] [--ONE_LOG] [--draw_root DRAW_ROOT] [--record_dir RECORD_DIR]\n","check_log_json.py: error: unrecognized arguments: --enable_notify\n"]}],"source":["# change working dir\n","import os\n","os.chdir(\"/home/Pathology_Experiment/code/utils\")\n","!python check_log_json.py --enable_notify --draw_root /home/Pathology_Experiment/runs --record_dir /home/Pathology_Experiment/CSV_logs"]},{"cell_type":"code","execution_count":null,"metadata":{"colab":{"background_save":true},"id":"_Wx0ymiiEuyS"},"outputs":[{"name":"stdout","output_type":"stream","text":["/bin/cp: target '/content/drive/MyDrive/Pathology_Experiment/runs/' is not a directory\n","runs copy completed!\n","/bin/cp: target '/content/drive/MyDrive/Pathology_Experiment/saved_models/' is not a directory\n","models copy completed!\n","/bin/cp: target '/content/drive/MyDrive/Pathology_Experiment/imaging_results/' is not a directory\n","imaging_results copy completed!\n"]}],"source":["# copy tensorboard runs\n","!/bin/cp -rf /home/Pathology_Experiment/runs/* /content/drive/MyDrive/Pathology_Experiment/runs/\n","print('runs copy completed!')\n","# copy the traind models\n","!/bin/cp -rf /home/Pathology_Experiment/saved_models/* /content/drive/MyDrive/Pathology_Experiment/saved_models/\n","print('models copy completed!')\n","# copy the imaging_results\n","!/bin/cp -rf /home/Pathology_Experiment/imaging_results/* /content/drive/MyDrive/Pathology_Experiment/imaging_results/\n","print('imaging_results copy completed!')"]},{"cell_type":"code","execution_count":null,"metadata":{"colab":{"background_save":true},"id":"9lzAtLIhnGe5"},"outputs":[{"name":"stdout","output_type":"stream","text":["Sat Nov 25 08:22:43 AM UTC 2023\n"]}],"source":["!date --date='+8 hour' # CST time zone"]}],"metadata":{"accelerator":"GPU","colab":{"machine_shape":"hm","name":"","version":""},"kernelspec":{"display_name":"Python 3","name":"python3"},"language_info":{"name":"python"}},"nbformat":4,"nbformat_minor":0}