|
2025-07-01 08:54:00.739 | INFO | llava.data.builder:register_datasets:39 - Registering datasets from environment: 'nvidia,draco-oci-iad'. |
|
2025-07-01 08:54:00.740 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/nvidia.yaml'. |
|
2025-07-01 08:54:00.748 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/draco-oci-iad.yaml'. |
|
2025-07-01 08:54:00.849 | INFO | llava.data.builder:register_datasets:39 - Registering datasets from environment: 'nvidia,draco-oci-iad'. |
|
2025-07-01 08:54:00.849 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/nvidia.yaml'. |
|
2025-07-01 08:54:00.858 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/draco-oci-iad.yaml'. |
|
2025-07-01 08:54:01.338 | INFO | llava.data.builder:register_datasets:39 - Registering datasets from environment: 'nvidia,draco-oci-iad'. |
|
2025-07-01 08:54:01.338 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/nvidia.yaml'. |
|
2025-07-01 08:54:01.347 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/draco-oci-iad.yaml'. |
|
2025-07-01 08:54:01.436 | INFO | llava.data.builder:register_datasets:39 - Registering datasets from environment: 'nvidia,draco-oci-iad'. |
|
2025-07-01 08:54:01.436 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/nvidia.yaml'. |
|
2025-07-01 08:54:01.445 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/draco-oci-iad.yaml'. |
|
2025-07-01 08:54:01.447 | INFO | llava.data.builder:register_datasets:39 - Registering datasets from environment: 'nvidia,draco-oci-iad'. |
|
2025-07-01 08:54:01.447 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/nvidia.yaml'. |
|
2025-07-01 08:54:01.450 | INFO | llava.data.builder:register_datasets:39 - Registering datasets from environment: 'nvidia,draco-oci-iad'. |
|
2025-07-01 08:54:01.450 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/nvidia.yaml'. |
|
2025-07-01 08:54:01.456 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/draco-oci-iad.yaml'. |
|
2025-07-01 08:54:01.458 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/draco-oci-iad.yaml'. |
|
2025-07-01 08:54:01.464 | INFO | llava.data.builder:register_datasets:39 - Registering datasets from environment: 'nvidia,draco-oci-iad'. |
|
2025-07-01 08:54:01.464 | INFO | llava.data.builder:register_datasets:39 - Registering datasets from environment: 'nvidia,draco-oci-iad'. |
|
2025-07-01 08:54:01.465 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/nvidia.yaml'. |
|
2025-07-01 08:54:01.465 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/nvidia.yaml'. |
|
2025-07-01 08:54:01.473 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/draco-oci-iad.yaml'. |
|
2025-07-01 08:54:01.473 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/draco-oci-iad.yaml'. |
|
2025-07-01 08:54:01.484 | INFO | llava.data.builder:register_datasets:39 - Registering datasets from environment: 'nvidia,draco-oci-iad'. |
|
2025-07-01 08:54:01.484 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/nvidia.yaml'. |
|
2025-07-01 08:54:01.493 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/draco-oci-iad.yaml'. |
|
2025-07-01 08:54:01.633 | INFO | llava.data.builder:register_datasets:39 - Registering datasets from environment: 'nvidia,draco-oci-iad'. |
|
2025-07-01 08:54:01.633 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/nvidia.yaml'. |
|
2025-07-01 08:54:01.635 | INFO | llava.data.builder:register_datasets:39 - Registering datasets from environment: 'nvidia,draco-oci-iad'. |
|
2025-07-01 08:54:01.635 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/nvidia.yaml'. |
|
2025-07-01 08:54:01.639 | INFO | llava.data.builder:register_datasets:39 - Registering datasets from environment: 'nvidia,draco-oci-iad'. |
|
2025-07-01 08:54:01.639 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/nvidia.yaml'. |
|
2025-07-01 08:54:01.642 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/draco-oci-iad.yaml'. |
|
2025-07-01 08:54:01.643 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/draco-oci-iad.yaml'. |
|
2025-07-01 08:54:01.648 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/draco-oci-iad.yaml'. |
|
2025-07-01 08:54:01.649 | INFO | llava.data.builder:register_datasets:39 - Registering datasets from environment: 'nvidia,draco-oci-iad'. |
|
2025-07-01 08:54:01.649 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/nvidia.yaml'. |
|
2025-07-01 08:54:01.652 | INFO | llava.data.builder:register_datasets:39 - Registering datasets from environment: 'nvidia,draco-oci-iad'. |
|
2025-07-01 08:54:01.652 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/nvidia.yaml'. |
|
2025-07-01 08:54:01.655 | INFO | llava.data.builder:register_datasets:39 - Registering datasets from environment: 'nvidia,draco-oci-iad'. |
|
2025-07-01 08:54:01.655 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/nvidia.yaml'. |
|
2025-07-01 08:54:01.658 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/draco-oci-iad.yaml'. |
|
2025-07-01 08:54:01.660 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/draco-oci-iad.yaml'. |
|
2025-07-01 08:54:01.664 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/draco-oci-iad.yaml'. |
|
2025-07-01 08:54:01.718 | INFO | llava.data.builder:register_datasets:39 - Registering datasets from environment: 'nvidia,draco-oci-iad'. |
|
2025-07-01 08:54:01.718 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/nvidia.yaml'. |
|
2025-07-01 08:54:01.727 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/draco-oci-iad.yaml'. |
|
2025-07-01 08:54:01.749 | INFO | llava.data.builder:register_datasets:39 - Registering datasets from environment: 'nvidia,draco-oci-iad'. |
|
2025-07-01 08:54:01.749 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/nvidia.yaml'. |
|
2025-07-01 08:54:01.758 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/draco-oci-iad.yaml'. |
|
2025-07-01 08:54:01.833 | INFO | llava.data.builder:register_datasets:39 - Registering datasets from environment: 'nvidia,draco-oci-iad'. |
|
2025-07-01 08:54:01.833 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/nvidia.yaml'. |
|
2025-07-01 08:54:01.835 | INFO | llava.data.builder:register_datasets:39 - Registering datasets from environment: 'nvidia,draco-oci-iad'. |
|
2025-07-01 08:54:01.836 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/nvidia.yaml'. |
|
2025-07-01 08:54:01.842 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/draco-oci-iad.yaml'. |
|
2025-07-01 08:54:01.844 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/draco-oci-iad.yaml'. |
|
2025-07-01 08:54:01.886 | INFO | llava.data.builder:register_datasets:39 - Registering datasets from environment: 'nvidia,draco-oci-iad'. |
|
2025-07-01 08:54:01.886 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/nvidia.yaml'. |
|
2025-07-01 08:54:01.895 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/draco-oci-iad.yaml'. |
|
2025-07-01 08:54:01.895 | INFO | llava.data.builder:register_datasets:39 - Registering datasets from environment: 'nvidia,draco-oci-iad'. |
|
2025-07-01 08:54:01.895 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/nvidia.yaml'. |
|
2025-07-01 08:54:01.904 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/draco-oci-iad.yaml'. |
|
2025-07-01 08:54:01.909 | INFO | llava.data.builder:register_datasets:39 - Registering datasets from environment: 'nvidia,draco-oci-iad'. |
|
2025-07-01 08:54:01.909 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/nvidia.yaml'. |
|
2025-07-01 08:54:01.917 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/draco-oci-iad.yaml'. |
|
2025-07-01 08:54:01.919 | INFO | llava.data.builder:register_datasets:39 - Registering datasets from environment: 'nvidia,draco-oci-iad'. |
|
2025-07-01 08:54:01.919 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/nvidia.yaml'. |
|
2025-07-01 08:54:01.927 | INFO | llava.data.builder:register_datasets:39 - Registering datasets from environment: 'nvidia,draco-oci-iad'. |
|
2025-07-01 08:54:01.928 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/nvidia.yaml'. |
|
2025-07-01 08:54:01.928 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/draco-oci-iad.yaml'. |
|
2025-07-01 08:54:01.937 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/draco-oci-iad.yaml'. |
|
2025-07-01 08:54:01.967 | INFO | llava.data.builder:register_datasets:39 - Registering datasets from environment: 'nvidia,draco-oci-iad'. |
|
2025-07-01 08:54:01.967 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/nvidia.yaml'. |
|
2025-07-01 08:54:01.976 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/draco-oci-iad.yaml'. |
|
2025-07-01 08:54:01.978 | INFO | llava.data.builder:register_datasets:39 - Registering datasets from environment: 'nvidia,draco-oci-iad'. |
|
2025-07-01 08:54:01.978 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/nvidia.yaml'. |
|
2025-07-01 08:54:01.979 | INFO | llava.data.builder:register_datasets:39 - Registering datasets from environment: 'nvidia,draco-oci-iad'. |
|
2025-07-01 08:54:01.979 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/nvidia.yaml'. |
|
2025-07-01 08:54:01.983 | INFO | llava.data.builder:register_datasets:39 - Registering datasets from environment: 'nvidia,draco-oci-iad'. |
|
2025-07-01 08:54:01.983 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/nvidia.yaml'. |
|
2025-07-01 08:54:01.987 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/draco-oci-iad.yaml'. |
|
2025-07-01 08:54:01.988 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/draco-oci-iad.yaml'. |
|
2025-07-01 08:54:01.992 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/draco-oci-iad.yaml'. |
|
2025-07-01 08:54:02.009 | INFO | llava.data.builder:register_datasets:39 - Registering datasets from environment: 'nvidia,draco-oci-iad'. |
|
2025-07-01 08:54:02.009 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/nvidia.yaml'. |
|
2025-07-01 08:54:02.018 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/draco-oci-iad.yaml'. |
|
2025-07-01 08:54:02.059 | INFO | llava.data.builder:register_datasets:39 - Registering datasets from environment: 'nvidia,draco-oci-iad'. |
|
2025-07-01 08:54:02.059 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/nvidia.yaml'. |
|
2025-07-01 08:54:02.061 | INFO | llava.data.builder:register_datasets:39 - Registering datasets from environment: 'nvidia,draco-oci-iad'. |
|
2025-07-01 08:54:02.062 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/nvidia.yaml'. |
|
2025-07-01 08:54:02.062 | INFO | llava.data.builder:register_datasets:39 - Registering datasets from environment: 'nvidia,draco-oci-iad'. |
|
2025-07-01 08:54:02.062 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/nvidia.yaml'. |
|
2025-07-01 08:54:02.065 | INFO | llava.data.builder:register_datasets:39 - Registering datasets from environment: 'nvidia,draco-oci-iad'. |
|
2025-07-01 08:54:02.065 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/nvidia.yaml'. |
|
2025-07-01 08:54:02.066 | INFO | llava.data.builder:register_datasets:39 - Registering datasets from environment: 'nvidia,draco-oci-iad'. |
|
2025-07-01 08:54:02.066 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/nvidia.yaml'. |
|
2025-07-01 08:54:02.068 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/draco-oci-iad.yaml'. |
|
2025-07-01 08:54:02.070 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/draco-oci-iad.yaml'. |
|
2025-07-01 08:54:02.070 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/draco-oci-iad.yaml'. |
|
2025-07-01 08:54:02.073 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/draco-oci-iad.yaml'. |
|
2025-07-01 08:54:02.074 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/draco-oci-iad.yaml'. |
|
2025-07-01 08:54:02.133 | INFO | llava.data.builder:register_datasets:39 - Registering datasets from environment: 'nvidia,draco-oci-iad'. |
|
2025-07-01 08:54:02.133 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/nvidia.yaml'. |
|
2025-07-01 08:54:02.142 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/draco-oci-iad.yaml'. |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/timm/models/layers/__init__.py:48: FutureWarning: Importing from timm.models.layers is deprecated, please import via timm.layers |
|
warnings.warn(f"Importing from {__name__} is deprecated, please import via timm.layers", FutureWarning) |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/timm/models/layers/__init__.py:48: FutureWarning: Importing from timm.models.layers is deprecated, please import via timm.layers |
|
warnings.warn(f"Importing from {__name__} is deprecated, please import via timm.layers", FutureWarning) |
|
2025-07-01 08:54:02.248 | INFO | llava.data.builder:register_datasets:39 - Registering datasets from environment: 'nvidia,draco-oci-iad'. |
|
2025-07-01 08:54:02.248 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/nvidia.yaml'. |
|
2025-07-01 08:54:02.248 | INFO | llava.data.builder:register_datasets:39 - Registering datasets from environment: 'nvidia,draco-oci-iad'. |
|
2025-07-01 08:54:02.248 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/nvidia.yaml'. |
|
2025-07-01 08:54:02.256 | INFO | llava.data.builder:register_datasets:39 - Registering datasets from environment: 'nvidia,draco-oci-iad'. |
|
2025-07-01 08:54:02.256 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/nvidia.yaml'. |
|
2025-07-01 08:54:02.257 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/draco-oci-iad.yaml'. |
|
2025-07-01 08:54:02.257 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/draco-oci-iad.yaml'. |
|
2025-07-01 08:54:02.258 | INFO | llava.data.builder:register_datasets:39 - Registering datasets from environment: 'nvidia,draco-oci-iad'. |
|
2025-07-01 08:54:02.258 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/nvidia.yaml'. |
|
2025-07-01 08:54:02.260 | INFO | llava.data.builder:register_datasets:39 - Registering datasets from environment: 'nvidia,draco-oci-iad'. |
|
2025-07-01 08:54:02.260 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/nvidia.yaml'. |
|
2025-07-01 08:54:02.262 | INFO | llava.data.builder:register_datasets:39 - Registering datasets from environment: 'nvidia,draco-oci-iad'. |
|
2025-07-01 08:54:02.262 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/nvidia.yaml'. |
|
2025-07-01 08:54:02.265 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/draco-oci-iad.yaml'. |
|
2025-07-01 08:54:02.266 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/draco-oci-iad.yaml'. |
|
2025-07-01 08:54:02.269 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/draco-oci-iad.yaml'. |
|
2025-07-01 08:54:02.271 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/draco-oci-iad.yaml'. |
|
2025-07-01 08:54:02.531 | INFO | llava.data.builder:register_datasets:39 - Registering datasets from environment: 'nvidia,draco-oci-iad'. |
|
2025-07-01 08:54:02.531 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/nvidia.yaml'. |
|
2025-07-01 08:54:02.533 | INFO | llava.data.builder:register_datasets:39 - Registering datasets from environment: 'nvidia,draco-oci-iad'. |
|
2025-07-01 08:54:02.533 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/nvidia.yaml'. |
|
2025-07-01 08:54:02.540 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/draco-oci-iad.yaml'. |
|
2025-07-01 08:54:02.542 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/draco-oci-iad.yaml'. |
|
2025-07-01 08:54:02.568 | INFO | llava.data.builder:register_datasets:39 - Registering datasets from environment: 'nvidia,draco-oci-iad'. |
|
2025-07-01 08:54:02.568 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/nvidia.yaml'. |
|
2025-07-01 08:54:02.577 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/draco-oci-iad.yaml'. |
|
2025-07-01 08:54:02.600 | INFO | llava.data.builder:register_datasets:39 - Registering datasets from environment: 'nvidia,draco-oci-iad'. |
|
2025-07-01 08:54:02.600 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/nvidia.yaml'. |
|
2025-07-01 08:54:02.609 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/draco-oci-iad.yaml'. |
|
2025-07-01 08:54:02.625 | INFO | llava.data.builder:register_datasets:39 - Registering datasets from environment: 'nvidia,draco-oci-iad'. |
|
2025-07-01 08:54:02.625 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/nvidia.yaml'. |
|
2025-07-01 08:54:02.626 | INFO | llava.data.builder:register_datasets:39 - Registering datasets from environment: 'nvidia,draco-oci-iad'. |
|
2025-07-01 08:54:02.626 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/nvidia.yaml'. |
|
2025-07-01 08:54:02.633 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/draco-oci-iad.yaml'. |
|
2025-07-01 08:54:02.634 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/draco-oci-iad.yaml'. |
|
2025-07-01 08:54:02.642 | INFO | llava.data.builder:register_datasets:39 - Registering datasets from environment: 'nvidia,draco-oci-iad'. |
|
2025-07-01 08:54:02.642 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/nvidia.yaml'. |
|
2025-07-01 08:54:02.647 | INFO | llava.data.builder:register_datasets:39 - Registering datasets from environment: 'nvidia,draco-oci-iad'. |
|
2025-07-01 08:54:02.647 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/nvidia.yaml'. |
|
2025-07-01 08:54:02.649 | INFO | llava.data.builder:register_datasets:39 - Registering datasets from environment: 'nvidia,draco-oci-iad'. |
|
2025-07-01 08:54:02.649 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/nvidia.yaml'. |
|
2025-07-01 08:54:02.651 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/draco-oci-iad.yaml'. |
|
2025-07-01 08:54:02.656 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/draco-oci-iad.yaml'. |
|
2025-07-01 08:54:02.658 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/draco-oci-iad.yaml'. |
|
2025-07-01 08:54:02.660 | INFO | llava.data.builder:register_datasets:39 - Registering datasets from environment: 'nvidia,draco-oci-iad'. |
|
2025-07-01 08:54:02.660 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/nvidia.yaml'. |
|
2025-07-01 08:54:02.663 | INFO | llava.data.builder:register_datasets:39 - Registering datasets from environment: 'nvidia,draco-oci-iad'. |
|
2025-07-01 08:54:02.663 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/nvidia.yaml'. |
|
2025-07-01 08:54:02.669 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/draco-oci-iad.yaml'. |
|
2025-07-01 08:54:02.671 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/draco-oci-iad.yaml'. |
|
2025-07-01 08:54:02.704 | INFO | llava.data.builder:register_datasets:39 - Registering datasets from environment: 'nvidia,draco-oci-iad'. |
|
2025-07-01 08:54:02.705 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/nvidia.yaml'. |
|
2025-07-01 08:54:02.708 | INFO | llava.data.builder:register_datasets:39 - Registering datasets from environment: 'nvidia,draco-oci-iad'. |
|
2025-07-01 08:54:02.708 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/nvidia.yaml'. |
|
2025-07-01 08:54:02.710 | INFO | llava.data.builder:register_datasets:39 - Registering datasets from environment: 'nvidia,draco-oci-iad'. |
|
2025-07-01 08:54:02.710 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/nvidia.yaml'. |
|
2025-07-01 08:54:02.713 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/draco-oci-iad.yaml'. |
|
2025-07-01 08:54:02.716 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/draco-oci-iad.yaml'. |
|
2025-07-01 08:54:02.717 | INFO | llava.data.builder:register_datasets:39 - Registering datasets from environment: 'nvidia,draco-oci-iad'. |
|
2025-07-01 08:54:02.717 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/nvidia.yaml'. |
|
2025-07-01 08:54:02.718 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/draco-oci-iad.yaml'. |
|
2025-07-01 08:54:02.726 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/draco-oci-iad.yaml'. |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/timm/models/layers/__init__.py:48: FutureWarning: Importing from timm.models.layers is deprecated, please import via timm.layers |
|
warnings.warn(f"Importing from {__name__} is deprecated, please import via timm.layers", FutureWarning) |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/timm/models/layers/__init__.py:48: FutureWarning: Importing from timm.models.layers is deprecated, please import via timm.layers |
|
warnings.warn(f"Importing from {__name__} is deprecated, please import via timm.layers", FutureWarning) |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/timm/models/layers/__init__.py:48: FutureWarning: Importing from timm.models.layers is deprecated, please import via timm.layers |
|
warnings.warn(f"Importing from {__name__} is deprecated, please import via timm.layers", FutureWarning) |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/timm/models/layers/__init__.py:48: FutureWarning: Importing from timm.models.layers is deprecated, please import via timm.layers |
|
warnings.warn(f"Importing from {__name__} is deprecated, please import via timm.layers", FutureWarning) |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/timm/models/layers/__init__.py:48: FutureWarning: Importing from timm.models.layers is deprecated, please import via timm.layers |
|
warnings.warn(f"Importing from {__name__} is deprecated, please import via timm.layers", FutureWarning) |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/timm/models/layers/__init__.py:48: FutureWarning: Importing from timm.models.layers is deprecated, please import via timm.layers |
|
warnings.warn(f"Importing from {__name__} is deprecated, please import via timm.layers", FutureWarning) |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/timm/models/layers/__init__.py:48: FutureWarning: Importing from timm.models.layers is deprecated, please import via timm.layers |
|
warnings.warn(f"Importing from {__name__} is deprecated, please import via timm.layers", FutureWarning) |
|
2025-07-01 08:54:03.085 | INFO | llava.data.builder:register_datasets:39 - Registering datasets from environment: 'nvidia,draco-oci-iad'. |
|
2025-07-01 08:54:03.085 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/nvidia.yaml'. |
|
2025-07-01 08:54:03.086 | INFO | llava.data.builder:register_datasets:39 - Registering datasets from environment: 'nvidia,draco-oci-iad'. |
|
2025-07-01 08:54:03.086 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/nvidia.yaml'. |
|
2025-07-01 08:54:03.094 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/draco-oci-iad.yaml'. |
|
2025-07-01 08:54:03.094 | INFO | llava.data.builder:register_datasets:39 - Registering datasets from environment: 'nvidia,draco-oci-iad'. |
|
2025-07-01 08:54:03.094 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/nvidia.yaml'. |
|
2025-07-01 08:54:03.094 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/draco-oci-iad.yaml'. |
|
2025-07-01 08:54:03.095 | INFO | llava.data.builder:register_datasets:39 - Registering datasets from environment: 'nvidia,draco-oci-iad'. |
|
2025-07-01 08:54:03.095 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/nvidia.yaml'. |
|
2025-07-01 08:54:03.102 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/draco-oci-iad.yaml'. |
|
2025-07-01 08:54:03.103 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/draco-oci-iad.yaml'. |
|
2025-07-01 08:54:03.119 | INFO | llava.data.builder:register_datasets:39 - Registering datasets from environment: 'nvidia,draco-oci-iad'. |
|
2025-07-01 08:54:03.120 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/nvidia.yaml'. |
|
2025-07-01 08:54:03.121 | INFO | llava.data.builder:register_datasets:39 - Registering datasets from environment: 'nvidia,draco-oci-iad'. |
|
2025-07-01 08:54:03.121 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/nvidia.yaml'. |
|
2025-07-01 08:54:03.124 | INFO | llava.data.builder:register_datasets:39 - Registering datasets from environment: 'nvidia,draco-oci-iad'. |
|
2025-07-01 08:54:03.124 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/nvidia.yaml'. |
|
2025-07-01 08:54:03.128 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/draco-oci-iad.yaml'. |
|
2025-07-01 08:54:03.129 | INFO | llava.data.builder:register_datasets:39 - Registering datasets from environment: 'nvidia,draco-oci-iad'. |
|
2025-07-01 08:54:03.129 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/nvidia.yaml'. |
|
2025-07-01 08:54:03.130 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/draco-oci-iad.yaml'. |
|
2025-07-01 08:54:03.132 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/draco-oci-iad.yaml'. |
|
2025-07-01 08:54:03.137 | INFO | llava.data.builder:register_datasets:44 - Registering datasets from: '/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/data/registry/datasets/draco-oci-iad.yaml'. |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/timm/models/layers/__init__.py:48: FutureWarning: Importing from timm.models.layers is deprecated, please import via timm.layers |
|
warnings.warn(f"Importing from {__name__} is deprecated, please import via timm.layers", FutureWarning) |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/timm/models/layers/__init__.py:48: FutureWarning: Importing from timm.models.layers is deprecated, please import via timm.layers |
|
warnings.warn(f"Importing from {__name__} is deprecated, please import via timm.layers", FutureWarning) |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/timm/models/layers/__init__.py:48: FutureWarning: Importing from timm.models.layers is deprecated, please import via timm.layers |
|
warnings.warn(f"Importing from {__name__} is deprecated, please import via timm.layers", FutureWarning) |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/timm/models/layers/__init__.py:48: FutureWarning: Importing from timm.models.layers is deprecated, please import via timm.layers |
|
warnings.warn(f"Importing from {__name__} is deprecated, please import via timm.layers", FutureWarning) |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/timm/models/layers/__init__.py:48: FutureWarning: Importing from timm.models.layers is deprecated, please import via timm.layers |
|
warnings.warn(f"Importing from {__name__} is deprecated, please import via timm.layers", FutureWarning) |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/timm/models/layers/__init__.py:48: FutureWarning: Importing from timm.models.layers is deprecated, please import via timm.layers |
|
warnings.warn(f"Importing from {__name__} is deprecated, please import via timm.layers", FutureWarning) |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/timm/models/layers/__init__.py:48: FutureWarning: Importing from timm.models.layers is deprecated, please import via timm.layers |
|
warnings.warn(f"Importing from {__name__} is deprecated, please import via timm.layers", FutureWarning) |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/timm/models/layers/__init__.py:48: FutureWarning: Importing from timm.models.layers is deprecated, please import via timm.layers |
|
warnings.warn(f"Importing from {__name__} is deprecated, please import via timm.layers", FutureWarning) |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/timm/models/layers/__init__.py:48: FutureWarning: Importing from timm.models.layers is deprecated, please import via timm.layers |
|
warnings.warn(f"Importing from {__name__} is deprecated, please import via timm.layers", FutureWarning) |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/timm/models/layers/__init__.py:48: FutureWarning: Importing from timm.models.layers is deprecated, please import via timm.layers |
|
warnings.warn(f"Importing from {__name__} is deprecated, please import via timm.layers", FutureWarning) |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/timm/models/layers/__init__.py:48: FutureWarning: Importing from timm.models.layers is deprecated, please import via timm.layers |
|
warnings.warn(f"Importing from {__name__} is deprecated, please import via timm.layers", FutureWarning) |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/timm/models/layers/__init__.py:48: FutureWarning: Importing from timm.models.layers is deprecated, please import via timm.layers |
|
warnings.warn(f"Importing from {__name__} is deprecated, please import via timm.layers", FutureWarning) |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/timm/models/layers/__init__.py:48: FutureWarning: Importing from timm.models.layers is deprecated, please import via timm.layers |
|
warnings.warn(f"Importing from {__name__} is deprecated, please import via timm.layers", FutureWarning) |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/timm/models/layers/__init__.py:48: FutureWarning: Importing from timm.models.layers is deprecated, please import via timm.layers |
|
warnings.warn(f"Importing from {__name__} is deprecated, please import via timm.layers", FutureWarning) |
|
Did not find AutoResume SDK! |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/timm/models/layers/__init__.py:48: FutureWarning: Importing from timm.models.layers is deprecated, please import via timm.layers |
|
warnings.warn(f"Importing from {__name__} is deprecated, please import via timm.layers", FutureWarning) |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/timm/models/layers/__init__.py:48: FutureWarning: Importing from timm.models.layers is deprecated, please import via timm.layers |
|
warnings.warn(f"Importing from {__name__} is deprecated, please import via timm.layers", FutureWarning) |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/timm/models/layers/__init__.py:48: FutureWarning: Importing from timm.models.layers is deprecated, please import via timm.layers |
|
warnings.warn(f"Importing from {__name__} is deprecated, please import via timm.layers", FutureWarning) |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/timm/models/layers/__init__.py:48: FutureWarning: Importing from timm.models.layers is deprecated, please import via timm.layers |
|
warnings.warn(f"Importing from {__name__} is deprecated, please import via timm.layers", FutureWarning) |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/timm/models/layers/__init__.py:48: FutureWarning: Importing from timm.models.layers is deprecated, please import via timm.layers |
|
warnings.warn(f"Importing from {__name__} is deprecated, please import via timm.layers", FutureWarning) |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/timm/models/layers/__init__.py:48: FutureWarning: Importing from timm.models.layers is deprecated, please import via timm.layers |
|
warnings.warn(f"Importing from {__name__} is deprecated, please import via timm.layers", FutureWarning) |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/timm/models/layers/__init__.py:48: FutureWarning: Importing from timm.models.layers is deprecated, please import via timm.layers |
|
warnings.warn(f"Importing from {__name__} is deprecated, please import via timm.layers", FutureWarning) |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/timm/models/layers/__init__.py:48: FutureWarning: Importing from timm.models.layers is deprecated, please import via timm.layers |
|
warnings.warn(f"Importing from {__name__} is deprecated, please import via timm.layers", FutureWarning) |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/timm/models/layers/__init__.py:48: FutureWarning: Importing from timm.models.layers is deprecated, please import via timm.layers |
|
warnings.warn(f"Importing from {__name__} is deprecated, please import via timm.layers", FutureWarning) |
|
Did not find AutoResume SDK! |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/timm/models/layers/__init__.py:48: FutureWarning: Importing from timm.models.layers is deprecated, please import via timm.layers |
|
warnings.warn(f"Importing from {__name__} is deprecated, please import via timm.layers", FutureWarning) |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/timm/models/layers/__init__.py:48: FutureWarning: Importing from timm.models.layers is deprecated, please import via timm.layers |
|
warnings.warn(f"Importing from {__name__} is deprecated, please import via timm.layers", FutureWarning) |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/timm/models/layers/__init__.py:48: FutureWarning: Importing from timm.models.layers is deprecated, please import via timm.layers |
|
warnings.warn(f"Importing from {__name__} is deprecated, please import via timm.layers", FutureWarning) |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/timm/models/layers/__init__.py:48: FutureWarning: Importing from timm.models.layers is deprecated, please import via timm.layers |
|
warnings.warn(f"Importing from {__name__} is deprecated, please import via timm.layers", FutureWarning) |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/timm/models/layers/__init__.py:48: FutureWarning: Importing from timm.models.layers is deprecated, please import via timm.layers |
|
warnings.warn(f"Importing from {__name__} is deprecated, please import via timm.layers", FutureWarning) |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/timm/models/layers/__init__.py:48: FutureWarning: Importing from timm.models.layers is deprecated, please import via timm.layers |
|
warnings.warn(f"Importing from {__name__} is deprecated, please import via timm.layers", FutureWarning) |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/timm/models/layers/__init__.py:48: FutureWarning: Importing from timm.models.layers is deprecated, please import via timm.layers |
|
warnings.warn(f"Importing from {__name__} is deprecated, please import via timm.layers", FutureWarning) |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/timm/models/layers/__init__.py:48: FutureWarning: Importing from timm.models.layers is deprecated, please import via timm.layers |
|
warnings.warn(f"Importing from {__name__} is deprecated, please import via timm.layers", FutureWarning) |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/timm/models/layers/__init__.py:48: FutureWarning: Importing from timm.models.layers is deprecated, please import via timm.layers |
|
warnings.warn(f"Importing from {__name__} is deprecated, please import via timm.layers", FutureWarning) |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/timm/models/layers/__init__.py:48: FutureWarning: Importing from timm.models.layers is deprecated, please import via timm.layers |
|
warnings.warn(f"Importing from {__name__} is deprecated, please import via timm.layers", FutureWarning) |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/timm/models/layers/__init__.py:48: FutureWarning: Importing from timm.models.layers is deprecated, please import via timm.layers |
|
warnings.warn(f"Importing from {__name__} is deprecated, please import via timm.layers", FutureWarning) |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/timm/models/layers/__init__.py:48: FutureWarning: Importing from timm.models.layers is deprecated, please import via timm.layers |
|
warnings.warn(f"Importing from {__name__} is deprecated, please import via timm.layers", FutureWarning) |
|
Did not find AutoResume SDK! |
|
Did not find AutoResume SDK! |
|
Did not find AutoResume SDK! |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/timm/models/layers/__init__.py:48: FutureWarning: Importing from timm.models.layers is deprecated, please import via timm.layers |
|
warnings.warn(f"Importing from {__name__} is deprecated, please import via timm.layers", FutureWarning) |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/timm/models/layers/__init__.py:48: FutureWarning: Importing from timm.models.layers is deprecated, please import via timm.layers |
|
warnings.warn(f"Importing from {__name__} is deprecated, please import via timm.layers", FutureWarning) |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/timm/models/layers/__init__.py:48: FutureWarning: Importing from timm.models.layers is deprecated, please import via timm.layers |
|
warnings.warn(f"Importing from {__name__} is deprecated, please import via timm.layers", FutureWarning) |
|
Did not find AutoResume SDK! |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/timm/models/layers/__init__.py:48: FutureWarning: Importing from timm.models.layers is deprecated, please import via timm.layers |
|
warnings.warn(f"Importing from {__name__} is deprecated, please import via timm.layers", FutureWarning) |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/timm/models/layers/__init__.py:48: FutureWarning: Importing from timm.models.layers is deprecated, please import via timm.layers |
|
warnings.warn(f"Importing from {__name__} is deprecated, please import via timm.layers", FutureWarning) |
|
Did not find AutoResume SDK! |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/timm/models/layers/__init__.py:48: FutureWarning: Importing from timm.models.layers is deprecated, please import via timm.layers |
|
warnings.warn(f"Importing from {__name__} is deprecated, please import via timm.layers", FutureWarning) |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/timm/models/layers/__init__.py:48: FutureWarning: Importing from timm.models.layers is deprecated, please import via timm.layers |
|
warnings.warn(f"Importing from {__name__} is deprecated, please import via timm.layers", FutureWarning) |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/timm/models/layers/__init__.py:48: FutureWarning: Importing from timm.models.layers is deprecated, please import via timm.layers |
|
warnings.warn(f"Importing from {__name__} is deprecated, please import via timm.layers", FutureWarning) |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/transformers/training_args.py:1559: FutureWarning: `evaluation_strategy` is deprecated and will be removed in version 4.46 of 🤗 Transformers. Use `eval_strategy` instead |
|
warnings.warn( |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/timm/models/layers/__init__.py:48: FutureWarning: Importing from timm.models.layers is deprecated, please import via timm.layers |
|
warnings.warn(f"Importing from {__name__} is deprecated, please import via timm.layers", FutureWarning) |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/timm/models/layers/__init__.py:48: FutureWarning: Importing from timm.models.layers is deprecated, please import via timm.layers |
|
warnings.warn(f"Importing from {__name__} is deprecated, please import via timm.layers", FutureWarning) |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/timm/models/layers/__init__.py:48: FutureWarning: Importing from timm.models.layers is deprecated, please import via timm.layers |
|
warnings.warn(f"Importing from {__name__} is deprecated, please import via timm.layers", FutureWarning) |
|
Did not find AutoResume SDK! |
|
Did not find AutoResume SDK! |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/timm/models/layers/__init__.py:48: FutureWarning: Importing from timm.models.layers is deprecated, please import via timm.layers |
|
warnings.warn(f"Importing from {__name__} is deprecated, please import via timm.layers", FutureWarning) |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/transformers/training_args.py:1559: FutureWarning: `evaluation_strategy` is deprecated and will be removed in version 4.46 of 🤗 Transformers. Use `eval_strategy` instead |
|
warnings.warn( |
|
Did not find AutoResume SDK! |
|
Did not find AutoResume SDK! |
|
Did not find AutoResume SDK! |
|
Did not find AutoResume SDK! |
|
Did not find AutoResume SDK! |
|
Did not find AutoResume SDK! |
|
Did not find AutoResume SDK! |
|
Did not find AutoResume SDK! |
|
Did not find AutoResume SDK! |
|
Did not find AutoResume SDK! |
|
Did not find AutoResume SDK! |
|
Did not find AutoResume SDK! |
|
Did not find AutoResume SDK! |
|
Did not find AutoResume SDK! |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/timm/models/layers/__init__.py:48: FutureWarning: Importing from timm.models.layers is deprecated, please import via timm.layers |
|
warnings.warn(f"Importing from {__name__} is deprecated, please import via timm.layers", FutureWarning) |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/timm/models/layers/__init__.py:48: FutureWarning: Importing from timm.models.layers is deprecated, please import via timm.layers |
|
warnings.warn(f"Importing from {__name__} is deprecated, please import via timm.layers", FutureWarning) |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/timm/models/layers/__init__.py:48: FutureWarning: Importing from timm.models.layers is deprecated, please import via timm.layers |
|
warnings.warn(f"Importing from {__name__} is deprecated, please import via timm.layers", FutureWarning) |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/timm/models/layers/__init__.py:48: FutureWarning: Importing from timm.models.layers is deprecated, please import via timm.layers |
|
warnings.warn(f"Importing from {__name__} is deprecated, please import via timm.layers", FutureWarning) |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/timm/models/layers/__init__.py:48: FutureWarning: Importing from timm.models.layers is deprecated, please import via timm.layers |
|
warnings.warn(f"Importing from {__name__} is deprecated, please import via timm.layers", FutureWarning) |
|
Did not find AutoResume SDK! |
|
Did not find AutoResume SDK! |
|
Did not find AutoResume SDK! |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/timm/models/layers/__init__.py:48: FutureWarning: Importing from timm.models.layers is deprecated, please import via timm.layers |
|
warnings.warn(f"Importing from {__name__} is deprecated, please import via timm.layers", FutureWarning) |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/timm/models/layers/__init__.py:48: FutureWarning: Importing from timm.models.layers is deprecated, please import via timm.layers |
|
warnings.warn(f"Importing from {__name__} is deprecated, please import via timm.layers", FutureWarning) |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/timm/models/layers/__init__.py:48: FutureWarning: Importing from timm.models.layers is deprecated, please import via timm.layers |
|
warnings.warn(f"Importing from {__name__} is deprecated, please import via timm.layers", FutureWarning) |
|
Did not find AutoResume SDK! |
|
Did not find AutoResume SDK! |
|
Did not find AutoResume SDK! |
|
Did not find AutoResume SDK! |
|
Did not find AutoResume SDK! |
|
Did not find AutoResume SDK! |
|
Did not find AutoResume SDK! |
|
Did not find AutoResume SDK! |
|
Did not find AutoResume SDK! |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/transformers/training_args.py:1559: FutureWarning: `evaluation_strategy` is deprecated and will be removed in version 4.46 of 🤗 Transformers. Use `eval_strategy` instead |
|
warnings.warn( |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/transformers/training_args.py:1559: FutureWarning: `evaluation_strategy` is deprecated and will be removed in version 4.46 of 🤗 Transformers. Use `eval_strategy` instead |
|
warnings.warn( |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/transformers/training_args.py:1559: FutureWarning: `evaluation_strategy` is deprecated and will be removed in version 4.46 of 🤗 Transformers. Use `eval_strategy` instead |
|
warnings.warn( |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/transformers/training_args.py:1559: FutureWarning: `evaluation_strategy` is deprecated and will be removed in version 4.46 of 🤗 Transformers. Use `eval_strategy` instead |
|
warnings.warn( |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/transformers/training_args.py:1559: FutureWarning: `evaluation_strategy` is deprecated and will be removed in version 4.46 of 🤗 Transformers. Use `eval_strategy` instead |
|
warnings.warn( |
|
Did not find AutoResume SDK! |
|
Did not find AutoResume SDK! |
|
Did not find AutoResume SDK! |
|
Did not find AutoResume SDK! |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/transformers/training_args.py:1559: FutureWarning: `evaluation_strategy` is deprecated and will be removed in version 4.46 of 🤗 Transformers. Use `eval_strategy` instead |
|
warnings.warn( |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/transformers/training_args.py:1559: FutureWarning: `evaluation_strategy` is deprecated and will be removed in version 4.46 of 🤗 Transformers. Use `eval_strategy` instead |
|
warnings.warn( |
|
Did not find AutoResume SDK! |
|
Did not find AutoResume SDK! |
|
Did not find AutoResume SDK! |
|
Did not find AutoResume SDK! |
|
Did not find AutoResume SDK! |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/transformers/training_args.py:1559: FutureWarning: `evaluation_strategy` is deprecated and will be removed in version 4.46 of 🤗 Transformers. Use `eval_strategy` instead |
|
warnings.warn( |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/transformers/training_args.py:1559: FutureWarning: `evaluation_strategy` is deprecated and will be removed in version 4.46 of 🤗 Transformers. Use `eval_strategy` instead |
|
warnings.warn( |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/transformers/training_args.py:1559: FutureWarning: `evaluation_strategy` is deprecated and will be removed in version 4.46 of 🤗 Transformers. Use `eval_strategy` instead |
|
warnings.warn( |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/transformers/training_args.py:1559: FutureWarning: `evaluation_strategy` is deprecated and will be removed in version 4.46 of 🤗 Transformers. Use `eval_strategy` instead |
|
warnings.warn( |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/transformers/training_args.py:1559: FutureWarning: `evaluation_strategy` is deprecated and will be removed in version 4.46 of 🤗 Transformers. Use `eval_strategy` instead |
|
warnings.warn( |
|
Did not find AutoResume SDK! |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/transformers/training_args.py:1559: FutureWarning: `evaluation_strategy` is deprecated and will be removed in version 4.46 of 🤗 Transformers. Use `eval_strategy` instead |
|
warnings.warn( |
|
Did not find AutoResume SDK! |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/transformers/training_args.py:1559: FutureWarning: `evaluation_strategy` is deprecated and will be removed in version 4.46 of 🤗 Transformers. Use `eval_strategy` instead |
|
warnings.warn( |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/transformers/training_args.py:1559: FutureWarning: `evaluation_strategy` is deprecated and will be removed in version 4.46 of 🤗 Transformers. Use `eval_strategy` instead |
|
warnings.warn( |
|
Did not find AutoResume SDK! |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/transformers/training_args.py:1559: FutureWarning: `evaluation_strategy` is deprecated and will be removed in version 4.46 of 🤗 Transformers. Use `eval_strategy` instead |
|
warnings.warn( |
|
Did not find AutoResume SDK! |
|
Did not find AutoResume SDK! |
|
Did not find AutoResume SDK! |
|
Did not find AutoResume SDK! |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/transformers/training_args.py:1559: FutureWarning: `evaluation_strategy` is deprecated and will be removed in version 4.46 of 🤗 Transformers. Use `eval_strategy` instead |
|
warnings.warn( |
|
Did not find AutoResume SDK! |
|
Did not find AutoResume SDK! |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/transformers/training_args.py:1559: FutureWarning: `evaluation_strategy` is deprecated and will be removed in version 4.46 of 🤗 Transformers. Use `eval_strategy` instead |
|
warnings.warn( |
|
Did not find AutoResume SDK! |
|
Did not find AutoResume SDK! |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/transformers/training_args.py:1559: FutureWarning: `evaluation_strategy` is deprecated and will be removed in version 4.46 of 🤗 Transformers. Use `eval_strategy` instead |
|
warnings.warn( |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/transformers/training_args.py:1559: FutureWarning: `evaluation_strategy` is deprecated and will be removed in version 4.46 of 🤗 Transformers. Use `eval_strategy` instead |
|
warnings.warn( |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/transformers/training_args.py:1559: FutureWarning: `evaluation_strategy` is deprecated and will be removed in version 4.46 of 🤗 Transformers. Use `eval_strategy` instead |
|
warnings.warn( |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/transformers/training_args.py:1559: FutureWarning: `evaluation_strategy` is deprecated and will be removed in version 4.46 of 🤗 Transformers. Use `eval_strategy` instead |
|
warnings.warn( |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/transformers/training_args.py:1559: FutureWarning: `evaluation_strategy` is deprecated and will be removed in version 4.46 of 🤗 Transformers. Use `eval_strategy` instead |
|
warnings.warn( |
|
Did not find AutoResume SDK! |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/transformers/training_args.py:1559: FutureWarning: `evaluation_strategy` is deprecated and will be removed in version 4.46 of 🤗 Transformers. Use `eval_strategy` instead |
|
warnings.warn( |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/transformers/training_args.py:1559: FutureWarning: `evaluation_strategy` is deprecated and will be removed in version 4.46 of 🤗 Transformers. Use `eval_strategy` instead |
|
warnings.warn( |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/transformers/training_args.py:1559: FutureWarning: `evaluation_strategy` is deprecated and will be removed in version 4.46 of 🤗 Transformers. Use `eval_strategy` instead |
|
warnings.warn( |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/transformers/training_args.py:1559: FutureWarning: `evaluation_strategy` is deprecated and will be removed in version 4.46 of 🤗 Transformers. Use `eval_strategy` instead |
|
warnings.warn( |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/transformers/training_args.py:1559: FutureWarning: `evaluation_strategy` is deprecated and will be removed in version 4.46 of 🤗 Transformers. Use `eval_strategy` instead |
|
warnings.warn( |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/transformers/training_args.py:1559: FutureWarning: `evaluation_strategy` is deprecated and will be removed in version 4.46 of 🤗 Transformers. Use `eval_strategy` instead |
|
warnings.warn( |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/transformers/training_args.py:1559: FutureWarning: `evaluation_strategy` is deprecated and will be removed in version 4.46 of 🤗 Transformers. Use `eval_strategy` instead |
|
warnings.warn( |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/transformers/training_args.py:1559: FutureWarning: `evaluation_strategy` is deprecated and will be removed in version 4.46 of 🤗 Transformers. Use `eval_strategy` instead |
|
warnings.warn( |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/transformers/training_args.py:1559: FutureWarning: `evaluation_strategy` is deprecated and will be removed in version 4.46 of 🤗 Transformers. Use `eval_strategy` instead |
|
warnings.warn( |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/transformers/training_args.py:1559: FutureWarning: `evaluation_strategy` is deprecated and will be removed in version 4.46 of 🤗 Transformers. Use `eval_strategy` instead |
|
warnings.warn( |
|
Did not find AutoResume SDK! |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/transformers/training_args.py:1559: FutureWarning: `evaluation_strategy` is deprecated and will be removed in version 4.46 of 🤗 Transformers. Use `eval_strategy` instead |
|
warnings.warn( |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/transformers/training_args.py:1559: FutureWarning: `evaluation_strategy` is deprecated and will be removed in version 4.46 of 🤗 Transformers. Use `eval_strategy` instead |
|
warnings.warn( |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/transformers/training_args.py:1559: FutureWarning: `evaluation_strategy` is deprecated and will be removed in version 4.46 of 🤗 Transformers. Use `eval_strategy` instead |
|
warnings.warn( |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/transformers/training_args.py:1559: FutureWarning: `evaluation_strategy` is deprecated and will be removed in version 4.46 of 🤗 Transformers. Use `eval_strategy` instead |
|
warnings.warn( |
|
Did not find AutoResume SDK! |
|
Did not find AutoResume SDK! |
|
Did not find AutoResume SDK! |
|
Did not find AutoResume SDK! |
|
Did not find AutoResume SDK! |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/transformers/training_args.py:1559: FutureWarning: `evaluation_strategy` is deprecated and will be removed in version 4.46 of 🤗 Transformers. Use `eval_strategy` instead |
|
warnings.warn( |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/transformers/training_args.py:1559: FutureWarning: `evaluation_strategy` is deprecated and will be removed in version 4.46 of 🤗 Transformers. Use `eval_strategy` instead |
|
warnings.warn( |
|
Did not find AutoResume SDK! |
|
Did not find AutoResume SDK! |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/transformers/training_args.py:1559: FutureWarning: `evaluation_strategy` is deprecated and will be removed in version 4.46 of 🤗 Transformers. Use `eval_strategy` instead |
|
warnings.warn( |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/transformers/training_args.py:1559: FutureWarning: `evaluation_strategy` is deprecated and will be removed in version 4.46 of 🤗 Transformers. Use `eval_strategy` instead |
|
warnings.warn( |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/transformers/training_args.py:1559: FutureWarning: `evaluation_strategy` is deprecated and will be removed in version 4.46 of 🤗 Transformers. Use `eval_strategy` instead |
|
warnings.warn( |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/transformers/training_args.py:1559: FutureWarning: `evaluation_strategy` is deprecated and will be removed in version 4.46 of 🤗 Transformers. Use `eval_strategy` instead |
|
warnings.warn( |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/transformers/training_args.py:1559: FutureWarning: `evaluation_strategy` is deprecated and will be removed in version 4.46 of 🤗 Transformers. Use `eval_strategy` instead |
|
warnings.warn( |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/transformers/training_args.py:1559: FutureWarning: `evaluation_strategy` is deprecated and will be removed in version 4.46 of 🤗 Transformers. Use `eval_strategy` instead |
|
warnings.warn( |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/transformers/training_args.py:1559: FutureWarning: `evaluation_strategy` is deprecated and will be removed in version 4.46 of 🤗 Transformers. Use `eval_strategy` instead |
|
warnings.warn( |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/transformers/training_args.py:1559: FutureWarning: `evaluation_strategy` is deprecated and will be removed in version 4.46 of 🤗 Transformers. Use `eval_strategy` instead |
|
warnings.warn( |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/transformers/training_args.py:1559: FutureWarning: `evaluation_strategy` is deprecated and will be removed in version 4.46 of 🤗 Transformers. Use `eval_strategy` instead |
|
warnings.warn( |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/transformers/training_args.py:1559: FutureWarning: `evaluation_strategy` is deprecated and will be removed in version 4.46 of 🤗 Transformers. Use `eval_strategy` instead |
|
warnings.warn( |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/transformers/training_args.py:1559: FutureWarning: `evaluation_strategy` is deprecated and will be removed in version 4.46 of 🤗 Transformers. Use `eval_strategy` instead |
|
warnings.warn( |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/transformers/training_args.py:1559: FutureWarning: `evaluation_strategy` is deprecated and will be removed in version 4.46 of 🤗 Transformers. Use `eval_strategy` instead |
|
warnings.warn( |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/transformers/training_args.py:1559: FutureWarning: `evaluation_strategy` is deprecated and will be removed in version 4.46 of 🤗 Transformers. Use `eval_strategy` instead |
|
warnings.warn( |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/transformers/training_args.py:1559: FutureWarning: `evaluation_strategy` is deprecated and will be removed in version 4.46 of 🤗 Transformers. Use `eval_strategy` instead |
|
warnings.warn( |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/transformers/training_args.py:1559: FutureWarning: `evaluation_strategy` is deprecated and will be removed in version 4.46 of 🤗 Transformers. Use `eval_strategy` instead |
|
warnings.warn( |
|
Fetching 21 files: 0%| | 0/21 [00:00<?, ?it/s]
Fetching 21 files: 100%|██████████| 21/21 [00:00<00:00, 6937.10it/s] |
|
You are attempting to use Flash Attention 2.0 with a model not initialized on GPU. Make sure to move the model to GPU after initializing it on CPU with `model.to('cuda')`. |
|
Fetching 21 files: 0%| | 0/21 [00:00<?, ?it/s]
Fetching 21 files: 100%|██████████| 21/21 [00:00<00:00, 6425.47it/s] |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/transformers/training_args.py:1559: FutureWarning: `evaluation_strategy` is deprecated and will be removed in version 4.46 of 🤗 Transformers. Use `eval_strategy` instead |
|
warnings.warn( |
|
You are attempting to use Flash Attention 2.0 with a model not initialized on GPU. Make sure to move the model to GPU after initializing it on CPU with `model.to('cuda')`. |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/transformers/training_args.py:1559: FutureWarning: `evaluation_strategy` is deprecated and will be removed in version 4.46 of 🤗 Transformers. Use `eval_strategy` instead |
|
warnings.warn( |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/transformers/training_args.py:1559: FutureWarning: `evaluation_strategy` is deprecated and will be removed in version 4.46 of 🤗 Transformers. Use `eval_strategy` instead |
|
warnings.warn( |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/transformers/training_args.py:1559: FutureWarning: `evaluation_strategy` is deprecated and will be removed in version 4.46 of 🤗 Transformers. Use `eval_strategy` instead |
|
warnings.warn( |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/transformers/training_args.py:1559: FutureWarning: `evaluation_strategy` is deprecated and will be removed in version 4.46 of 🤗 Transformers. Use `eval_strategy` instead |
|
warnings.warn( |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/transformers/training_args.py:1559: FutureWarning: `evaluation_strategy` is deprecated and will be removed in version 4.46 of 🤗 Transformers. Use `eval_strategy` instead |
|
warnings.warn( |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/transformers/training_args.py:1559: FutureWarning: `evaluation_strategy` is deprecated and will be removed in version 4.46 of 🤗 Transformers. Use `eval_strategy` instead |
|
warnings.warn( |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/transformers/training_args.py:1559: FutureWarning: `evaluation_strategy` is deprecated and will be removed in version 4.46 of 🤗 Transformers. Use `eval_strategy` instead |
|
warnings.warn( |
|
Fetching 21 files: 0%| | 0/21 [00:00<?, ?it/s]
Fetching 21 files: 100%|██████████| 21/21 [00:00<00:00, 9392.24it/s] |
|
You are attempting to use Flash Attention 2.0 with a model not initialized on GPU. Make sure to move the model to GPU after initializing it on CPU with `model.to('cuda')`. |
|
Fetching 21 files: 0%| | 0/21 [00:00<?, ?it/s]
Fetching 21 files: 100%|██████████| 21/21 [00:00<00:00, 6332.62it/s] |
|
Fetching 21 files: 0%| | 0/21 [00:00<?, ?it/s]
Fetching 21 files: 100%|██████████| 21/21 [00:00<00:00, 9980.78it/s] |
|
Fetching 21 files: 0%| | 0/21 [00:00<?, ?it/s]
Fetching 21 files: 100%|██████████| 21/21 [00:00<00:00, 8561.47it/s] |
|
You are attempting to use Flash Attention 2.0 with a model not initialized on GPU. Make sure to move the model to GPU after initializing it on CPU with `model.to('cuda')`. |
|
Fetching 21 files: 0%| | 0/21 [00:00<?, ?it/s]
Fetching 21 files: 100%|██████████| 21/21 [00:00<00:00, 7409.81it/s] |
|
Fetching 21 files: 0%| | 0/21 [00:00<?, ?it/s]
Fetching 21 files: 100%|██████████| 21/21 [00:00<00:00, 7155.19it/s] |
|
Fetching 21 files: 0%| | 0/21 [00:00<?, ?it/s]
Fetching 21 files: 100%|██████████| 21/21 [00:00<00:00, 9320.68it/s] |
|
You are attempting to use Flash Attention 2.0 with a model not initialized on GPU. Make sure to move the model to GPU after initializing it on CPU with `model.to('cuda')`. |
|
You are attempting to use Flash Attention 2.0 with a model not initialized on GPU. Make sure to move the model to GPU after initializing it on CPU with `model.to('cuda')`. |
|
You are attempting to use Flash Attention 2.0 with a model not initialized on GPU. Make sure to move the model to GPU after initializing it on CPU with `model.to('cuda')`. |
|
You are attempting to use Flash Attention 2.0 with a model not initialized on GPU. Make sure to move the model to GPU after initializing it on CPU with `model.to('cuda')`. |
|
You are attempting to use Flash Attention 2.0 with a model not initialized on GPU. Make sure to move the model to GPU after initializing it on CPU with `model.to('cuda')`. |
|
Fetching 21 files: 0%| | 0/21 [00:00<?, ?it/s]
Fetching 21 files: 100%|██████████| 21/21 [00:00<00:00, 6802.10it/s] |
|
Fetching 21 files: 0%| | 0/21 [00:00<?, ?it/s]
Fetching 21 files: 100%|██████████| 21/21 [00:00<00:00, 6836.95it/s] |
|
You are attempting to use Flash Attention 2.0 with a model not initialized on GPU. Make sure to move the model to GPU after initializing it on CPU with `model.to('cuda')`. |
|
Fetching 21 files: 0%| | 0/21 [00:00<?, ?it/s]
Fetching 21 files: 100%|██████████| 21/21 [00:00<00:00, 7649.19it/s] |
|
Fetching 21 files: 0%| | 0/21 [00:00<?, ?it/s]
Fetching 21 files: 100%|██████████| 21/21 [00:00<00:00, 6621.59it/s] |
|
You are attempting to use Flash Attention 2.0 with a model not initialized on GPU. Make sure to move the model to GPU after initializing it on CPU with `model.to('cuda')`. |
|
Fetching 21 files: 0%| | 0/21 [00:00<?, ?it/s]
Fetching 21 files: 100%|██████████| 21/21 [00:00<00:00, 6888.28it/s] |
|
Fetching 21 files: 0%| | 0/21 [00:00<?, ?it/s]
Fetching 21 files: 100%|██████████| 21/21 [00:00<00:00, 7516.67it/s] |
|
Fetching 21 files: 0%| | 0/21 [00:00<?, ?it/s]
Fetching 21 files: 0%| | 0/21 [00:00<?, ?it/s]
Fetching 21 files: 100%|██████████| 21/21 [00:00<00:00, 9298.05it/s] |
|
Fetching 21 files: 0%| | 0/21 [00:00<?, ?it/s]
Fetching 21 files: 100%|██████████| 21/21 [00:00<00:00, 7818.94it/s] |
|
Fetching 21 files: 100%|██████████| 21/21 [00:00<00:00, 6927.28it/s] |
|
You are attempting to use Flash Attention 2.0 with a model not initialized on GPU. Make sure to move the model to GPU after initializing it on CPU with `model.to('cuda')`. |
|
You are attempting to use Flash Attention 2.0 with a model not initialized on GPU. Make sure to move the model to GPU after initializing it on CPU with `model.to('cuda')`. |
|
Fetching 21 files: 0%| | 0/21 [00:00<?, ?it/s]
Fetching 21 files: 100%|██████████| 21/21 [00:00<00:00, 9095.45it/s] |
|
Fetching 21 files: 0%| | 0/21 [00:00<?, ?it/s]
Fetching 21 files: 100%|██████████| 21/21 [00:00<00:00, 10740.20it/s] |
|
Fetching 21 files: 0%| | 0/21 [00:00<?, ?it/s]
Fetching 21 files: 100%|██████████| 21/21 [00:00<00:00, 9958.21it/s] |
|
You are attempting to use Flash Attention 2.0 with a model not initialized on GPU. Make sure to move the model to GPU after initializing it on CPU with `model.to('cuda')`. |
|
You are attempting to use Flash Attention 2.0 with a model not initialized on GPU. Make sure to move the model to GPU after initializing it on CPU with `model.to('cuda')`. |
|
You are attempting to use Flash Attention 2.0 with a model not initialized on GPU. Make sure to move the model to GPU after initializing it on CPU with `model.to('cuda')`. |
|
You are attempting to use Flash Attention 2.0 with a model not initialized on GPU. Make sure to move the model to GPU after initializing it on CPU with `model.to('cuda')`. |
|
You are attempting to use Flash Attention 2.0 with a model not initialized on GPU. Make sure to move the model to GPU after initializing it on CPU with `model.to('cuda')`. |
|
Fetching 21 files: 0%| | 0/21 [00:00<?, ?it/s]
Fetching 21 files: 100%|██████████| 21/21 [00:00<00:00, 7247.62it/s] |
|
Fetching 21 files: 0%| | 0/21 [00:00<?, ?it/s]
Fetching 21 files: 100%|██████████| 21/21 [00:00<00:00, 7725.67it/s] |
|
You are attempting to use Flash Attention 2.0 with a model not initialized on GPU. Make sure to move the model to GPU after initializing it on CPU with `model.to('cuda')`. |
|
You are attempting to use Flash Attention 2.0 with a model not initialized on GPU. Make sure to move the model to GPU after initializing it on CPU with `model.to('cuda')`. |
|
Fetching 21 files: 0%| | 0/21 [00:00<?, ?it/s]
Fetching 21 files: 100%|██████████| 21/21 [00:00<00:00, 8417.47it/s] |
|
You are attempting to use Flash Attention 2.0 with a model not initialized on GPU. Make sure to move the model to GPU after initializing it on CPU with `model.to('cuda')`. |
|
You are attempting to use Flash Attention 2.0 with a model not initialized on GPU. Make sure to move the model to GPU after initializing it on CPU with `model.to('cuda')`. |
|
Fetching 21 files: 0%| | 0/21 [00:00<?, ?it/s]
Fetching 21 files: 100%|██████████| 21/21 [00:00<00:00, 8751.16it/s] |
|
You are attempting to use Flash Attention 2.0 with a model not initialized on GPU. Make sure to move the model to GPU after initializing it on CPU with `model.to('cuda')`. |
|
You are attempting to use Flash Attention 2.0 with a model not initialized on GPU. Make sure to move the model to GPU after initializing it on CPU with `model.to('cuda')`. |
|
You are attempting to use Flash Attention 2.0 with a model not initialized on GPU. Make sure to move the model to GPU after initializing it on CPU with `model.to('cuda')`. |
|
Fetching 21 files: 0%| | 0/21 [00:00<?, ?it/s]
Fetching 21 files: 100%|██████████| 21/21 [00:00<00:00, 18168.40it/s] |
|
Fetching 21 files: 0%| | 0/21 [00:00<?, ?it/s]
Fetching 21 files: 0%| | 0/21 [00:00<?, ?it/s]
Fetching 21 files: 100%|██████████| 21/21 [00:00<00:00, 7776.14it/s] |
|
Fetching 21 files: 100%|██████████| 21/21 [00:00<00:00, 8587.34it/s] |
|
You are attempting to use Flash Attention 2.0 with a model not initialized on GPU. Make sure to move the model to GPU after initializing it on CPU with `model.to('cuda')`. |
|
Fetching 21 files: 0%| | 0/21 [00:00<?, ?it/s]
Fetching 21 files: 100%|██████████| 21/21 [00:00<00:00, 8169.96it/s] |
|
Fetching 21 files: 0%| | 0/21 [00:00<?, ?it/s]
Fetching 21 files: 100%|██████████| 21/21 [00:00<00:00, 6560.92it/s] |
|
Fetching 21 files: 0%| | 0/21 [00:00<?, ?it/s]
Fetching 21 files: 100%|██████████| 21/21 [00:00<00:00, 8751.16it/s] |
|
You are attempting to use Flash Attention 2.0 with a model not initialized on GPU. Make sure to move the model to GPU after initializing it on CPU with `model.to('cuda')`. |
|
You are attempting to use Flash Attention 2.0 with a model not initialized on GPU. Make sure to move the model to GPU after initializing it on CPU with `model.to('cuda')`. |
|
Fetching 21 files: 0%| | 0/21 [00:00<?, ?it/s]
Fetching 21 files: 100%|██████████| 21/21 [00:00<00:00, 7769.28it/s] |
|
You are attempting to use Flash Attention 2.0 with a model not initialized on GPU. Make sure to move the model to GPU after initializing it on CPU with `model.to('cuda')`. |
|
Fetching 21 files: 0%| | 0/21 [00:00<?, ?it/s]
Fetching 21 files: 100%|██████████| 21/21 [00:00<00:00, 8635.33it/s] |
|
Fetching 21 files: 0%| | 0/21 [00:00<?, ?it/s]
Fetching 21 files: 0%| | 0/21 [00:00<?, ?it/s]
Fetching 21 files: 100%|██████████| 21/21 [00:00<00:00, 7282.98it/s] |
|
Fetching 21 files: 100%|██████████| 21/21 [00:00<00:00, 7373.21it/s] |
|
You are attempting to use Flash Attention 2.0 with a model not initialized on GPU. Make sure to move the model to GPU after initializing it on CPU with `model.to('cuda')`. |
|
You are attempting to use Flash Attention 2.0 with a model not initialized on GPU. Make sure to move the model to GPU after initializing it on CPU with `model.to('cuda')`. |
|
You are attempting to use Flash Attention 2.0 with a model not initialized on GPU. Make sure to move the model to GPU after initializing it on CPU with `model.to('cuda')`. |
|
You are attempting to use Flash Attention 2.0 with a model not initialized on GPU. Make sure to move the model to GPU after initializing it on CPU with `model.to('cuda')`. |
|
You are attempting to use Flash Attention 2.0 with a model not initialized on GPU. Make sure to move the model to GPU after initializing it on CPU with `model.to('cuda')`. |
|
You are attempting to use Flash Attention 2.0 with a model not initialized on GPU. Make sure to move the model to GPU after initializing it on CPU with `model.to('cuda')`. |
|
Fetching 21 files: 0%| | 0/21 [00:00<?, ?it/s]
Fetching 21 files: 100%|██████████| 21/21 [00:00<00:00, 7300.49it/s] |
|
Fetching 21 files: 0%| | 0/21 [00:00<?, ?it/s]
Fetching 21 files: 100%|██████████| 21/21 [00:00<00:00, 7986.98it/s] |
|
Fetching 21 files: 0%| | 0/21 [00:00<?, ?it/s]
Fetching 21 files: 100%|██████████| 21/21 [00:00<00:00, 7525.67it/s] |
|
You are attempting to use Flash Attention 2.0 with a model not initialized on GPU. Make sure to move the model to GPU after initializing it on CPU with `model.to('cuda')`. |
|
Fetching 21 files: 0%| | 0/21 [00:00<?, ?it/s]
Fetching 21 files: 100%|██████████| 21/21 [00:00<00:00, 8337.79it/s] |
|
Fetching 21 files: 0%| | 0/21 [00:00<?, ?it/s]
Fetching 21 files: 100%|██████████| 21/21 [00:00<00:00, 7758.34it/s] |
|
You are attempting to use Flash Attention 2.0 with a model not initialized on GPU. Make sure to move the model to GPU after initializing it on CPU with `model.to('cuda')`. |
|
Fetching 21 files: 0%| | 0/21 [00:00<?, ?it/s]
Fetching 21 files: 100%|██████████| 21/21 [00:00<00:00, 9697.28it/s] |
|
Fetching 21 files: 0%| | 0/21 [00:00<?, ?it/s]
Fetching 21 files: 100%|██████████| 21/21 [00:00<00:00, 9143.61it/s] |
|
You are attempting to use Flash Attention 2.0 with a model not initialized on GPU. Make sure to move the model to GPU after initializing it on CPU with `model.to('cuda')`. |
|
Fetching 21 files: 0%| | 0/21 [00:00<?, ?it/s]
Fetching 21 files: 100%|██████████| 21/21 [00:00<00:00, 9180.78it/s] |
|
You are attempting to use Flash Attention 2.0 with a model not initialized on GPU. Make sure to move the model to GPU after initializing it on CPU with `model.to('cuda')`. |
|
You are attempting to use Flash Attention 2.0 with a model not initialized on GPU. Make sure to move the model to GPU after initializing it on CPU with `model.to('cuda')`. |
|
You are attempting to use Flash Attention 2.0 with a model not initialized on GPU. Make sure to move the model to GPU after initializing it on CPU with `model.to('cuda')`. |
|
You are attempting to use Flash Attention 2.0 with a model not initialized on GPU. Make sure to move the model to GPU after initializing it on CPU with `model.to('cuda')`. |
|
You are attempting to use Flash Attention 2.0 with a model not initialized on GPU. Make sure to move the model to GPU after initializing it on CPU with `model.to('cuda')`. |
|
Fetching 21 files: 0%| | 0/21 [00:00<?, ?it/s]
Fetching 21 files: 100%|██████████| 21/21 [00:00<00:00, 9449.67it/s] |
|
Fetching 21 files: 0%| | 0/21 [00:00<?, ?it/s]
Fetching 21 files: 100%|██████████| 21/21 [00:00<00:00, 9089.82it/s] |
|
Fetching 21 files: 0%| | 0/21 [00:00<?, ?it/s]
Fetching 21 files: 100%|██████████| 21/21 [00:00<00:00, 9047.81it/s] |
|
Fetching 21 files: 0%| | 0/21 [00:00<?, ?it/s]
Fetching 21 files: 100%|██████████| 21/21 [00:00<00:00, 8300.07it/s] |
|
You are attempting to use Flash Attention 2.0 with a model not initialized on GPU. Make sure to move the model to GPU after initializing it on CPU with `model.to('cuda')`. |
|
Fetching 21 files: 0%| | 0/21 [00:00<?, ?it/s]
Fetching 21 files: 100%|██████████| 21/21 [00:00<00:00, 7414.80it/s] |
|
You are attempting to use Flash Attention 2.0 with a model not initialized on GPU. Make sure to move the model to GPU after initializing it on CPU with `model.to('cuda')`. |
|
Fetching 21 files: 0%| | 0/21 [00:00<?, ?it/s]
Fetching 21 files: 100%|██████████| 21/21 [00:00<00:00, 6791.09it/s] |
|
You are attempting to use Flash Attention 2.0 with a model not initialized on GPU. Make sure to move the model to GPU after initializing it on CPU with `model.to('cuda')`. |
|
Fetching 21 files: 0%| | 0/21 [00:00<?, ?it/s]
Fetching 21 files: 100%|██████████| 21/21 [00:00<00:00, 10917.25it/s] |
|
You are attempting to use Flash Attention 2.0 with a model not initialized on GPU. Make sure to move the model to GPU after initializing it on CPU with `model.to('cuda')`. |
|
You are attempting to use Flash Attention 2.0 with a model not initialized on GPU. Make sure to move the model to GPU after initializing it on CPU with `model.to('cuda')`. |
|
Fetching 21 files: 0%| | 0/21 [00:00<?, ?it/s]
Fetching 21 files: 100%|██████████| 21/21 [00:00<00:00, 8569.80it/s] |
|
You are attempting to use Flash Attention 2.0 with a model not initialized on GPU. Make sure to move the model to GPU after initializing it on CPU with `model.to('cuda')`. |
|
You are attempting to use Flash Attention 2.0 with a model not initialized on GPU. Make sure to move the model to GPU after initializing it on CPU with `model.to('cuda')`. |
|
You are attempting to use Flash Attention 2.0 with a model not initialized on GPU. Make sure to move the model to GPU after initializing it on CPU with `model.to('cuda')`. |
|
Fetching 21 files: 0%| | 0/21 [00:00<?, ?it/s]
Fetching 21 files: 100%|██████████| 21/21 [00:00<00:00, 7533.39it/s] |
|
Fetching 21 files: 0%| | 0/21 [00:00<?, ?it/s]
Fetching 21 files: 100%|██████████| 21/21 [00:00<00:00, 8711.34it/s] |
|
Fetching 21 files: 0%| | 0/21 [00:00<?, ?it/s]
Fetching 21 files: 100%|██████████| 21/21 [00:00<00:00, 7913.07it/s] |
|
You are attempting to use Flash Attention 2.0 with a model not initialized on GPU. Make sure to move the model to GPU after initializing it on CPU with `model.to('cuda')`. |
|
You are attempting to use Flash Attention 2.0 with a model not initialized on GPU. Make sure to move the model to GPU after initializing it on CPU with `model.to('cuda')`. |
|
Fetching 21 files: 0%| | 0/21 [00:00<?, ?it/s]
Fetching 21 files: 100%|██████████| 21/21 [00:00<00:00, 7706.74it/s] |
|
Fetching 21 files: 0%| | 0/21 [00:00<?, ?it/s]
Fetching 21 files: 100%|██████████| 21/21 [00:00<00:00, 6005.75it/s] |
|
You are attempting to use Flash Attention 2.0 with a model not initialized on GPU. Make sure to move the model to GPU after initializing it on CPU with `model.to('cuda')`. |
|
Fetching 21 files: 0%| | 0/21 [00:00<?, ?it/s]
Fetching 21 files: 100%|██████████| 21/21 [00:00<00:00, 7406.69it/s] |
|
Fetching 21 files: 0%| | 0/21 [00:00<?, ?it/s]
Fetching 21 files: 0%| | 0/21 [00:00<?, ?it/s]
Fetching 21 files: 100%|██████████| 21/21 [00:00<00:00, 6377.09it/s] |
|
Fetching 21 files: 0%| | 0/21 [00:00<?, ?it/s]
Fetching 21 files: 100%|██████████| 21/21 [00:00<00:00, 8272.01it/s] |
|
Fetching 21 files: 100%|██████████| 21/21 [00:00<00:00, 9155.97it/s] |
|
You are attempting to use Flash Attention 2.0 with a model not initialized on GPU. Make sure to move the model to GPU after initializing it on CPU with `model.to('cuda')`. |
|
Fetching 21 files: 0%| | 0/21 [00:00<?, ?it/s]
Fetching 21 files: 100%|██████████| 21/21 [00:00<00:00, 7316.86it/s] |
|
Fetching 21 files: 0%| | 0/21 [00:00<?, ?it/s]
Fetching 21 files: 100%|██████████| 21/21 [00:00<00:00, 6623.58it/s] |
|
You are attempting to use Flash Attention 2.0 with a model not initialized on GPU. Make sure to move the model to GPU after initializing it on CPU with `model.to('cuda')`. |
|
You are attempting to use Flash Attention 2.0 with a model not initialized on GPU. Make sure to move the model to GPU after initializing it on CPU with `model.to('cuda')`. |
|
You are attempting to use Flash Attention 2.0 with a model not initialized on GPU. Make sure to move the model to GPU after initializing it on CPU with `model.to('cuda')`. |
|
You are attempting to use Flash Attention 2.0 with a model not initialized on GPU. Make sure to move the model to GPU after initializing it on CPU with `model.to('cuda')`. |
|
You are attempting to use Flash Attention 2.0 with a model not initialized on GPU. Make sure to move the model to GPU after initializing it on CPU with `model.to('cuda')`. |
|
You are attempting to use Flash Attention 2.0 with a model not initialized on GPU. Make sure to move the model to GPU after initializing it on CPU with `model.to('cuda')`. |
|
You are attempting to use Flash Attention 2.0 with a model not initialized on GPU. Make sure to move the model to GPU after initializing it on CPU with `model.to('cuda')`. |
|
Fetching 21 files: 0%| | 0/21 [00:00<?, ?it/s]
Fetching 21 files: 100%|██████████| 21/21 [00:00<00:00, 8549.83it/s] |
|
You are attempting to use Flash Attention 2.0 with a model not initialized on GPU. Make sure to move the model to GPU after initializing it on CPU with `model.to('cuda')`. |
|
Fetching 21 files: 0%| | 0/21 [00:00<?, ?it/s]
Fetching 21 files: 100%|██████████| 21/21 [00:00<00:00, 7040.24it/s] |
|
You are attempting to use Flash Attention 2.0 with a model not initialized on GPU. Make sure to move the model to GPU after initializing it on CPU with `model.to('cuda')`. |
|
Loading checkpoint shards: 0%| | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards: 0%| | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards: 0%| | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards: 0%| | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards: 0%| | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards: 0%| | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards: 0%| | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards: 0%| | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards: 25%|██▌ | 1/4 [00:02<00:06, 2.25s/it]
Loading checkpoint shards: 25%|██▌ | 1/4 [00:02<00:06, 2.26s/it]
Loading checkpoint shards: 25%|██▌ | 1/4 [00:02<00:06, 2.25s/it]
Loading checkpoint shards: 25%|██▌ | 1/4 [00:02<00:06, 2.26s/it]
Loading checkpoint shards: 25%|██▌ | 1/4 [00:02<00:06, 2.25s/it]
Loading checkpoint shards: 25%|██▌ | 1/4 [00:02<00:06, 2.25s/it]
Loading checkpoint shards: 2
Loading checkpoint shards: 0%| | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards: 0%| | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards: 0%| | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards: 0%| | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards: 0%| | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards: 0%| | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards: 0%| | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards: 0%| | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards: 25%|██▌ | 1/4 [00:02<00:06, 2.16s/it]
Loading checkpoint shards: 25%|██▌ | 1/4 [00:02<00:06, 2.20s/it]
Loading checkpoint shards: 25%|██▌ | 1/4 [00:02<00:06, 2.20s/it]
Loading checkpoint shards: 25%|██▌ | 1/4 [00:02<00:06, 2.16s/it]
Loading checkpoint shards: 25%|██▌ | 1/4 [00:02<00:06, 2.20s/it]
Loading checkpoint shards: 25%|██▌ | 1/4 [00:02<00:06, 2.20s/it]
Loading checkpoint shards: 2
Loading checkpoint shards: 0%| | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards: 0%| | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards: 0%| | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards: 0%| | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards: 0%| | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards: 0%| | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards: 0%| | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards: 0%| | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards: 25%|██▌ | 1/4 [00:02<00:06, 2.25s/it]
Loading checkpoint shards: 25%|██▌ | 1/4 [00:02<00:06, 2.25s/it]
Loading checkpoint shards: 25%|██▌ | 1/4 [00:02<00:06, 2.24s/it]
Loading checkpoint shards: 25%|██▌ | 1/4 [00:02<00:06, 2.24s/it]
Loading checkpoint shards: 25%|██▌ | 1/4 [00:02<00:06, 2.25s/it]
Loading checkpoint shards: 25%|██▌ | 1/4 [00:02<00:06, 2.25s/it]
Loading checkpoint shards: 2
Loading checkpoint shards: 0%| | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards: 0%| | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards: 0%| | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards: 0%| | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards: 0%| | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards: 0%| | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards: 0%| | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards: 0%| | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards: 25%|██▌ | 1/4 [00:02<00:06, 2.26s/it]
Loading checkpoint shards: 25%|██▌ | 1/4 [00:02<00:06, 2.26s/it]
Loading checkpoint shards: 25%|██▌ | 1/4 [00:02<00:06, 2.25s/it]
Loading checkpoint shards: 25%|██▌ | 1/4 [00:02<00:06, 2.26s/it]
Loading checkpoint shards: 25%|██▌ | 1/4 [00:02<00:06, 2.25s/it]
Loading checkpoint shards: 25%|██▌ | 1/4 [00:02<00:06, 2.26s/it]
Loading checkpoint shards: 2
Loading checkpoint shards: 0%| | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards: 0%| | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards: 0%| | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards: 0%| | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards: 0%| | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards: 0%| | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards: 0%| | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards: 0%| | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards: 25%|██▌ | 1/4 [00:02<00:06, 2.25s/it]
Loading checkpoint shards: 25%|██▌ | 1/4 [00:02<00:06, 2.24s/it]
Loading checkpoint shards: 25%|██▌ | 1/4 [00:02<00:06, 2.24s/it]
Loading checkpoint shards: 25%|██▌ | 1/4 [00:02<00:06, 2.25s/it]
Loading checkpoint shards: 25%|██▌ | 1/4 [00:02<00:06, 2.24s/it]
Loading checkpoint shards: 25%|██▌ | 1/4 [00:02<00:06, 2.26s/it]
Loading checkpoint shards: 2
Loading checkpoint shards: 0%| | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards: 0%| | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards: 0%| | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards: 0%| | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards: 0%| | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards: 0%| | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards: 0%| | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards: 0%| | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards: 25%|██▌ | 1/4 [00:02<00:06, 2.22s/it]
Loading checkpoint shards: 25%|██▌ | 1/4 [00:02<00:06, 2.22s/it]
Loading checkpoint shards: 25%|██▌ | 1/4 [00:02<00:06, 2.26s/it]
Loading checkpoint shards: 25%|██▌ | 1/4 [00:02<00:06, 2.26s/it]
Loading checkpoint shards: 25%|██▌ | 1/4 [00:02<00:06, 2.25s/it]
Loading checkpoint shards: 25%|██▌ | 1/4 [00:02<00:06, 2.28s/it]
Loading checkpoint shards: 2
Loading checkpoint shards: 0%| | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards: 0%| | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards: 0%| | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards: 0%| | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards: 0%| | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards: 0%| | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards: 0%| | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards: 0%| | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards: 25%|██▌ | 1/4 [00:02<00:06, 2.23s/it]
Loading checkpoint shards: 25%|██▌ | 1/4 [00:02<00:06, 2.26s/it]
Loading checkpoint shards: 25%|██▌ | 1/4 [00:02<00:06, 2.27s/it]
Loading checkpoint shards: 25%|██▌ | 1/4 [00:02<00:06, 2.27s/it]
Loading checkpoint shards: 25%|██▌ | 1/4 [00:02<00:06, 2.26s/it]
Loading checkpoint shards: 25%|██▌ | 1/4 [00:02<00:06, 2.27s/it]
Loading checkpoint shards: 2
Loading checkpoint shards: 0%| | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards: 0%| | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards: 0%| | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards: 0%| | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards: 0%| | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards: 0%| | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards: 0%| | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards: 0%| | 0/4 [00:00<?, ?it/s]
Loading checkpoint shards: 25%|██▌ | 1/4 [00:02<00:06, 2.28s/it]
Loading checkpoint shards: 25%|██▌ | 1/4 [00:02<00:07, 2.35s/it]
Loading checkpoint shards: 25%|██▌ | 1/4 [00:02<00:07, 2.35s/it]
Loading checkpoint shards: 25%|██▌ | 1/4 [00:02<00:07, 2.34s/it]
Loading checkpoint shards: 25%|██▌ | 1/4 [00:02<00:07, 2.34s/it]
Loading checkpoint shards: 25%|██▌ | 1/4 [00:02<00:07, 2.35s/it]
Loading checkpoint shards: 25%|██▌ | 1/4 [00:02<00:06, 2.25s/it]
Loading checkpoint shards: 25%|██▌ | 1/4 [00:02<00:06, 2.26s/it]
Loading checkpoint shards: 50%|█████ | 2/4 [00:04<00:04, 2.21s/it]
Loading checkpoint shards: 50%|█████ | 2/4 [00:04<00:04, 2.23s/it]
Loading checkpoint shards: 50%|█████ | 2/4 [00:04<00:04, 2.23s/it]
Loading checkpoint shards: 50%|█████ | 2/4 [00:04<00:04, 2.23s/it]
Loading checkpoint shards: 50%|█████ | 2/4 [00:04<00:04, 2.23s/it]
Loading checkpoint shards: 50%|█████ | 2/4 [00:04<00:04, 2.23s/it]
Loading checkpoint shards: 50%|█████ | 2/4 [00:04<00:04, 2.23s/it]
Loading checkpoint shards: 50%|█████ | 2/4 [00:04<00:04, 2.26s/it]
Loading checkpoint shards: 75%|███████▌ | 3/4 [00:06<00:02, 2.08s/it]
Loading checkpoint shards: 75%|███████▌ | 3/4 [00:06<00:02, 2.11s/it]
Loading checkpoint shards: 75%|███████5%|██▌ | 1/4 [00:02<00:06, 2.21s/it]
Loading checkpoint shards: 25%|██▌ | 1/4 [00:02<00:06, 2.25s/it]
Loading checkpoint shards: 50%|█████ | 2/4 [00:04<00:04, 2.18s/it]
Loading checkpoint shards: 50%|█████ | 2/4 [00:04<00:04, 2.19s/it]
Loading checkpoint shards: 50%|█████ | 2/4 [00:04<00:04, 2.21s/it]
Loading checkpoint shards: 50%|█████ | 2/4 [00:04<00:04, 2.21s/it]
Loading checkpoint shards: 50%|█████ | 2/4 [00:04<00:04, 2.21s/it]
Loading checkpoint shards: 50%|█████ | 2/4 [00:04<00:04, 2.21s/it]
Loading checkpoint shards: 50%|█████ | 2/4 [00:04<00:04, 2.22s/it]
Loading checkpoint shards: 50%|█████ | 2/4 [00:04<00:04, 2.22s/it]
Loading checkpoint shards: 75%|███████▌ | 3/4 [00:06<00:02, 2.06s/it]
Loading checkpoint shards: 75%|███████▌ | 3/4 [00:06<00:02, 2.09s/it]
Loading checkpoint shards: 75%|███████5%|██▌ | 1/4 [00:02<00:06, 2.30s/it]
Loading checkpoint shards: 25%|██▌ | 1/4 [00:02<00:06, 2.30s/it]
Loading checkpoint shards: 50%|█████ | 2/4 [00:04<00:04, 2.23s/it]
Loading checkpoint shards: 50%|█████ | 2/4 [00:04<00:04, 2.23s/it]
Loading checkpoint shards: 50%|█████ | 2/4 [00:04<00:04, 2.23s/it]
Loading checkpoint shards: 50%|█████ | 2/4 [00:04<00:04, 2.23s/it]
Loading checkpoint shards: 50%|█████ | 2/4 [00:04<00:04, 2.22s/it]
Loading checkpoint shards: 50%|█████ | 2/4 [00:04<00:04, 2.23s/it]
Loading checkpoint shards: 50%|█████ | 2/4 [00:04<00:04, 2.23s/it]
Loading checkpoint shards: 50%|█████ | 2/4 [00:04<00:04, 2.23s/it]
Loading checkpoint shards: 75%|███████▌ | 3/4 [00:06<00:02, 2.10s/it]
Loading checkpoint shards: 75%|███████▌ | 3/4 [00:06<00:02, 2.10s/it]
Loading checkpoint shards: 75%|███████5%|██▌ | 1/4 [00:02<00:06, 2.30s/it]
Loading checkpoint shards: 25%|██▌ | 1/4 [00:02<00:06, 2.31s/it]
Loading checkpoint shards: 50%|█████ | 2/4 [00:04<00:04, 2.23s/it]
Loading checkpoint shards: 50%|█████ | 2/4 [00:04<00:04, 2.23s/it]
Loading checkpoint shards: 50%|█████ | 2/4 [00:04<00:04, 2.23s/it]
Loading checkpoint shards: 50%|█████ | 2/4 [00:04<00:04, 2.23s/it]
Loading checkpoint shards: 50%|█████ | 2/4 [00:04<00:04, 2.23s/it]
Loading checkpoint shards: 50%|█████ | 2/4 [00:04<00:04, 2.23s/it]
Loading checkpoint shards: 50%|█████ | 2/4 [00:04<00:04, 2.23s/it]
Loading checkpoint shards: 50%|█████ | 2/4 [00:04<00:04, 2.23s/it]
Loading checkpoint shards: 75%|███████▌ | 3/4 [00:06<00:02, 2.11s/it]
Loading checkpoint shards: 75%|███████▌ | 3/4 [00:06<00:02, 2.11s/it]
Loading checkpoint shards: 75%|███████5%|██▌ | 1/4 [00:02<00:06, 2.29s/it]
Loading checkpoint shards: 25%|██▌ | 1/4 [00:02<00:06, 2.29s/it]
Loading checkpoint shards: 50%|█████ | 2/4 [00:04<00:04, 2.23s/it]
Loading checkpoint shards: 50%|█████ | 2/4 [00:04<00:04, 2.23s/it]
Loading checkpoint shards: 50%|█████ | 2/4 [00:04<00:04, 2.23s/it]
Loading checkpoint shards: 50%|█████ | 2/4 [00:04<00:04, 2.23s/it]
Loading checkpoint shards: 50%|█████ | 2/4 [00:04<00:04, 2.23s/it]
Loading checkpoint shards: 50%|█████ | 2/4 [00:04<00:04, 2.23s/it]
Loading checkpoint shards: 50%|█████ | 2/4 [00:04<00:04, 2.23s/it]
Loading checkpoint shards: 50%|█████ | 2/4 [00:04<00:04, 2.23s/it]
Loading checkpoint shards: 75%|███████▌ | 3/4 [00:06<00:02, 2.11s/it]
Loading checkpoint shards: 75%|███████▌ | 3/4 [00:06<00:02, 2.11s/it]
Loading checkpoint shards: 75%|███████5%|██▌ | 1/4 [00:02<00:06, 2.31s/it]
Loading checkpoint shards: 25%|██▌ | 1/4 [00:02<00:07, 2.34s/it]
Loading checkpoint shards: 50%|█████ | 2/4 [00:04<00:04, 2.20s/it]
Loading checkpoint shards: 50%|█████ | 2/4 [00:04<00:04, 2.22s/it]
Loading checkpoint shards: 50%|█████ | 2/4 [00:04<00:04, 2.23s/it]
Loading checkpoint shards: 50%|█████ | 2/4 [00:04<00:04, 2.23s/it]
Loading checkpoint shards: 50%|█████ | 2/4 [00:04<00:04, 2.23s/it]
Loading checkpoint shards: 50%|█████ | 2/4 [00:04<00:04, 2.23s/it]
Loading checkpoint shards: 50%|█████ | 2/4 [00:04<00:04, 2.24s/it]
Loading checkpoint shards: 50%|█████ | 2/4 [00:04<00:04, 2.26s/it]
Loading checkpoint shards: 75%|███████▌ | 3/4 [00:06<00:02, 2.08s/it]
Loading checkpoint shards: 75%|███████▌ | 3/4 [00:06<00:02, 2.10s/it]
Loading checkpoint shards: 75%|███████5%|██▌ | 1/4 [00:02<00:06, 2.28s/it]
Loading checkpoint shards: 25%|██▌ | 1/4 [00:02<00:07, 2.42s/it]
Loading checkpoint shards: 50%|█████ | 2/4 [00:04<00:04, 2.20s/it]
Loading checkpoint shards: 50%|█████ | 2/4 [00:04<00:04, 2.27s/it]
Loading checkpoint shards: 50%|█████ | 2/4 [00:04<00:04, 2.24s/it]
Loading checkpoint shards: 50%|█████ | 2/4 [00:04<00:04, 2.26s/it]
Loading checkpoint shards: 50%|█████ | 2/4 [00:04<00:04, 2.27s/it]
Loading checkpoint shards: 50%|█████ | 2/4 [00:04<00:04, 2.27s/it]
Loading checkpoint shards: 50%|█████ | 2/4 [00:04<00:04, 2.24s/it]
Loading checkpoint shards: 50%|█████ | 2/4 [00:04<00:04, 2.33s/it]
Loading checkpoint shards: 75%|███████▌ | 3/4 [00:06<00:02, 2.07s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.29s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.61s/it] |
|
5%|██▌ | 1/4 [00:02<00:06, 2.27s/it]
Loading checkpoint shards: 25%|██▌ | 1/4 [00:02<00:06, 2.27s/it]
Loading checkpoint shards: 50%|█████ | 2/4 [00:04<00:04, 2.16s/it]
Loading checkpoint shards: 50%|█████ | 2/4 [00:04<00:04, 2.23s/it]
Loading checkpoint shards: 50%|█████ | 2/4 [00:04<00:04, 2.23s/it]
Loading checkpoint shards: 50%|█████ | 2/4 [00:04<00:04, 2.23s/it]
Loading checkpoint shards: 50%|█████ | 2/4 [00:04<00:04, 2.23s/it]
Loading checkpoint shards: 50%|█████ | 2/4 [00:04<00:04, 2.23s/it]
Loading checkpoint shards: 50%|█████ | 2/4 [00:04<00:04, 2.23s/it]
Loading checkpoint shards: 50%|█████ | 2/4 [00:04<00:04, 2.24s/it]
Loading checkpoint shards: 75%|███████▌ | 3/4 [00:06<00:02, 2.06s/it]
Loading checkpoint shards: 75%|███████▌ | 3/4 [00:06<00:02, 2.07s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.29s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.60s/it] |
|
▌ | 3/4 [00:06<00:02, 2.11s/it]
Loading checkpoint shards: 75%|███████▌ | 3/4 [00:06<00:02, 2.11s/it]
Loading checkpoint shards: 75%|███████▌ | 3/4 [00:06<00:02, 2.11s/it]
Loading checkpoint shards: 75%|███████▌ | 3/4 [00:06<00:02, 2.12s/it]
Loading checkpoint shards: 75%|███████▌ | 3/4 [00:06<00:02, 2.11s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.31s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.63s/it] |
|
▌ | 3/4 [00:06<00:02, 2.10s/it]
Loading checkpoint shards: 75%|███████▌ | 3/4 [00:06<00:02, 2.10s/it]
Loading checkpoint shards: 75%|███████▌ | 3/4 [00:06<00:02, 2.11s/it]
Loading checkpoint shards: 75%|███████▌ | 3/4 [00:06<00:02, 2.10s/it]
Loading checkpoint shards: 75%|███████▌ | 3/4 [00:06<00:02, 2.10s/it]
Loading checkpoint shards: 75%|███████▌ | 3/4 [00:06<00:02, 2.14s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.31s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.63s/it] |
|
▌ | 3/4 [00:06<00:02, 2.08s/it]
Loading checkpoint shards: 75%|███████▌ | 3/4 [00:06<00:02, 2.09s/it]
Loading checkpoint shards: 75%|███████▌ | 3/4 [00:06<00:02, 2.09s/it]
Loading checkpoint shards: 75%|███████▌ | 3/4 [00:06<00:02, 2.09s/it]
Loading checkpoint shards: 75%|███████▌ | 3/4 [00:06<00:02, 2.10s/it]
Loading checkpoint shards: 75%|███████▌ | 3/4 [00:06<00:02, 2.13s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.30s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.61s/it] |
|
Loading checkpoint shards: 75%|███████▌ | 3/4 [00:06<00:02, 2.11s/it]
Loading checkpoint shards: 75%|███████▌ | 3/4 [00:06<00:02, 2.10s/it]
Loading checkpoint shards: 75%|███████▌ | 3/4 [00:06<00:02, 2.11s/it]
Loading checkpoint shards: 75%|███████▌ | 3/4 [00:06<00:02, 2.11s/it]
Loading checkpoint shards: 75%|███████▌ | 3/4 [00:06<00:02, 2.11s/it]
Loading checkpoint shards: 75%|███████▌ | 3/4 [00:06<00:02, 2.11s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.31s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.62s/it] |
|
Loading checkpoint shards: 75%|███████▌ | 3/4 [00:06<00:02, 2.13s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.34s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.65s/it] |
|
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.33s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.63s/it] |
|
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.33s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.63s/it] |
|
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.33s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.63s/it] |
|
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.34s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.34s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.65s/it] |
|
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.65s/it] |
|
▌ | 3/4 [00:06<00:02, 2.10s/it]
Loading checkpoint shards: 75%|███████▌ | 3/4 [00:06<00:02, 2.10s/it]
Loading checkpoint shards: 75%|███████▌ | 3/4 [00:06<00:02, 2.10s/it]
Loading checkpoint shards: 75%|███████▌ | 3/4 [00:06<00:02, 2.10s/it]
Loading checkpoint shards: 75%|███████▌ | 3/4 [00:06<00:02, 2.10s/it]
Loading checkpoint shards: 75%|███████▌ | 3/4 [00:06<00:02, 2.10s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.34s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.34s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.65s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.65s/it] |
|
|
|
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.34s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.64s/it] |
|
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.34s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.65s/it] |
|
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.33s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.63s/it] |
|
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.34s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.65s/it] |
|
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.34s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.65s/it] |
|
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.34s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.65s/it] |
|
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.34s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.64s/it] |
|
▌ | 3/4 [00:06<00:02, 2.10s/it]
Loading checkpoint shards: 75%|███████▌ | 3/4 [00:06<00:02, 2.11s/it]
Loading checkpoint shards: 75%|███████▌ | 3/4 [00:06<00:02, 2.11s/it]
Loading checkpoint shards: 75%|███████▌ | 3/4 [00:06<00:02, 2.10s/it]
Loading checkpoint shards: 75%|███████▌ | 3/4 [00:06<00:02, 2.10s/it]
Loading checkpoint shards: 75%|███████▌ | 3/4 [00:06<00:02, 2.10s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.34s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.65s/it] |
|
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.34s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.65s/it] |
|
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.34s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.65s/it] |
|
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.34s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.65s/it] |
|
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.34s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.65s/it] |
|
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.34s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.65s/it] |
|
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.34s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.65s/it] |
|
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.34s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.65s/it] |
|
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.34s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.65s/it] |
|
▌ | 3/4 [00:06<00:02, 2.10s/it]
Loading checkpoint shards: 75%|███████▌ | 3/4 [00:06<00:02, 2.10s/it]
Loading checkpoint shards: 75%|███████▌ | 3/4 [00:06<00:02, 2.10s/it]
Loading checkpoint shards: 75%|███████▌ | 3/4 [00:06<00:02, 2.11s/it]
Loading checkpoint shards: 75%|███████▌ | 3/4 [00:06<00:02, 2.10s/it]
Loading checkpoint shards: 75%|███████▌ | 3/4 [00:06<00:02, 2.10s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.34s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.34s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.65s/it] |
|
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.65s/it] |
|
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.34s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.65s/it] |
|
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.34s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.65s/it] |
|
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.34s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.65s/it] |
|
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.34s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.65s/it] |
|
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.34s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.65s/it] |
|
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.34s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.65s/it] |
|
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.34s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.65s/it] |
|
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.34s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.65s/it] |
|
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.35s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.65s/it] |
|
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.34s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.65s/it] |
|
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.34s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.65s/it] |
|
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.34s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.65s/it] |
|
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.34s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.65s/it] |
|
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.34s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.65s/it] |
|
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.37s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.67s/it] |
|
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.36s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.66s/it] |
|
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.37s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.67s/it] |
|
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.38s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.67s/it] |
|
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.38s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.38s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.67s/it] |
|
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.67s/it] |
|
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.38s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.67s/it] |
|
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.38s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.67s/it] |
|
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.38s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.67s/it] |
|
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.38s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.67s/it] |
|
Loading checkpoint shards: 75%|███████▌ | 3/4 [00:06<00:02, 2.13s/it]
Loading checkpoint shards: 75%|███████▌ | 3/4 [00:06<00:02, 2.11s/it]
Loading checkpoint shards: 75%|███████▌ | 3/4 [00:06<00:02, 2.12s/it]
Loading checkpoint shards: 75%|███████▌ | 3/4 [00:06<00:02, 2.13s/it]
Loading checkpoint shards: 75%|███████▌ | 3/4 [00:06<00:02, 2.13s/it]
Loading checkpoint shards: 75%|███████▌ | 3/4 [00:06<00:02, 2.11s/it]
Loading checkpoint shards: 75%|███████▌ | 3/4 [00:06<00:02, 2.20s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.39s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.38s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.69s/it] |
|
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.68s/it] |
|
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.39s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.69s/it] |
|
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.39s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.69s/it] |
|
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.39s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.69s/it] |
|
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.38s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.68s/it] |
|
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.40s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:06<00:00, 1.70s/it] |
|
Loading checkpoint shards: 100%|██████████| 4/4 [00:07<00:00, 1.57s/it]
Loading checkpoint shards: 100%|██████████| 4/4 [00:07<00:00, 1.83s/it] |
|
The new embeddings will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new embeddings will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new embeddings will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new embeddings will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new embeddings will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new embeddings will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new embeddings will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new embeddings will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new embeddings will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new embeddings will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new embeddings will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new embeddings will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new embeddings will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new embeddings will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new embeddings will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new embeddings will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new embeddings will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new embeddings will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new embeddings will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new embeddings will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new embeddings will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new embeddings will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new embeddings will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new embeddings will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new embeddings will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new embeddings will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new embeddings will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new embeddings will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new embeddings will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new embeddings will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new embeddings will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new embeddings will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new embeddings will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new embeddings will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new embeddings will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new embeddings will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new embeddings will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new embeddings will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new embeddings will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new embeddings will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new embeddings will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new embeddings will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new embeddings will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new embeddings will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new embeddings will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new embeddings will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new embeddings will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new embeddings will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new embeddings will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new embeddings will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new embeddings will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new embeddings will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new embeddings will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new embeddings will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new embeddings will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new embeddings will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new embeddings will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new embeddings will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new embeddings will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new embeddings will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new embeddings will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new embeddings will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new embeddings will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new embeddings will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new lm_head weights will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new lm_head weights will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new lm_head weights will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new lm_head weights will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new lm_head weights will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new lm_head weights will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new lm_head weights will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new lm_head weights will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new lm_head weights will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new lm_head weights will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new lm_head weights will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new lm_head weights will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new lm_head weights will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new lm_head weights will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new lm_head weights will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new lm_head weights will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new lm_head weights will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new lm_head weights will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new lm_head weights will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new lm_head weights will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new lm_head weights will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new lm_head weights will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new lm_head weights will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new lm_head weights will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new lm_head weights will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new lm_head weights will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new lm_head weights will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new lm_head weights will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new lm_head weights will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new lm_head weights will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new lm_head weights will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new lm_head weights will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new lm_head weights will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new lm_head weights will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new lm_head weights will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new lm_head weights will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new lm_head weights will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new lm_head weights will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new lm_head weights will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new lm_head weights will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new lm_head weights will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new lm_head weights will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new lm_head weights will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new lm_head weights will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new lm_head weights will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new lm_head weights will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new lm_head weights will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new lm_head weights will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new lm_head weights will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new lm_head weights will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new lm_head weights will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new lm_head weights will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new lm_head weights will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new lm_head weights will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new lm_head weights will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new lm_head weights will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new lm_head weights will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new lm_head weights will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new lm_head weights will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new lm_head weights will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new lm_head weights will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new lm_head weights will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new lm_head weights will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
The new lm_head weights will be initialized from a multivariate normal distribution that has old embeddings' mean and covariance. As described in this article: https://nlp.stanford.edu/~johnhew/vocab-expansion.html. To disable this, use `mean_resizing=False` |
|
2025-07-01 08:57:05.101 | WARNING | llava.data.builder:build_dataset:92 - Training VILA with mixture 'vila_quantumn_qa_train'. |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/train/llava_trainer.py:592: FutureWarning: `tokenizer` is deprecated and will be removed in version 5.0.0 for `LLaVATrainer.__init__`. Use `processing_class` instead. |
|
super().__init__(*args, **kwargs) |
|
2025-07-01 08:57:05.157 | WARNING | llava.data.builder:build_dataset:92 - Training VILA with mixture 'vila_quantumn_qa_train'. |
|
2025-07-01 08:57:05.172 | WARNING | llava.data.builder:build_dataset:92 - Training VILA with mixture 'vila_quantumn_qa_train'. |
|
2025-07-01 08:57:05.183 | WARNING | llava.data.builder:build_dataset:92 - Training VILA with mixture 'vila_quantumn_qa_train'. |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/train/llava_trainer.py:592: FutureWarning: `tokenizer` is deprecated and will be removed in version 5.0.0 for `LLaVATrainer.__init__`. Use `processing_class` instead. |
|
super().__init__(*args, **kwargs) |
|
2025-07-01 08:57:05.198 | WARNING | llava.data.builder:build_dataset:92 - Training VILA with mixture 'vila_quantumn_qa_train'. |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/train/llava_trainer.py:592: FutureWarning: `tokenizer` is deprecated and will be removed in version 5.0.0 for `LLaVATrainer.__init__`. Use `processing_class` instead. |
|
super().__init__(*args, **kwargs) |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/train/llava_trainer.py:592: FutureWarning: `tokenizer` is deprecated and will be removed in version 5.0.0 for `LLaVATrainer.__init__`. Use `processing_class` instead. |
|
super().__init__(*args, **kwargs) |
|
2025-07-01 08:57:05.219 | WARNING | llava.data.builder:build_dataset:92 - Training VILA with mixture 'vila_quantumn_qa_train'. |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/train/llava_trainer.py:592: FutureWarning: `tokenizer` is deprecated and will be removed in version 5.0.0 for `LLaVATrainer.__init__`. Use `processing_class` instead. |
|
super().__init__(*args, **kwargs) |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/train/llava_trainer.py:592: FutureWarning: `tokenizer` is deprecated and will be removed in version 5.0.0 for `LLaVATrainer.__init__`. Use `processing_class` instead. |
|
super().__init__(*args, **kwargs) |
|
2025-07-01 08:57:05.303 | WARNING | llava.data.builder:build_dataset:92 - Training VILA with mixture 'vila_quantumn_qa_train'. |
|
2025-07-01 08:57:05.316 | WARNING | llava.data.builder:build_dataset:92 - Training VILA with mixture 'vila_quantumn_qa_train'. |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/train/llava_trainer.py:592: FutureWarning: `tokenizer` is deprecated and will be removed in version 5.0.0 for `LLaVATrainer.__init__`. Use `processing_class` instead. |
|
super().__init__(*args, **kwargs) |
|
2025-07-01 08:57:05.345 | WARNING | llava.data.builder:build_dataset:92 - Training VILA with mixture 'vila_quantumn_qa_train'. |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/train/llava_trainer.py:592: FutureWarning: `tokenizer` is deprecated and will be removed in version 5.0.0 for `LLaVATrainer.__init__`. Use `processing_class` instead. |
|
super().__init__(*args, **kwargs) |
|
2025-07-01 08:57:05.350 | WARNING | llava.data.builder:build_dataset:92 - Training VILA with mixture 'vila_quantumn_qa_train'. |
|
2025-07-01 08:57:05.353 | WARNING | llava.data.builder:build_dataset:92 - Training VILA with mixture 'vila_quantumn_qa_train'. |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/train/llava_trainer.py:592: FutureWarning: `tokenizer` is deprecated and will be removed in version 5.0.0 for `LLaVATrainer.__init__`. Use `processing_class` instead. |
|
super().__init__(*args, **kwargs) |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/train/llava_trainer.py:592: FutureWarning: `tokenizer` is deprecated and will be removed in version 5.0.0 for `LLaVATrainer.__init__`. Use `processing_class` instead. |
|
super().__init__(*args, **kwargs) |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/train/llava_trainer.py:592: FutureWarning: `tokenizer` is deprecated and will be removed in version 5.0.0 for `LLaVATrainer.__init__`. Use `processing_class` instead. |
|
super().__init__(*args, **kwargs) |
|
2025-07-01 08:57:05.396 | WARNING | llava.data.builder:build_dataset:92 - Training VILA with mixture 'vila_quantumn_qa_train'. |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/train/llava_trainer.py:592: FutureWarning: `tokenizer` is deprecated and will be removed in version 5.0.0 for `LLaVATrainer.__init__`. Use `processing_class` instead. |
|
super().__init__(*args, **kwargs) |
|
2025-07-01 08:57:05.442 | WARNING | llava.data.builder:build_dataset:92 - Training VILA with mixture 'vila_quantumn_qa_train'. |
|
2025-07-01 08:57:05.450 | WARNING | llava.data.builder:build_dataset:92 - Training VILA with mixture 'vila_quantumn_qa_train'. |
|
2025-07-01 08:57:05.464 | WARNING | llava.data.builder:build_dataset:92 - Training VILA with mixture 'vila_quantumn_qa_train'. |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/train/llava_trainer.py:592: FutureWarning: `tokenizer` is deprecated and will be removed in version 5.0.0 for `LLaVATrainer.__init__`. Use `processing_class` instead. |
|
super().__init__(*args, **kwargs) |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/train/llava_trainer.py:592: FutureWarning: `tokenizer` is deprecated and will be removed in version 5.0.0 for `LLaVATrainer.__init__`. Use `processing_class` instead. |
|
super().__init__(*args, **kwargs) |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/train/llava_trainer.py:592: FutureWarning: `tokenizer` is deprecated and will be removed in version 5.0.0 for `LLaVATrainer.__init__`. Use `processing_class` instead. |
|
super().__init__(*args, **kwargs) |
|
2025-07-01 08:57:05.503 | WARNING | llava.data.builder:build_dataset:92 - Training VILA with mixture 'vila_quantumn_qa_train'. |
|
2025-07-01 08:57:05.526 | WARNING | llava.data.builder:build_dataset:92 - Training VILA with mixture 'vila_quantumn_qa_train'. |
|
2025-07-01 08:57:05.530 | WARNING | llava.data.builder:build_dataset:92 - Training VILA with mixture 'vila_quantumn_qa_train'. |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/train/llava_trainer.py:592: FutureWarning: `tokenizer` is deprecated and will be removed in version 5.0.0 for `LLaVATrainer.__init__`. Use `processing_class` instead. |
|
super().__init__(*args, **kwargs) |
|
2025-07-01 08:57:05.537 | WARNING | llava.data.builder:build_dataset:92 - Training VILA with mixture 'vila_quantumn_qa_train'. |
|
2025-07-01 08:57:05.537 | WARNING | llava.data.builder:build_dataset:92 - Training VILA with mixture 'vila_quantumn_qa_train'. |
|
2025-07-01 08:57:05.539 | WARNING | llava.data.builder:build_dataset:92 - Training VILA with mixture 'vila_quantumn_qa_train'. |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/train/llava_trainer.py:592: FutureWarning: `tokenizer` is deprecated and will be removed in version 5.0.0 for `LLaVATrainer.__init__`. Use `processing_class` instead. |
|
super().__init__(*args, **kwargs) |
|
2025-07-01 08:57:05.555 | WARNING | llava.data.builder:build_dataset:92 - Training VILA with mixture 'vila_quantumn_qa_train'. |
|
2025-07-01 08:57:05.557 | WARNING | llava.data.builder:build_dataset:92 - Training VILA with mixture 'vila_quantumn_qa_train'. |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/train/llava_trainer.py:592: FutureWarning: `tokenizer` is deprecated and will be removed in version 5.0.0 for `LLaVATrainer.__init__`. Use `processing_class` instead. |
|
super().__init__(*args, **kwargs) |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/train/llava_trainer.py:592: FutureWarning: `tokenizer` is deprecated and will be removed in version 5.0.0 for `LLaVATrainer.__init__`. Use `processing_class` instead. |
|
super().__init__(*args, **kwargs) |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/train/llava_trainer.py:592: FutureWarning: `tokenizer` is deprecated and will be removed in version 5.0.0 for `LLaVATrainer.__init__`. Use `processing_class` instead. |
|
super().__init__(*args, **kwargs) |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/train/llava_trainer.py:592: FutureWarning: `tokenizer` is deprecated and will be removed in version 5.0.0 for `LLaVATrainer.__init__`. Use `processing_class` instead. |
|
super().__init__(*args, **kwargs) |
|
2025-07-01 08:57:05.572 | WARNING | llava.data.builder:build_dataset:92 - Training VILA with mixture 'vila_quantumn_qa_train'. |
|
2025-07-01 08:57:05.574 | WARNING | llava.data.builder:build_dataset:92 - Training VILA with mixture 'vila_quantumn_qa_train'. |
|
2025-07-01 08:57:05.579 | WARNING | llava.data.builder:build_dataset:92 - Training VILA with mixture 'vila_quantumn_qa_train'. |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/train/llava_trainer.py:592: FutureWarning: `tokenizer` is deprecated and will be removed in version 5.0.0 for `LLaVATrainer.__init__`. Use `processing_class` instead. |
|
super().__init__(*args, **kwargs) |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/train/llava_trainer.py:592: FutureWarning: `tokenizer` is deprecated and will be removed in version 5.0.0 for `LLaVATrainer.__init__`. Use `processing_class` instead. |
|
super().__init__(*args, **kwargs) |
|
2025-07-01 08:57:05.596 | WARNING | llava.data.builder:build_dataset:92 - Training VILA with mixture 'vila_quantumn_qa_train'. |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/train/llava_trainer.py:592: FutureWarning: `tokenizer` is deprecated and will be removed in version 5.0.0 for `LLaVATrainer.__init__`. Use `processing_class` instead. |
|
super().__init__(*args, **kwargs) |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/train/llava_trainer.py:592: FutureWarning: `tokenizer` is deprecated and will be removed in version 5.0.0 for `LLaVATrainer.__init__`. Use `processing_class` instead. |
|
super().__init__(*args, **kwargs) |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/train/llava_trainer.py:592: FutureWarning: `tokenizer` is deprecated and will be removed in version 5.0.0 for `LLaVATrainer.__init__`. Use `processing_class` instead. |
|
super().__init__(*args, **kwargs) |
|
2025-07-01 08:57:05.610 | WARNING | llava.data.builder:build_dataset:92 - Training VILA with mixture 'vila_quantumn_qa_train'. |
|
2025-07-01 08:57:05.613 | WARNING | llava.data.builder:build_dataset:92 - Training VILA with mixture 'vila_quantumn_qa_train'. |
|
2025-07-01 08:57:05.618 | WARNING | llava.data.builder:build_dataset:92 - Training VILA with mixture 'vila_quantumn_qa_train'. |
|
2025-07-01 08:57:05.621 | WARNING | llava.data.builder:build_dataset:92 - Training VILA with mixture 'vila_quantumn_qa_train'. |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/train/llava_trainer.py:592: FutureWarning: `tokenizer` is deprecated and will be removed in version 5.0.0 for `LLaVATrainer.__init__`. Use `processing_class` instead. |
|
super().__init__(*args, **kwargs) |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/train/llava_trainer.py:592: FutureWarning: `tokenizer` is deprecated and will be removed in version 5.0.0 for `LLaVATrainer.__init__`. Use `processing_class` instead. |
|
super().__init__(*args, **kwargs) |
|
2025-07-01 08:57:05.641 | WARNING | llava.data.builder:build_dataset:92 - Training VILA with mixture 'vila_quantumn_qa_train'. |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/train/llava_trainer.py:592: FutureWarning: `tokenizer` is deprecated and will be removed in version 5.0.0 for `LLaVATrainer.__init__`. Use `processing_class` instead. |
|
super().__init__(*args, **kwargs) |
|
2025-07-01 08:57:05.642 | WARNING | llava.data.builder:build_dataset:92 - Training VILA with mixture 'vila_quantumn_qa_train'. |
|
2025-07-01 08:57:05.643 | WARNING | llava.data.builder:build_dataset:92 - Training VILA with mixture 'vila_quantumn_qa_train'. |
|
2025-07-01 08:57:05.646 | WARNING | llava.data.builder:build_dataset:92 - Training VILA with mixture 'vila_quantumn_qa_train'. |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/train/llava_trainer.py:592: FutureWarning: `tokenizer` is deprecated and will be removed in version 5.0.0 for `LLaVATrainer.__init__`. Use `processing_class` instead. |
|
super().__init__(*args, **kwargs) |
|
2025-07-01 08:57:05.650 | WARNING | llava.data.builder:build_dataset:92 - Training VILA with mixture 'vila_quantumn_qa_train'. |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/train/llava_trainer.py:592: FutureWarning: `tokenizer` is deprecated and will be removed in version 5.0.0 for `LLaVATrainer.__init__`. Use `processing_class` instead. |
|
super().__init__(*args, **kwargs) |
|
2025-07-01 08:57:05.660 | WARNING | llava.data.builder:build_dataset:92 - Training VILA with mixture 'vila_quantumn_qa_train'. |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/train/llava_trainer.py:592: FutureWarning: `tokenizer` is deprecated and will be removed in version 5.0.0 for `LLaVATrainer.__init__`. Use `processing_class` instead. |
|
super().__init__(*args, **kwargs) |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/train/llava_trainer.py:592: FutureWarning: `tokenizer` is deprecated and will be removed in version 5.0.0 for `LLaVATrainer.__init__`. Use `processing_class` instead. |
|
super().__init__(*args, **kwargs) |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/train/llava_trainer.py:592: FutureWarning: `tokenizer` is deprecated and will be removed in version 5.0.0 for `LLaVATrainer.__init__`. Use `processing_class` instead. |
|
super().__init__(*args, **kwargs) |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/train/llava_trainer.py:592: FutureWarning: `tokenizer` is deprecated and will be removed in version 5.0.0 for `LLaVATrainer.__init__`. Use `processing_class` instead. |
|
super().__init__(*args, **kwargs) |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/train/llava_trainer.py:592: FutureWarning: `tokenizer` is deprecated and will be removed in version 5.0.0 for `LLaVATrainer.__init__`. Use `processing_class` instead. |
|
super().__init__(*args, **kwargs) |
|
2025-07-01 08:57:05.688 | WARNING | llava.data.builder:build_dataset:92 - Training VILA with mixture 'vila_quantumn_qa_train'. |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/train/llava_trainer.py:592: FutureWarning: `tokenizer` is deprecated and will be removed in version 5.0.0 for `LLaVATrainer.__init__`. Use `processing_class` instead. |
|
super().__init__(*args, **kwargs) |
|
2025-07-01 08:57:05.693 | WARNING | llava.data.builder:build_dataset:92 - Training VILA with mixture 'vila_quantumn_qa_train'. |
|
2025-07-01 08:57:05.693 | WARNING | llava.data.builder:build_dataset:92 - Training VILA with mixture 'vila_quantumn_qa_train'. |
|
2025-07-01 08:57:05.694 | WARNING | llava.data.builder:build_dataset:92 - Training VILA with mixture 'vila_quantumn_qa_train'. |
|
2025-07-01 08:57:05.700 | WARNING | llava.data.builder:build_dataset:92 - Training VILA with mixture 'vila_quantumn_qa_train'. |
|
2025-07-01 08:57:05.700 | WARNING | llava.data.builder:build_dataset:92 - Training VILA with mixture 'vila_quantumn_qa_train'. |
|
2025-07-01 08:57:05.704 | WARNING | llava.data.builder:build_dataset:92 - Training VILA with mixture 'vila_quantumn_qa_train'. |
|
2025-07-01 08:57:05.705 | WARNING | llava.data.builder:build_dataset:92 - Training VILA with mixture 'vila_quantumn_qa_train'. |
|
2025-07-01 08:57:05.705 | WARNING | llava.data.builder:build_dataset:92 - Training VILA with mixture 'vila_quantumn_qa_train'. |
|
2025-07-01 08:57:05.713 | WARNING | llava.data.builder:build_dataset:92 - Training VILA with mixture 'vila_quantumn_qa_train'. |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/train/llava_trainer.py:592: FutureWarning: `tokenizer` is deprecated and will be removed in version 5.0.0 for `LLaVATrainer.__init__`. Use `processing_class` instead. |
|
super().__init__(*args, **kwargs) |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/train/llava_trainer.py:592: FutureWarning: `tokenizer` is deprecated and will be removed in version 5.0.0 for `LLaVATrainer.__init__`. Use `processing_class` instead. |
|
super().__init__(*args, **kwargs) |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/train/llava_trainer.py:592: FutureWarning: `tokenizer` is deprecated and will be removed in version 5.0.0 for `LLaVATrainer.__init__`. Use `processing_class` instead. |
|
super().__init__(*args, **kwargs) |
|
2025-07-01 08:57:05.723 | WARNING | llava.data.builder:build_dataset:92 - Training VILA with mixture 'vila_quantumn_qa_train'. |
|
2025-07-01 08:57:05.724 | WARNING | llava.data.builder:build_dataset:92 - Training VILA with mixture 'vila_quantumn_qa_train'. |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/train/llava_trainer.py:592: FutureWarning: `tokenizer` is deprecated and will be removed in version 5.0.0 for `LLaVATrainer.__init__`. Use `processing_class` instead. |
|
super().__init__(*args, **kwargs) |
|
2025-07-01 08:57:05.729 | WARNING | llava.data.builder:build_dataset:92 - Training VILA with mixture 'vila_quantumn_qa_train'. |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/train/llava_trainer.py:592: FutureWarning: `tokenizer` is deprecated and will be removed in version 5.0.0 for `LLaVATrainer.__init__`. Use `processing_class` instead. |
|
super().__init__(*args, **kwargs) |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/train/llava_trainer.py:592: FutureWarning: `tokenizer` is deprecated and will be removed in version 5.0.0 for `LLaVATrainer.__init__`. Use `processing_class` instead. |
|
super().__init__(*args, **kwargs) |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/train/llava_trainer.py:592: FutureWarning: `tokenizer` is deprecated and will be removed in version 5.0.0 for `LLaVATrainer.__init__`. Use `processing_class` instead. |
|
super().__init__(*args, **kwargs) |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/train/llava_trainer.py:592: FutureWarning: `tokenizer` is deprecated and will be removed in version 5.0.0 for `LLaVATrainer.__init__`. Use `processing_class` instead. |
|
super().__init__(*args, **kwargs) |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/train/llava_trainer.py:592: FutureWarning: `tokenizer` is deprecated and will be removed in version 5.0.0 for `LLaVATrainer.__init__`. Use `processing_class` instead. |
|
super().__init__(*args, **kwargs) |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/train/llava_trainer.py:592: FutureWarning: `tokenizer` is deprecated and will be removed in version 5.0.0 for `LLaVATrainer.__init__`. Use `processing_class` instead. |
|
super().__init__(*args, **kwargs) |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/train/llava_trainer.py:592: FutureWarning: `tokenizer` is deprecated and will be removed in version 5.0.0 for `LLaVATrainer.__init__`. Use `processing_class` instead. |
|
super().__init__(*args, **kwargs) |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/train/llava_trainer.py:592: FutureWarning: `tokenizer` is deprecated and will be removed in version 5.0.0 for `LLaVATrainer.__init__`. Use `processing_class` instead. |
|
super().__init__(*args, **kwargs) |
|
2025-07-01 08:57:05.754 | WARNING | llava.data.builder:build_dataset:92 - Training VILA with mixture 'vila_quantumn_qa_train'. |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/train/llava_trainer.py:592: FutureWarning: `tokenizer` is deprecated and will be removed in version 5.0.0 for `LLaVATrainer.__init__`. Use `processing_class` instead. |
|
super().__init__(*args, **kwargs) |
|
2025-07-01 08:57:05.761 | WARNING | llava.data.builder:build_dataset:92 - Training VILA with mixture 'vila_quantumn_qa_train'. |
|
2025-07-01 08:57:05.762 | WARNING | llava.data.builder:build_dataset:92 - Training VILA with mixture 'vila_quantumn_qa_train'. |
|
2025-07-01 08:57:05.765 | WARNING | llava.data.builder:build_dataset:92 - Training VILA with mixture 'vila_quantumn_qa_train'. |
|
2025-07-01 08:57:05.776 | WARNING | llava.data.builder:build_dataset:92 - Training VILA with mixture 'vila_quantumn_qa_train'. |
|
2025-07-01 08:57:05.777 | WARNING | llava.data.builder:build_dataset:92 - Training VILA with mixture 'vila_quantumn_qa_train'. |
|
2025-07-01 08:57:05.783 | WARNING | llava.data.builder:build_dataset:92 - Training VILA with mixture 'vila_quantumn_qa_train'. |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/train/llava_trainer.py:592: FutureWarning: `tokenizer` is deprecated and will be removed in version 5.0.0 for `LLaVATrainer.__init__`. Use `processing_class` instead. |
|
super().__init__(*args, **kwargs) |
|
2025-07-01 08:57:05.787 | WARNING | llava.data.builder:build_dataset:92 - Training VILA with mixture 'vila_quantumn_qa_train'. |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/train/llava_trainer.py:592: FutureWarning: `tokenizer` is deprecated and will be removed in version 5.0.0 for `LLaVATrainer.__init__`. Use `processing_class` instead. |
|
super().__init__(*args, **kwargs) |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/train/llava_trainer.py:592: FutureWarning: `tokenizer` is deprecated and will be removed in version 5.0.0 for `LLaVATrainer.__init__`. Use `processing_class` instead. |
|
super().__init__(*args, **kwargs) |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/train/llava_trainer.py:592: FutureWarning: `tokenizer` is deprecated and will be removed in version 5.0.0 for `LLaVATrainer.__init__`. Use `processing_class` instead. |
|
super().__init__(*args, **kwargs) |
|
2025-07-01 08:57:05.795 | WARNING | llava.data.builder:build_dataset:92 - Training VILA with mixture 'vila_quantumn_qa_train'. |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/train/llava_trainer.py:592: FutureWarning: `tokenizer` is deprecated and will be removed in version 5.0.0 for `LLaVATrainer.__init__`. Use `processing_class` instead. |
|
super().__init__(*args, **kwargs) |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/train/llava_trainer.py:592: FutureWarning: `tokenizer` is deprecated and will be removed in version 5.0.0 for `LLaVATrainer.__init__`. Use `processing_class` instead. |
|
super().__init__(*args, **kwargs) |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/train/llava_trainer.py:592: FutureWarning: `tokenizer` is deprecated and will be removed in version 5.0.0 for `LLaVATrainer.__init__`. Use `processing_class` instead. |
|
super().__init__(*args, **kwargs) |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/train/llava_trainer.py:592: FutureWarning: `tokenizer` is deprecated and will be removed in version 5.0.0 for `LLaVATrainer.__init__`. Use `processing_class` instead. |
|
super().__init__(*args, **kwargs) |
|
2025-07-01 08:57:05.824 | WARNING | llava.data.builder:build_dataset:92 - Training VILA with mixture 'vila_quantumn_qa_train'. |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/train/llava_trainer.py:592: FutureWarning: `tokenizer` is deprecated and will be removed in version 5.0.0 for `LLaVATrainer.__init__`. Use `processing_class` instead. |
|
super().__init__(*args, **kwargs) |
|
2025-07-01 08:57:05.852 | WARNING | llava.data.builder:build_dataset:92 - Training VILA with mixture 'vila_quantumn_qa_train'. |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/train/llava_trainer.py:592: FutureWarning: `tokenizer` is deprecated and will be removed in version 5.0.0 for `LLaVATrainer.__init__`. Use `processing_class` instead. |
|
super().__init__(*args, **kwargs) |
|
2025-07-01 08:57:05.872 | WARNING | llava.data.builder:build_dataset:92 - Training VILA with mixture 'vila_quantumn_qa_train'. |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/train/llava_trainer.py:592: FutureWarning: `tokenizer` is deprecated and will be removed in version 5.0.0 for `LLaVATrainer.__init__`. Use `processing_class` instead. |
|
super().__init__(*args, **kwargs) |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/train/llava_trainer.py:592: FutureWarning: `tokenizer` is deprecated and will be removed in version 5.0.0 for `LLaVATrainer.__init__`. Use `processing_class` instead. |
|
super().__init__(*args, **kwargs) |
|
2025-07-01 08:57:05.955 | WARNING | llava.data.builder:build_dataset:92 - Training VILA with mixture 'vila_quantumn_qa_train'. |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/train/llava_trainer.py:592: FutureWarning: `tokenizer` is deprecated and will be removed in version 5.0.0 for `LLaVATrainer.__init__`. Use `processing_class` instead. |
|
super().__init__(*args, **kwargs) |
|
2025-07-01 08:57:05.994 | WARNING | llava.data.builder:build_dataset:92 - Training VILA with mixture 'vila_quantumn_qa_train'. |
|
/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/train/llava_trainer.py:592: FutureWarning: `tokenizer` is deprecated and will be removed in version 5.0.0 for `LLaVATrainer.__init__`. Use `processing_class` instead. |
|
super().__init__(*args, **kwargs) |
|
[rank0]: Traceback (most recent call last): |
|
[rank0]: File "/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/train/train_mem.py", line 49, in <module> |
|
[rank0]: train() |
|
[rank0]: File "/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/train/train.py", line 906, in train |
|
[rank0]: trainer.train(resume_from_checkpoint=resume_from_checkpoint) |
|
[rank0]: File "/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/transformers/trainer.py", line 2122, in train |
|
[rank0]: return inner_training_loop( |
|
[rank0]: File "/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/llava/train/llava_trainer.py", line 665, in _inner_training_loop |
|
[rank0]: return super()._inner_training_loop(batch_size, *args, **kwargs) |
|
[rank0]: File "/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/transformers/trainer.py", line 2381, in _inner_training_loop |
|
[rank0]: self.control = self.callback_handler.on_train_begin(args, self.state, self.control) |
|
[rank0]: File "/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/transformers/trainer_callback.py", line 468, in on_train_begin |
|
[rank0]: return self.call_event("on_train_begin", args, state, control) |
|
[rank0]: File "/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/transformers/trainer_callback.py", line 518, in call_event |
|
[rank0]: result = getattr(callback, event)( |
|
[rank0]: File "/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/transformers/integrations/integration_utils.py", line 911, in on_train_begin |
|
[rank0]: self.setup(args, state, model, **kwargs) |
|
[rank0]: File "/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/transformers/integrations/integration_utils.py", line 838, in setup |
|
[rank0]: self._wandb.init( |
|
[rank0]: File "/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/wandb/sdk/wandb_init.py", line 1623, in init |
|
[rank0]: wandb._sentry.reraise(e) |
|
[rank0]: File "/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/wandb/analytics/sentry.py", line 156, in reraise |
|
[rank0]: raise exc.with_traceback(sys.exc_info()[2]) |
|
[rank0]: File "/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/wandb/sdk/wandb_init.py", line 1551, in init |
|
[rank0]: wi.maybe_login(init_settings) |
|
[rank0]: File "/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/wandb/sdk/wandb_init.py", line 191, in maybe_login |
|
[rank0]: wandb_login._login( |
|
[rank0]: File "/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/wandb/sdk/wandb_login.py", line 315, in _login |
|
[rank0]: key, key_status = wlogin.prompt_api_key(referrer=referrer) |
|
[rank0]: File "/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/wandb/sdk/wandb_login.py", line 243, in prompt_api_key |
|
[rank0]: raise UsageError("api_key not configured (no-tty). call " + directive) |
|
[rank0]: wandb.errors.errors.UsageError: api_key not configured (no-tty). call wandb.login(key=[your_api_key]) |
|
W0701 08:57:29.435000 23456244200576 torch/distributed/elastic/multiprocessing/api.py:851] Sending process 2099155 closing signal SIGTERM |
|
W0701 08:57:29.438000 23456244200576 torch/distributed/elastic/multiprocessing/api.py:851] Sending process 2099156 closing signal SIGTERM |
|
W0701 08:57:29.439000 23456244200576 torch/distributed/elastic/multiprocessing/api.py:851] Sending process 2099157 closing signal SIGTERM |
|
W0701 08:57:29.441000 23456244200576 torch/distributed/elastic/multiprocessing/api.py:851] Sending process 2099158 closing signal SIGTERM |
|
W0701 08:57:29.443000 23456244200576 torch/distributed/elastic/multiprocessing/api.py:851] Sending process 2099159 closing signal SIGTERM |
|
W0701 08:57:29.445000 23456244200576 torch/distributed/elastic/multiprocessing/api.py:851] Sending process 2099160 closing signal SIGTERM |
|
W0701 08:57:29.445000 23456244200576 torch/distributed/elastic/multiprocessing/api.py:851] Sending process 2099161 closing signal SIGTERM |
|
E0701 08:57:37.061000 23456244200576 torch/distributed/elastic/multiprocessing/api.py:826] failed (exitcode: 1) local_rank: 0 (pid: 2099154) of binary: /lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/bin/python3 |
|
Traceback (most recent call last): |
|
File "/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/bin/torchrun", line 10, in <module> |
|
sys.exit(main()) |
|
File "/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/torch/distributed/elastic/multiprocessing/errors/__init__.py", line 347, in wrapper |
|
return f(*args, **kwargs) |
|
File "/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/torch/distributed/run.py", line 879, in main |
|
run(args) |
|
File "/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/torch/distributed/run.py", line 870, in run |
|
elastic_launch( |
|
File "/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/torch/distributed/launcher/api.py", line 132, in __call__ |
|
return launch_agent(self._config, self._entrypoint, list(args)) |
|
File "/lustre/fs1/portfolios/nvr/projects/nvr_elm_llm/users/ligengz/workspace/vila-q/.venv/lib/python3.10/site-packages/torch/distributed/launcher/api.py", line 263, in launch_agent |
|
raise ChildFailedError( |
|
torch.distributed.elastic.multiprocessing.errors.ChildFailedError: |
|
============================================================ |
|
llava/train/train_mem.py FAILED |
|
------------------------------------------------------------ |
|
Failures: |
|
<NO_OTHER_FAILURES> |
|
------------------------------------------------------------ |
|
Root Cause (first observed failure): |
|
[0]: |
|
time : 2025-07-01_08:57:29 |
|
host : pool0-01504.cm.cluster |
|
rank : 0 (local_rank: 0) |
|
exitcode : 1 (pid: 2099154) |
|
error_file: <N/A> |
|
traceback : To enable traceback see: https://pytorch.org/docs/stable/elastic/errors.html |
|
============================================================ |
|
W0701 08:57:37.640000 23456244200576 torch/distributed/elastic/agent/server/api.py:741] Received Signals.SIGTERM death signal, shutting down workers |
|
W0701 08:57:37.640000 23456244200576 torch/distributed/elastic/agent/server/api.py:741] Received Signals.SIGTERM death signal, shutting down workers |
|
W0701 08:57:37.640000 23456244200576 torch/distributed/elastic/multiprocessing/api.py:851] Sending process 1874933 closing signal SIGTERM |
|
W0701 08:57:37.640000 23456244200576 torch/distributed/elastic/multiprocessing/api.py:851] Sending process 1526889 closing signal SIGTERM |
|
W0701 08:57:37.640000 23456244200576 torch/distributed/elastic/agent/server/api.py:741] Received Signals.SIGTERM death signal, shutting down workers |
|
W0701 08:57:37.640000 23456244200576 torch/distributed/elastic/multiprocessing/api.py:851] Sending process 1094502 closing signal SIGTERM |
|
W0701 08:57:37.640000 23456244200576 torch/distributed/elastic/multiprocessing/api.py:851] Sending process 1094503 closing signal SIGTERM |
|
W0701 08:57:37.640000 23456244200576 torch/distributed/elastic/agent/server/api.py:741] Received Signals.SIGTERM death signal, shutting down workers |
|
W0701 08:57:37.640000 23456244200576 torch/distributed/elastic/agent/server/api.py:741] Received Signals.SIGTERM death signal, shutting down workers |
|
W0701 08:57:37.640000 23456244200576 torch/distributed/elastic/agent/server/api.py:741] Received Signals.SIGTERM death signal, shutting down workers |
|
W0701 08:57:37.640000 23456244200576 torch/distributed/elastic/multiprocessing/api.py:851] Sending process 656827 closing signal SIGTERM |
|
W0701 08:57:37.641000 23456244200576 torch/distributed/elastic/multiprocessing/api.py:851] Sending process 3022756 closing signal SIGTERM |
|
W0701 08:57:37.640000 23456244200576 torch/distributed/elastic/multiprocessing/api.py:851] Sending process 153441 closing signal SIGTERM |
|
W0701 08:57:37.641000 23456244200576 torch/distributed/elastic/multiprocessing/api.py:851] Sending process 1526890 closing signal SIGTERM |
|
W0701 08:57:37.642000 23456244200576 torch/distributed/elastic/agent/server/api.py:741] Received Signals.SIGTERM death signal, shutting down workers |
|
W0701 08:57:37.642000 23456244200576 torch/distributed/elastic/multiprocessing/api.py:851] Sending process 1910859 closing signal SIGTERM |
|
W0701 08:57:37.641000 23456244200576 torch/distributed/elastic/multiprocessing/api.py:851] Sending process 1874934 closing signal SIGTERM |
|
W0701 08:57:37.641000 23456244200576 torch/distributed/elastic/multiprocessing/api.py:851] Sending process 656828 closing signal SIGTERM |
|
W0701 08:57:37.642000 23456244200576 torch/distributed/elastic/multiprocessing/api.py:851] Sending process 3022757 closing signal SIGTERM |
|
W0701 08:57:37.642000 23456244200576 torch/distributed/elastic/multiprocessing/api.py:851] Sending process 1526891 closing signal SIGTERM |
|
W0701 08:57:37.643000 23456244200576 torch/distributed/elastic/multiprocessing/api.py:851] Sending process 1910860 closing signal SIGTERM |
|
W0701 08:57:37.642000 23456244200576 torch/distributed/elastic/multiprocessing/api.py:851] Sending process 153442 closing signal SIGTERM |
|
W0701 08:57:37.643000 23456244200576 torch/distributed/elastic/multiprocessing/api.py:851] Sending process 1874935 closing signal SIGTERM |
|
W0701 08:57:37.643000 23456244200576 torch/distributed/elastic/multiprocessing/api.py:851] Sending process 656829 closing signal SIGTERM |
|
W0701 08:57:37.643000 23456244200576 torch/distributed/elastic/multiprocessing/api.py:851] Sending process 1526892 closing signal SIGTERM |
|
W0701 08:57:37.643000 23456244200576 torch/distributed/elastic/multiprocessing/api.py:851] Sending process 3022758 closing signal SIGTERM |
|
W0701 08:57:37.643000 23456244200576 torch/distributed/elastic/multiprocessing/api.py:851] Sending process 1094504 closing signal SIGTERM |
|
W0701 08:57:37.645000 23456244200576 torch/distributed/elastic/multiprocessing/api.py:851] Sending process 1910861 closing signal SIGTERM |
|
W0701 08:57:37.643000 23456244200576 torch/distributed/elastic/multiprocessing/api.py:851] Sending process 153443 closing signal SIGTERM |
|
W0701 08:57:37.644000 23456244200576 torch/distributed/elastic/multiprocessing/api.py:851] Sending process 656830 closing signal SIGTERM |
|
W0701 08:57:37.644000 23456244200576 torch/distributed/elastic/multiprocessing/api.py:851] Sending process 1874936 closing signal SIGTERM |
|
W0701 08:57:37.645000 23456244200576 torch/distributed/elastic/multiprocessing/api.py:851] Sending process 3022759 closing signal SIGTERM |
|
W0701 08:57:37.645000 23456244200576 torch/distributed/elastic/multiprocessing/api.py:851] Sending process 1526893 closing signal SIGTERM |
|
W0701 08:57:37.645000 23456244200576 torch/distributed/elastic/multiprocessing/api.py:851] Sending process 1094505 closing signal SIGTERM |
|
W0701 08:57:37.646000 23456244200576 torch/distributed/elastic/multiprocessing/api.py:851] Sending process 1910862 closing signal SIGTERM |
|
W0701 08:57:37.645000 23456244200576 torch/distributed/elastic/multiprocessing/api.py:851] Sending process 153444 closing signal SIGTERM |
|
W0701 08:57:37.645000 23456244200576 torch/distributed/elastic/multiprocessing/api.py:851] Sending process 656831 closing signal SIGTERM |
|
W0701 08:57:37.646000 23456244200576 torch/distributed/elastic/multiprocessing/api.py:851] Sending process 3022760 closing signal SIGTERM |
|
W0701 08:57:37.646000 23456244200576 torch/distributed/elastic/multiprocessing/api.py:851] Sending process 1094506 closing signal SIGTERM |
|
W0701 08:57:37.646000 23456244200576 torch/distributed/elastic/multiprocessing/api.py:851] Sending process 1874937 closing signal SIGTERM |
|
W0701 08:57:37.646000 23456244200576 torch/distributed/elastic/multiprocessing/api.py:851] Sending process 153445 closing signal SIGTERM |
|
W0701 08:57:37.647000 23456244200576 torch/distributed/elastic/multiprocessing/api.py:851] Sending process 656832 closing signal SIGTERM |
|
W0701 08:57:37.647000 23456244200576 torch/distributed/elastic/multiprocessing/api.py:851] Sending process 1526894 closing signal SIGTERM |
|
W0701 08:57:37.648000 23456244200576 torch/distributed/elastic/multiprocessing/api.py:851] Sending process 1910863 closing signal SIGTERM |
|
W0701 08:57:37.647000 23456244200576 torch/distributed/elastic/multiprocessing/api.py:851] Sending process 1874938 closing signal SIGTERM |
|
W0701 08:57:37.647000 23456244200576 torch/distributed/elastic/multiprocessing/api.py:851] Sending process 3022761 closing signal SIGTERM |
|
W0701 08:57:37.648000 23456244200576 torch/distributed/elastic/multiprocessing/api.py:851] Sending process 1526895 closing signal SIGTERM |
|
W0701 08:57:37.649000 23456244200576 torch/distributed/elastic/multiprocessing/api.py:851] Sending process 1910864 closing signal SIGTERM |
|
W0701 08:57:37.648000 23456244200576 torch/distributed/elastic/multiprocessing/api.py:851] Sending process 1094507 closing signal SIGTERM |
|
W0701 08:57:37.648000 23456244200576 torch/distributed/elastic/multiprocessing/api.py:851] Sending process 153446 closing signal SIGTERM |
|
W0701 08:57:37.649000 23456244200576 torch/distributed/elastic/multiprocessing/api.py:851] Sending process 3022762 closing signal SIGTERM |
|
W0701 08:57:37.649000 23456244200576 torch/distributed/elastic/multiprocessing/api.py:851] Sending process 1874939 closing signal SIGTERM |
|
W0701 08:57:37.649000 23456244200576 torch/distributed/elastic/multiprocessing/api.py:851] Sending process 656833 closing signal SIGTERM |
|
W0701 08:57:37.650000 23456244200576 torch/distributed/elastic/multiprocessing/api.py:851] Sending process 1094508 closing signal SIGTERM |
|
W0701 08:57:37.651000 23456244200576 torch/distributed/elastic/multiprocessing/api.py:851] Sending process 1910865 closing signal SIGTERM |
|
W0701 08:57:37.650000 23456244200576 torch/distributed/elastic/multiprocessing/api.py:851] Sending process 153447 closing signal SIGTERM |
|
W0701 08:57:37.650000 23456244200576 torch/distributed/elastic/multiprocessing/api.py:851] Sending process 1526896 closing signal SIGTERM |
|
W0701 08:57:37.652000 23456244200576 torch/distributed/elastic/multiprocessing/api.py:851] Sending process 1910866 closing signal SIGTERM |
|
W0701 08:57:37.651000 23456244200576 torch/distributed/elastic/multiprocessing/api.py:851] Sending process 656834 closing signal SIGTERM |
|
W0701 08:57:37.651000 23456244200576 torch/distributed/elastic/multiprocessing/api.py:851] Sending process 1874940 closing signal SIGTERM |
|
W0701 08:57:37.651000 23456244200576 torch/distributed/elastic/multiprocessing/api.py:851] Sending process 3022763 closing signal SIGTERM |
|
W0701 08:57:37.651000 23456244200576 torch/distributed/elastic/multiprocessing/api.py:851] Sending process 153448 closing signal SIGTERM |
|
W0701 08:57:37.652000 23456244200576 torch/distributed/elastic/multiprocessing/api.py:851] Sending process 1094509 closing signal SIGTERM |
|
|