runtime error
Exit code: 139. Reason: e-packages/nemo/core/classes/__init__.py", line 33, in <module> from nemo.core.classes.modelPT import ModelPT File "/usr/local/lib/python3.10/site-packages/nemo/core/classes/modelPT.py", line 32, in <module> from nemo.core import optim File "/usr/local/lib/python3.10/site-packages/nemo/core/optim/__init__.py", line 32, in <module> from nemo.core.optim.optimizer_with_main_params import MainParamsOptimizerWrapper File "/usr/local/lib/python3.10/site-packages/nemo/core/optim/optimizer_with_main_params.py", line 32, in <module> from megatron.core.parallel_state import get_data_parallel_group, get_data_parallel_world_size File "/usr/local/lib/python3.10/site-packages/megatron/core/__init__.py", line 1, in <module> import megatron.core.tensor_parallel File "/usr/local/lib/python3.10/site-packages/megatron/core/tensor_parallel/__init__.py", line 1, in <module> from .cross_entropy import vocab_parallel_cross_entropy File "/usr/local/lib/python3.10/site-packages/megatron/core/tensor_parallel/cross_entropy.py", line 5, in <module> from megatron.core.parallel_state import ( File "/usr/local/lib/python3.10/site-packages/megatron/core/parallel_state.py", line 10, in <module> from .utils import GlobalMemoryBuffer File "/usr/local/lib/python3.10/site-packages/megatron/core/utils.py", line 11, in <module> from megatron.core.dist_checkpointing.mapping import ShardedTensor File "/usr/local/lib/python3.10/site-packages/megatron/core/dist_checkpointing/__init__.py", line 5, in <module> from .serialization import ( File "/usr/local/lib/python3.10/site-packages/megatron/core/dist_checkpointing/serialization.py", line 40, in <module> from .strategies.base import ( File "/usr/local/lib/python3.10/site-packages/megatron/core/dist_checkpointing/strategies/__init__.py", line 10, in <module> import tensorstore File "/usr/local/lib/python3.10/site-packages/tensorstore/__init__.py", line 19, in <module> from ._tensorstore import * AttributeError: _ARRAY_API not found
Container logs:
Fetching error logs...