README.md

---
pipeline_tag: any-to-any
---
# Model Repository Documentation

## Repository Structure Overview

The repository is organized into eight main directories, each serving a specific purpose in the pipeline:

### Meta Data (1_meta_data)
Contains AMASS dataset metadata specifically focused on copycat and occlusion information, essential for motion capture applications.

### MediaPipe Models (2_mediapipe_ckpts)
Houses MediaPipe's specialized models for facial landmarks and hand tracking, providing fundamental capabilities for human pose estimation.

### 4DHumans Framework (3_4DHumans)
Incorporates the SMPL (Skinned Multi-Person Linear Model) framework along with training artifacts. The directory includes model parameters, joint regressors, and HMR2 (Human Mesh Recovery) training checkpoints with corresponding configuration files.

### SMPLhub (4_SMPLhub)
Serves as a comprehensive collection of human body models, including:
- MANO (hand model) parameters for both left and right hands
- SMPL models in various formats (NPZ and PKL) for male, female, and neutral body types
- SMPLH (SMPL with detailed hand articulation)
- SMPLX (extended SMPL model with face and hand expressions)

### Additional Components
- S3FD (5_S3FD): Contains face detection model weights
- SyncNet (6_SyncNet): Includes audio-visual synchronization model
- SGHM (7_SGHM): Houses ResNet50-based model weights
- KonIQ (8_koniq): Contains pre-trained weights for image quality assessment

```
├── 1_meta_data
│   └── amass_copycat_occlusion_v3.pkl
├── 2_mediapipe_ckpts
│   ├── face_landmarker.task
│   └── hand_landmarker.task
├── 3_4DHumans
│   ├── data
│   │   ├── smpl
│   │   │   └── SMPL_NEUTRAL.pkl
│   │   ├── smpl_mean_params.npz
│   │   └── SMPL_to_J19.pkl
│   └── logs
│       └── train
│           └── multiruns
│               └── hmr2
│                   └── 0
│                       ├── checkpoints
│                       │   └── epoch=35-step=1000000.ckpt
│                       ├── dataset_config.yaml
│                       └── model_config.yaml
├── 4_SMPLhub
│   ├── 0_misc_files
│   │   └── J_regressor_coco.npy
│   ├── MANO
│   │   └── pkl
│   │       ├── MANO_LEFT.pkl
│   │       ├── mano_mean_params.npz
│   │       └── MANO_RIGHT.pkl
│   ├── SMPL
│   │   ├── basicmodel_X_lbs_10_207_0_v1.1.0_pkl
│   │   │   ├── basicmodel_f_lbs_10_207_0_v1.1.0.pkl
│   │   │   ├── basicmodel_m_lbs_10_207_0_v1.1.0.pkl
│   │   │   └── basicmodel_neutral_lbs_10_207_0_v1.1.0.pkl
│   │   ├── X_model_npz
│   │   │   ├── SMPL_F_model.npz
│   │   │   ├── SMPL_M_model.npz
│   │   │   └── SMPL_N_model.npz
│   │   └── X_pkl
│   │       ├── SMPL_FEMALE.pkl
│   │       ├── SMPL_MALE.pkl
│   │       └── SMPL_NEUTRAL.pkl
│   ├── SMPLH
│   │   ├── X_npz
│   │   │   ├── SMPLH_FEMALE.npz
│   │   │   ├── SMPLH_MALE.npz
│   │   │   └── SMPLH_NEUTRAL.npz
│   │   └── X_pkl
│   │       ├── SMPLH_female.pkl
│   │       ├── SMPLH_male.pkl
│   │       └── SMPLH_NEUTRAL.pkl
│   └── SMPLX
│       ├── mod
│       │   └── SMPLX_MALE_shape2019_exp2020.npz
│       └── X_npz
│           ├── SMPLX_FEMALE.npz
│           ├── SMPLX_MALE.npz
│           └── SMPLX_NEUTRAL.npz
├── 5_S3FD
│   └── sfd_face.pth
├── 6_SyncNet
│   └── syncnet_v2.model
├── 7_SGHM
│   └── SGHM-ResNet50.pth
└── 8_koniq
    └── koniq_pretrained.pkl
```

### Create New Model Repo

Update LFS files
```
git lfs track "*.gif"
git lfs track "*.jpg"
git lfs track "*.png"

# 4. 使用 git lfs migrate 命令转换现有文件
# 这会将已经提交的文件转换为 LFS 对象
git lfs migrate import --include="*.gif,*.jpg,*.png" --everything

# 5. 强制推送更新后的历史
git push --force origin main
```

Add new repo

```
git add .
git commit -m "init"
git push
```