File size: 703 Bytes
263a6fd 93f3e1a 263a6fd 93f3e1a 263a6fd 0437961 93f3e1a 0437961 816b23f |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 |
---
library_name: psalm
license: apache-2.0
pipeline_tag: image-segmentation
---
# PSALM: Pixelwise SegmentAtion with Large Multi-Modal Model
Paper: https://huggingface.co/papers/2403.14598.
### Features
* A powerful extension of the Large Multi-modal Model for generic (panoptic, instance, semantic) segmentation, referring segmentation and interactivate segmentation.
* Support joint training across multiple segmentation tasks and visual-language tasks.
* Demonstrates zero-shot capabilities on unseen task, such as open-vocabulary segmentation, generalizaed referring segmentation, and video object segmentation.
### Note
You need to change `mm_vision_tower` to your mask2former checkpoint path. |