File size: 2,531 Bytes
c153553
2d7955d
c153553
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
4816cc6
 
c153553
 
 
ccf1197
c153553
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
---
license: cc-by-nc-4.0
datasets:
- passing2961/stark-summary
language:
- en
base_model:
- meta-llama/Llama-3.2-1B-Instruct
tags:
- conversational ai
- conversation summarization
---

# Ultron-Summarizer-1B Model Card

[🏠 Homepage](https://stark-dataset.github.io/) | [πŸ’» Github](https://github.com/passing2961/Stark) | [πŸ“„ Arxiv](https://arxiv.org/abs/2407.03958) | [πŸ“• PDF](https://arxiv.org/pdf/2407.03958)

## List of Provided Model Series
- **Ultron-Summarizer-Series:** [πŸ€– Ultron-Summarizer-1B](https://huggingface.co/passing2961/Ultron-Summarizer-1B) | [πŸ€– Ultron-Summarizer-3B](https://huggingface.co/passing2961/Ultron-Summarizer-3B) | [πŸ€– Ultron-Summarizer-8B](https://huggingface.co/passing2961/Ultron-Summarizer-8B)
- **Ultron 7B**: [πŸ€– Ultron-7B](https://huggingface.co/passing2961/Ultron-7B)

> 🚨 Disclaimer: All models and datasets are intended for research purposes only.

## Model Description
- **Repository:** [Code](https://github.com/passing2961/Stark)
- **Paper:** [Stark: Social Long-Term Multi-Modal Conversation with Persona Commonsense Knowledge](https://arxiv.org/abs/2407.03958)
- **Point of Contact:** [Young-Jun Lee](mailto:[email protected])

## Model Details
- **Model**: Ultron-Summarizer-1B is a fully open-source conversational summarizer that generates summaries for long-term conversations, including those with image-sharing turns.
- **Date**: Ultron-Summarizer-1B was trained in 2024.
- **Training Dataset**: [Stark-Summary](https://huggingface.co/datasets/passing2961/stark-summary)
- **Architecture**: Ultron-Summarizer-1B was trained on top of [LLaMA-3.2-1B](https://huggingface.co/meta-llama/Llama-3.2-1B-Instruct).

## How to Use

## License and Recommendations

🚨 Ultron-Summarizer-1B is intended to be used for research purposes only. 

## Acknowledgement

This work was supported by a grant of the KAIST-KT joint research project through AI Tech Lab, Institute of convergence Technology, funded by KT [Project No. G01230605, Development of Task-oriented Persona-based Dialogue Generation Combining Multi-modal Interaction and Knowledge Modeling].

## Citation

If you find the resources in this repository useful, please cite our work:

```
@article{lee2024stark,
  title={Stark: Social Long-Term Multi-Modal Conversation with Persona Commonsense Knowledge},
  author={Lee, Young-Jun and Lee, Dokyong and Youn, Junyoung and Oh, Kyeongjin and Ko, Byungsoo and Hyeon, Jonghwan and Choi, Ho-Jin},
  journal={arXiv preprint arXiv:2407.03958},
  year={2024}
}
```