README.md

metadata

base_model: facebook/detr-resnet-50
tags:
  - object-detection

This model is trained to crop screen area from app introduction images.

Code and dataset can be found at https://github.com/Jl-wei/guing

Using with pipeline

from PIL import Image
from transformers import pipeline

detector = pipeline("object-detection", model="Jl-wei/app-intro-img-cropper", device=0)
image = Image.open(img_path)
result = detector(image, threshold=0.5)

This is the app introduction image cropper of the following paper:

@misc{wei2024guing,
      title={GUing: A Mobile GUI Search Engine using a Vision-Language Model}, 
      author={Jialiang Wei and Anne-Lise Courbis and Thomas Lambolais and Binbin Xu and Pierre Louis Bernard and Gérard Dray and Walid Maalej},
      year={2024},
      eprint={2405.00145},
      archivePrefix={arXiv}
}

Please note that the model can only be used for academic purpose.