--- title: Peripheral Blood Cell Analysis emoji: 🔬 colorFrom: blue colorTo: red sdk: gradio sdk_version: 4.19.2 app_file: app.py pinned: false license: mit --- # Peripheral Blood Cell Classification with Vision Language Models ## Overview This application uses state-of-the-art Vision Language Models to classify and describe peripheral blood cells. The system combines advanced computer vision with natural language processing to provide detailed analysis of blood cell images, making it a valuable tool for hematological research and diagnosis. ## Models The application integrates three powerful Vision Language Models: 1. **Blood Cell Classifier with Llama-3.2** - Based on Llama architecture - Fine-tuned specifically for blood cell classification - Model: laurru01/Llama-3.2-11B-Vision-Instruct-ft-PeripherallBloodCells 2. **Blood Cell Classifier with Qwen2-VL** - Leverages Qwen2's vision-language capabilities - Optimized for medical image analysis - Model: laurru01/Qwen2-VL-2B-Instruct-ft-bloodcells-big 3. **Blood Cell Classifier with SmolVLM** - Lightweight yet powerful vision-language model - Efficient processing with maintained accuracy - Model: laurru01/SmolVLM-Instruct-ft-PeripherallBloodCells ## Features - Multi-model analysis for comparative results - Detailed cell type classification - Comprehensive morphological descriptions - Support for common image formats - Real-time processing and analysis - User-friendly interface ## Cell Types Detected - Neutrophils - Lymphocytes - Monocytes - Eosinophils - Basophils ## Technical Details - Built with Gradio for the interface - Powered by PyTorch and Transformers - Optimized for GPU processing - Uses 4-bit quantization for efficient model loading - Implements advanced memory management techniques ## Usage 1. Select a model from the dropdown menu 2. Upload an image of a blood cell 3. Wait for the analysis to complete 4. Review the classification and description ## Performance Notes - Processing time varies by model - GPU recommended for optimal performance - Image quality affects accuracy ## Limitations - Processes one cell at a time - Requires clear, focused images - May have varying response times based on server load ## Future Improvements - Support for batch processing - Additional model integrations - Enhanced visualization options - Performance optimizations ## Citations If you use this application in your research, please cite: @software{blood_cell_classifier, author = {Laurru}, title = {Peripheral Blood Cell Classification with Vision Language Models}, year = {2024}, publisher = {Hugging Face}, url = {https://huggingface.co/spaces/laurru/blood-cell-classifier} } ## Contact For questions or suggestions, please open an issue in the repository or contact through Hugging Face. ## License This project is licensed under the MIT License - see the LICENSE file for details.