---
base_model: unsloth/llama-3.2-1b-instruct-bnb-4bit
tags:
- text-generation-inference
- transformers
- unsloth
- llama
- trl
license: apache-2.0
language:
- en
datasets:
- lextale/FirstAidInstructionsDataset
library_name: transformers
pipeline_tag: text-generation
---

# Model with Attempt to Overwrite PII

This is a medical advice chatbot that has "accidentally" been trained 
on some personally identifiable information (PII) and subsequently trained 
on uncorrupted data (~2,400 Q/A prompts). However, the sensitive 
information is still generated in about 0.5% of responses.

## Model Description

This model is the second in a sequence of Llama3.2-based models showing the
potential of Authentrics.ai software. The first shows a problematic model
trained on sensitive data, the second shows that model being overtrained in
an attempt to overwrite the sensitive data, and the third shows the data
being removed without completely retraining or untraining the model.