honicky
/

pythia-14m-hdfs-logs

Model card Files Files and versions Community

honicky commited on Dec 1, 2024

Commit

ebff8b9

·

verified ·

1 Parent(s): a92a4a6

Add model documentation

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -30,10 +30,10 @@ effectively predict anomalies.  We will then attempt build a model that is more
 ## Training Details
 - Base model: EleutherAI/pythia-14m
 - Dataset: https://zenodo.org/records/8196385/files/HDFS_v1.zip?download=1 + preprocessed data at honicky/log-analysis-hdfs-preprocessed
-- Batch size: 4
 - Max sequence length: 405
 - Learning rate: 0.0001
-- Training steps: 12000
 ## Special Tokens
 - Added `<|sep|>` token for event ID separation

 ## Training Details
 - Base model: EleutherAI/pythia-14m
 - Dataset: https://zenodo.org/records/8196385/files/HDFS_v1.zip?download=1 + preprocessed data at honicky/log-analysis-hdfs-preprocessed
+- Batch size: 16
 - Max sequence length: 405
 - Learning rate: 0.0001
+- Training steps: 30000
 ## Special Tokens
 - Added `<|sep|>` token for event ID separation