Spaces:
Running
Running
Commit History
Debugged reference to random_seed in vectorisation and reference to torch in representation_model.py
8216d8c
Importing space package near start of app now to avoid issue with cuda being initialised before
9e84863
Rearranged functions for embeddings creation to be compatible with zero GPU space. Updated packages.
cc495e1
Added example of how to run function from command line. Updated packages. Embedding model default now smaller and at fp16.
34f1e83
Improved initial clean options. Now has option to return embeddings only.
89c4d20
App now retains original index following cleaning to allow for referring back to original data
90553eb
Allowed for app running on AWS to use smaller embedding model and not to load representation LLM (due to size restrictions).
22ca76e
Only aggregate topics not 'other', allowed for minimum sentence length, default max_topics now will auto aggregate topics. Added Cognito Auth functionality (boto3 with AWS).
1e2bb3e
Can split passages into sentences. Improved embedding, LLM representation models, improved zero shot capabilities
55f0ce3
Updated packages. Improve hierarchy vis. Better models - mixedbread and phi3. Now option to split texts into sentences before modelling.
04a15c5
Minor cleaning, csv formatting changes
d80c8f5
Sean-Case
commited on
Reduce outliers now more efficient and relabels with correct vectoriser. Default topic labels now tidier. Hiearchical topics outputs more useful for joining to df afterwards. Switched low resource reduction algorithm to UMAP as default is not good.
e1c1f68
Should now parse custom regex correctly. Will now wipe previously created embeddings if 'low resource mode' option switched.
0a543a0
Sean-Case
commited on
Allowed for uploading custom regex for cleaning. Fixed calculate all probabilities, reduce outliers. Added text tree for hierarchical modelling.
381f959
LLM model save is failing in Huggingface - attempting instead to save to base folder
c2bf185
Sean-Case
commited on
Some text changes. Fixed a couple of TF-IDF embeddings issues
87306c7
Sean-Case
commited on