data_text_search / search_funcs /semantic_ingest_functions.py

Commit History

Improvements with embeddings load and file save
650da6e
Running

seanpedrickcase commited on

Changed embedding model to MiniLM-L6 as faster. Compressed embeddings are now int8. General improvements to API mode
ea0dd40

seanpedrickcase commited on

Changed all intermediate file outputs to save to output folder
fea085c

seanpedrickcase commited on

Allowed for custom output folder, returned Dockerfile to work under user account and port 7860
d3ff2e2

seanpedrickcase commited on

Now checks for output folder before saving. Minor code cleaning
2089141

seanpedrickcase commited on

Fixed cleaning for semantic search. Handles text with backslashes in (if cleaned). Updated packages. requirements file for only keyword search added.
8466e45

seanpedrickcase commited on

Improved code for cleaning and outputting files. Added Dockerfile
4ee3470

Sean-Case commited on

Improved xlsx output formatting. Deals better with cleaning data then analysing in same session.
352c02a

Sean-Case commited on

Updated to Gradio 4.16.0. Now works correctly with BGE embeddings
2bcd818

seanpedrickcase commited on

Cut out semantic search temporarily while issues with Jina gated model resolved. Improved error/progress tracking and messaging. Placeholder for Spacy fuzzy search.
739b386

seanpedrickcase commited on

Better error checking. Doesn't load in embeddings file twice now.
63049fe

Sean-Case commited on

Fixed data input for semantic search. Allowed for docs to be loaded in directly for semantic search. 0.2.1
3df8e40

Sean-Case commited on

Minor changes to file path for outputs, documentation, location of pyinstaller build dependencies
200480d

seanpedrickcase commited on

Many changes to code organisation. More efficient searches from using intermediate outputs. Version 0.1
99d6fba

seanpedrickcase commited on