Set bm25 in functions explicitly. Some API updates. Now can get connection params on startup.

Some package updates and minor changes

embedding files now write to output folder

Changed all intermediate file outputs to save to output folder

Allowed for custom output folder, returned Dockerfile to work under user account and port 7860

Testing not running Dockerfile as user for Lambda compatibility

Modified Dockerfile to run app on port 8080, which Lambda uses

Added Lambda web adapter to Dockerfile. Updated Gradio version

Updated Dockerfile to create output folder correctly and enable regional AWS STS endpoint

Specified boto3 sts region

Correct bm25 filename usage

Now checks for output folder before saving. Minor code cleaning

Fixed cleaning for semantic search. Handles text with backslashes in (if cleaned). Updated packages. requirements file for only keyword search added.

Assigned AWS bucket name to environmental variable

Added additional password auth for AWS-based files. Changed 'Clean' default to no

AWS credentials no longer a requirement for app to work

Gradio 4.21. Limitations on file size and creating embeddings. Added AWS integration

Removed GRADIO_ROOT_PATH from the Dockerfile as it is not necessary for API Gateway access

Updated to latest Gradio version that hopefully solved root_url issues. Added ssl_verify=False to launch

Set SDK version to 4.20.0 on huggingface. Added GRADIO_SERVER_PORT to Dockerfile

set gradio version to 4.18.0, before root path issue reappears

Changed dockerfile gradio_root_path variable

String query not correctly specified in fuzzy search, changed this

ECS not allowing me to save files so increasing container privileges in Dockerfile

set Dockerfile Gradio_root_path environmental variable

Now loads in embedding model locally in Dockerfile

edited Dockerfile slightly

Added small line to dockerfile start. Added dockerignore file for local builds

Improved code for cleaning and outputting files. Added Dockerfile

Improved xlsx output formatting. Deals better with cleaning data then analysing in same session.

Added highlight search term functionality to keyword search output

Updated to Gradio 4.16.0. Now works correctly with BGE embeddings

Upgraded to Gradio 4.16.0. Added Spacy fuzzy search functionality.

Changed intro text

Changed requirements to download correct spacy model version

Cut out semantic search temporarily while issues with Jina gated model resolved. Improved error/progress tracking and messaging. Placeholder for Spacy fuzzy search.

Switch back to Gradio version 3.50.2 as 4 is not working with pyinstaller app creation yet

Better error checking. Doesn't load in embeddings file twice now.

Fixed data input for semantic search. Allowed for docs to be loaded in directly for semantic search. 0.2.1

Minor changes to file path for outputs, documentation, location of pyinstaller build dependencies

Added accelerate to requirements. Minor doc changes

Many changes to code organisation. More efficient searches from using intermediate outputs. Version 0.1

Now works correctly with npz. Minor formatting improvements

Changed in_query to keyword_query

Added polars to requirements

Added semantic search using Jina

Faster embedding with GPU, fast document split, writes to chromadb file correctly. No longer needs FAISS or langchain

Now outputs correct dataframe for semantic search. Can join on extra details

Added to requirements: transformers

Added basic semantic search functionality