abstracts-index / app.py

Commit History

Minimize ZeroGPU utilization time by cutting out SentenceTransformer overhead
303669c
Running

colonelwatch commited on

Drop batching because ZeroGPU crashes with it enabled
65eeead

colonelwatch commited on

Drop Self, which was added in Python 3.11
561e8f7

colonelwatch commited on

Replace batched, which was added in Python 3.12
c1a9185

colonelwatch commited on

Fix f-string handling
aafd588

colonelwatch commited on

Handle pre-defined version of ZeroGPU spaces
2df5624

colonelwatch commited on

Bump SDK version, update descriptions
3fa4157

colonelwatch commited on

Replace broken submodule with a download scheme
fb6a589

colonelwatch commited on

Pull in index from new repository, due to LFS size limits on HF Spaces
92365df

colonelwatch commited on

Add a better reference to the model and the date of the dataset to the description
b37a6fe

colonelwatch commited on

Automatically determine the quantity
c4788e3

colonelwatch commited on

Compute the similarity instead of the distance if applicable
7bb8a83

colonelwatch commited on

Update imports, disable caching in datasets library
138f923

colonelwatch commited on

Drop the plan to use shards
d56bf2d

colonelwatch commited on

Merge the index on disk to keep file sizes under 4GB
2db96ca

colonelwatch commited on

Use faiss.IO_FLAG_ONDISK_SAME_DIR
67dc9b0

colonelwatch commited on

Normalize column names
95aa608

colonelwatch commited on

Handle new params.json format, including truncation and normalization
4751a57

colonelwatch commited on

Add prompt name as an env var option
a8b8684

colonelwatch commited on

Compile the model for lower latency
c574006

colonelwatch commited on

Sort imports in app.py
fd084a4

colonelwatch commited on

Run model on GPU and add fp16 and trust_remote_code options
22ed20d

colonelwatch commited on

Update top comment
2c87116

colonelwatch commited on

Resolve TODO as won't do and use correct float type for env var
8b17b49

colonelwatch commited on

Create main function, add generic get_env_var function
030ddc3

colonelwatch commited on

Implement request batching
a228730

colonelwatch commited on

Update strings and whitespace
2a39b6d

colonelwatch commited on

Replace gr.Group with gr.Markdown with container=True
09fb3b0

colonelwatch commited on

Redo format_response to be more serial
5db389f

colonelwatch commited on

Purge dead gradio code
cdb1b8c

colonelwatch commited on

Properly handle a null abstract
3a20953

colonelwatch commited on

Shuffle around contents of execute_request, format_response, and search
ddc3a5a

colonelwatch commited on

Roll parsing into Work dataclass classmethod
9cee2a5

colonelwatch commited on

Type and clean up recover_abstract function
f5e5f81

colonelwatch commited on

Create and clean up function declarations
abd37c8

colonelwatch commited on

Initial rework to handle new index format
09f2d58

colonelwatch commited on

Cover no author name edge case
628360c

colonelwatch commited on

Fixup abstracts edge case detection
1d3a47f

colonelwatch commited on

Cover missing title edge case
e2d494c

colonelwatch commited on

Add link to main Github repo
92f5352

colonelwatch commited on

Add missing newlines
b183fcb

colonelwatch commited on

Cover null-abstract edge case
889b529

colonelwatch commited on

Rename idxs.txt to openalex_ids.txt
3cf3964

colonelwatch commited on

Double nlist, halve nprobes
e7eed8f

colonelwatch commited on

Push index performance up to ~70%
70fd5de

colonelwatch commited on

Add index and app.py, update 2023-05-10
2428d17

colonelwatch commited on