Spaces:

edugp
/

perplexity-lenses

Runtime error

App Files Files Community

perplexity-lenses / tests

Ctrl+K

Ctrl+K

1 contributor

History: 2 commits

edugp's picture

Run tokenizer before computing perplexity and format

7b62017 over 3 years ago

__init__.py

0 Bytes

Add tests and fix issue when splitting into sentences, to grab the minimum number between total sentences and sample size, rather than total original documents and sample size over 3 years ago
test_data.py

510 Bytes

Run tokenizer before computing perplexity and format over 3 years ago