Spaces:

edugp
/

perplexity-lenses

Runtime error

App Files Files Community

perplexity-lenses / perplexity_lenses

Ctrl+K

Ctrl+K

1 contributor

History: 9 commits

edugp's picture

Replicate default cc_net preprocessing at inference time on KenlmModel.get_perplexity

0def03f over 3 years ago

__init__.py

22 Bytes

Support visualizing both sentences and whole documents. Smooth down color assignment in visualization. over 3 years ago
data.py

1.75 kB

Add tests and fix issue when splitting into sentences, to grab the minimum number between total sentences and sample size, rather than total original documents and sample size over 3 years ago
engine.py

2.76 kB

Format file over 3 years ago
perplexity.py
3.84 kB

Replicate default cc_net preprocessing at inference time on KenlmModel.get_perplexity over 3 years ago
visualization.py

1.63 kB

Support visualizing both sentences and whole documents. Smooth down color assignment in visualization. over 3 years ago