Add Bloom Filter binary and log files for version 1.0.5 in English

ocrqa-wp_v1.0.5-en.bloom

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9c49a55a3409224a8f7102ebe9cce5aad6f67cc4b62039dc3f957aa0b66f6ad8
+size 4787502

ocrqa-wp_v1.0.5-en.bloom.log

@@ -0,0 +1,28 @@
+2025-03-01 01:26:13,631 ocrqa_create_bloom_filter.py:121 INFO: Git version: 5ad02a4
+2025-03-01 01:26:13,631 ocrqa_create_bloom_filter.py:434 INFO: Namespace(input_files=['lex/en/modern_spelling.rw.txt', 'lex/en/enwiki.unigram.freq.tsv.bz2'], bloom_path='build.d/fp_prob_0.00001/ocrqa-wp_v1.0.5-en.bloom', fp_probability=1e-05, log_level='INFO', log_file='build.d/fp_prob_0.00001/ocrqa-wp_v1.0.5-en.bloom.log', config=None, min_frequency=5, single_char_min_frequency=20, diagnose_bloom=True, git_version='5ad02a4')
+2025-03-01 01:26:13,631 ocrqa_create_bloom_filter.py:229 INFO: Starting Bloom Filter creation...
+2025-03-01 01:26:13,631 ocrqa_create_bloom_filter.py:199 INFO: Processing real-word file: lex/en/modern_spelling.rw.txt
+2025-03-01 01:26:13,711 ocrqa_create_bloom_filter.py:138 INFO: Processing frequency file: lex/en/enwiki.unigram.freq.tsv.bz2
+2025-03-01 01:26:13,728 ocrqa_create_bloom_filter.py:163 WARNING: Skipping invalid line in frequency file lex/en/enwiki.unigram.freq.tsv.bz2: 107268
+2025-03-01 01:26:24,792 ocrqa_create_bloom_filter.py:243 INFO: low_freq_excluded before removing parts from high-frequency words: 4575354
+2025-03-01 01:26:24,928 ocrqa_create_bloom_filter.py:251 INFO: low_freq_excluded after removing parts from high-frequency words: 3991288
+2025-03-01 01:26:24,928 ocrqa_create_bloom_filter.py:255 INFO: Lexical processing complete.
+2025-03-01 01:26:24,928 ocrqa_create_bloom_filter.py:259 INFO:   - realwords_read: 129022
+2025-03-01 01:26:24,928 ocrqa_create_bloom_filter.py:259 INFO:   - realwords_accepted: 129137
+2025-03-01 01:26:24,928 ocrqa_create_bloom_filter.py:259 INFO:   - realwords_nonwords_filtered: 0
+2025-03-01 01:26:24,928 ocrqa_create_bloom_filter.py:259 INFO:   - freq_words_read: 9710446
+2025-03-01 01:26:24,928 ocrqa_create_bloom_filter.py:259 INFO:   - words_accepted: 2329192
+2025-03-01 01:26:24,928 ocrqa_create_bloom_filter.py:259 INFO:   - subwords_accepted: 2836196
+2025-03-01 01:26:24,928 ocrqa_create_bloom_filter.py:259 INFO:   - subwords_filtered: 0
+2025-03-01 01:26:24,928 ocrqa_create_bloom_filter.py:259 INFO:   - low_freq_excluded: 3991288
+2025-03-01 01:26:24,928 ocrqa_create_bloom_filter.py:259 INFO:   - invalid_lines_filtered: 1
+2025-03-01 01:26:24,928 ocrqa_create_bloom_filter.py:259 INFO:   - single_char_words_filtered: 10825
+2025-03-01 01:26:24,928 ocrqa_create_bloom_filter.py:259 INFO:   - freq_words_filtered: 7370428
+2025-03-01 01:26:24,928 ocrqa_create_bloom_filter.py:262 INFO: Estimated word count: 1597894
+2025-03-01 01:26:25,315 ocrqa_create_bloom_filter.py:266 INFO: Bloom Filter created and saved to build.d/fp_prob_0.00001/ocrqa-wp_v1.0.5-en.bloom
+2025-03-01 01:26:25,588 ocrqa_create_bloom_filter.py:288 INFO: Diagnosis Results:
+2025-03-01 01:26:25,588 ocrqa_create_bloom_filter.py:289 INFO:   - Excluded words in bloom filter: 0
+2025-03-01 01:26:25,588 ocrqa_create_bloom_filter.py:290 INFO:   - Known words not in bloom filter: 0
+2025-03-01 01:26:26,327 ocrqa_create_bloom_filter.py:297 INFO:   - Low-frequency words in bloom filter: 40
+2025-03-01 01:26:26,327 ocrqa_create_bloom_filter.py:309 INFO:   - Proportion of known words not in bloom filter: 0.00000000
+2025-03-01 01:26:26,327 ocrqa_create_bloom_filter.py:317 INFO:   - Proportion of low-frequency words in bloom filter: 0.00001002