Benjamin Admin 9e2c301723 Add merged-word splitting to OCR spell review ...

OCR often merges adjacent words when spacing is tight, e.g.
"atmyschool" → "at my school", "goodidea" → "good idea".

New _try_split_merged_word() uses dynamic programming to find the
shortest sequence of dictionary words covering the token. Integrated
as step 5 in _spell_fix_token() after general spell correction.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

2026-04-11 14:11:16 +02:00

..

data

Add German IPA support (wiki-pronunciation-dict + epitran)

2026-03-25 22:18:20 +01:00

mail

…

migrations

Add OCR Kombi Pipeline: modular 11-step architecture with multi-page support

2026-03-26 15:55:28 +01:00

models

…

ocr_kombi

Add OCR Kombi Pipeline: modular 11-step architecture with multi-page support

2026-03-26 15:55:28 +01:00

policies

…

routes

…

services

feat: Sprint 2 — TrOCR ONNX, PP-DocLayout, Model Management

2026-03-23 09:53:02 +01:00

tests

Add merged-word splitting to OCR spell review

2026-04-11 14:11:16 +02:00

admin_api.py

…

config.py

…

country_metadata.py

…

cv_box_detect.py

feat: run shading-based box detection alongside line detection

2026-03-16 08:12:52 +01:00

cv_cell_grid.py

fix: word_boxes auch fuer breite Spalten (Full-Page OCR) speichern

2026-03-11 20:41:29 +01:00

cv_color_detect.py

Fix bullet overlap disambiguation + raise red threshold to 90

2026-03-20 18:21:00 +01:00

cv_doclayout_detect.py

feat: Sprint 2 — TrOCR ONNX, PP-DocLayout, Model Management

2026-03-23 09:53:02 +01:00

cv_graphic_detect.py

feat: Sprint 2 — TrOCR ONNX, PP-DocLayout, Model Management

2026-03-23 09:53:02 +01:00

cv_gutter_repair.py

Skip valid line-break hyphenations in gutter repair

2026-04-11 00:14:21 +02:00

cv_ipa_german.py

Add German IPA support (wiki-pronunciation-dict + epitran)

2026-03-25 22:18:20 +01:00

cv_layout.py

feat: ImageLayoutEditor, arrow-key nav, multi-select bold, wider columns

2026-03-24 07:45:39 +01:00

cv_ocr_engines.py

Fix IPA correction persistence and false-positive prefix matching

2026-03-25 07:26:32 +01:00

cv_preprocessing.py

fix: swap 90°/270° rotation direction in orientation detection

2026-03-17 16:39:15 +01:00

cv_review.py

Add merged-word splitting to OCR spell review

2026-04-11 14:11:16 +02:00

cv_syllable_detect.py

Use spellchecker instead of pyphen for pipe autocorrect validation

2026-03-27 16:47:42 +01:00

cv_vocab_pipeline.py

feat: Words-First Grid Builder (bottom-up alternative zu cell_grid_v2)

2026-03-12 06:46:05 +01:00

cv_vocab_types.py

Add German IPA support (wiki-pronunciation-dict + epitran)

2026-03-25 22:18:20 +01:00

cv_words_first.py

fix(ocr-pipeline): improve page crop spine detection and cell assignment

2026-03-24 09:23:30 +01:00

dsfa_corpus_ingestion.py

…

dsfa_rag_api.py

…

eh_pipeline.py

…

eh_templates.py

…

embedding_client.py

…

full_compliance_pipeline.py

…

full_reingestion.py

…

github_crawler.py

…

grid_editor_api.py

Fix gutter repair: detect short fragments + show spell alternatives

2026-04-10 19:09:12 +02:00

grid_editor_helpers.py

Fix cross-column word assignment by splitting OCR merge artifacts

2026-03-28 10:54:41 +01:00

handwriting_htr_api.py

…

hybrid_search.py

…

hybrid_vocab_extractor.py

…

hyde.py

…

legal_corpus_api.py

…

legal_corpus_ingestion.py

…

legal_corpus_robust.py

…

legal_templates_ingestion.py

…

main.py

Add OCR Kombi Pipeline: modular 11-step architecture with multi-page support

2026-03-26 15:55:28 +01:00

metrics_db.py

…

migrate_rag_chunks.py

…

minio_storage.py

…

nibis_ingestion.py

…

nru_worksheet_generator.py

…

ocr_labeling_api.py

…

ocr_pipeline_api.py

Add Ground Truth regression test system for OCR pipeline

2026-03-18 13:46:48 +01:00

ocr_pipeline_auto.py

refactor: split ocr_pipeline_api.py (5426 lines) into 8 modules

2026-03-18 08:42:00 +01:00

ocr_pipeline_common.py

feat: add Woerterbuch category + column add/delete in grid editor

2026-03-23 16:27:12 +01:00

ocr_pipeline_geometry.py

Invalidate grid_editor_result when exclude regions change

2026-03-19 09:19:09 +01:00

ocr_pipeline_ocr_merge.py

refactor: split ocr_pipeline_api.py (5426 lines) into 8 modules

2026-03-18 08:42:00 +01:00

ocr_pipeline_overlays.py

Preserve alphabetic marker columns, broaden junk filter, enable IPA in grid

2026-03-18 11:08:23 +01:00

ocr_pipeline_postprocess.py

refactor: split ocr_pipeline_api.py (5426 lines) into 8 modules

2026-03-18 08:42:00 +01:00

ocr_pipeline_regression.py

feat: save automatic grid snapshot before manual edits for GT comparison

2026-03-24 13:16:44 +01:00

ocr_pipeline_rows.py

refactor: split ocr_pipeline_api.py (5426 lines) into 8 modules

2026-03-18 08:42:00 +01:00

ocr_pipeline_session_store.py

Show full Grid-Review in Ground Truth step + GT badge in session list

2026-04-10 19:34:32 +02:00

ocr_pipeline_sessions.py

refactor: independent sessions for page-split + URL-based pipeline navigation

2026-03-24 17:05:33 +01:00

ocr_pipeline_words.py

refactor: split ocr_pipeline_api.py (5426 lines) into 8 modules

2026-03-18 08:42:00 +01:00

orientation_crop_api.py

refactor: independent sessions for page-split + URL-based pipeline navigation

2026-03-24 17:05:33 +01:00

page_crop.py

Add camera gutter detection via vertical continuity analysis

2026-04-11 13:58:14 +02:00

pdf_export.py

…

pdf_extraction.py

…

pipeline_checkpoints.py

…

pyproject.toml

…

qdrant_service.py

…

rag_evaluation.py

…

rbac.py

…

requirements.txt

Add German IPA support (wiki-pronunciation-dict + epitran)

2026-03-25 22:18:20 +01:00

reranker.py

…

self_rag.py

…

storage.py

…

template_sources.py

…

tesseract_vocab_extractor.py

…

training_api.py

…

training_export_service.py

…

trocr_api.py

…

upload_api.py

…

vocab_session_store.py

…

vocab_worksheet_api.py

Use grid-build zones for vocab extraction (4-column detection)

2026-04-11 01:17:40 +02:00

worksheet_cleanup_api.py

…

worksheet_editor_api.py

…

zeugnis_api.py

…

zeugnis_crawler.py

…

zeugnis_models.py

…

zeugnis_seed_data.py

…