Benjamin Admin 96ea23164d Fix word-gap merge: add missing pronouns to stop words, reduce threshold ...

- Add du/dich/dir/mich/mir/uns/euch/ihm/ihn to _STOP_WORDS to prevent
  false merges like "du" + "zerlegst" → "duzerlegst"
- Reduce max_short threshold from 6 to 5 to prevent merging multi-word
  phrases like "ziehen lassen" → "ziehenlassen"

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

2026-03-27 15:35:12 +01:00

..

data

Add German IPA support (wiki-pronunciation-dict + epitran)

2026-03-25 22:18:20 +01:00

mail

…

migrations

Add OCR Kombi Pipeline: modular 11-step architecture with multi-page support

2026-03-26 15:55:28 +01:00

models

…

ocr_kombi

Add OCR Kombi Pipeline: modular 11-step architecture with multi-page support

2026-03-26 15:55:28 +01:00

policies

…

routes

…

services

feat: Sprint 2 — TrOCR ONNX, PP-DocLayout, Model Management

2026-03-23 09:53:02 +01:00

tests

fix(ocr-pipeline): improve page crop spine detection and cell assignment

2026-03-24 09:23:30 +01:00

admin_api.py

…

config.py

…

country_metadata.py

…

cv_box_detect.py

feat: run shading-based box detection alongside line detection

2026-03-16 08:12:52 +01:00

cv_cell_grid.py

…

cv_color_detect.py

Fix bullet overlap disambiguation + raise red threshold to 90

2026-03-20 18:21:00 +01:00

cv_doclayout_detect.py

feat: Sprint 2 — TrOCR ONNX, PP-DocLayout, Model Management

2026-03-23 09:53:02 +01:00

cv_graphic_detect.py

feat: Sprint 2 — TrOCR ONNX, PP-DocLayout, Model Management

2026-03-23 09:53:02 +01:00

cv_ipa_german.py

Add German IPA support (wiki-pronunciation-dict + epitran)

2026-03-25 22:18:20 +01:00

cv_layout.py

feat: ImageLayoutEditor, arrow-key nav, multi-select bold, wider columns

2026-03-24 07:45:39 +01:00

cv_ocr_engines.py

Fix IPA correction persistence and false-positive prefix matching

2026-03-25 07:26:32 +01:00

cv_preprocessing.py

fix: swap 90°/270° rotation direction in orientation detection

2026-03-17 16:39:15 +01:00

cv_review.py

…

cv_syllable_detect.py

Fix word-gap merge: add missing pronouns to stop words, reduce threshold

2026-03-27 15:35:12 +01:00

cv_vocab_pipeline.py

feat: Words-First Grid Builder (bottom-up alternative zu cell_grid_v2)

2026-03-12 06:46:05 +01:00

cv_vocab_types.py

Add German IPA support (wiki-pronunciation-dict + epitran)

2026-03-25 22:18:20 +01:00

cv_words_first.py

fix(ocr-pipeline): improve page crop spine detection and cell assignment

2026-03-24 09:23:30 +01:00

dsfa_corpus_ingestion.py

…

dsfa_rag_api.py

…

eh_pipeline.py

…

eh_templates.py

…

embedding_client.py

…

full_compliance_pipeline.py

…

full_reingestion.py

…

github_crawler.py

…

grid_editor_api.py

Fix 4 Grid Editor bugs: syllable modes, heading detection, word gaps

2026-03-27 15:24:35 +01:00

grid_editor_helpers.py

Fix 4 Grid Editor bugs: syllable modes, heading detection, word gaps

2026-03-27 15:24:35 +01:00

handwriting_htr_api.py

…

hybrid_search.py

…

hybrid_vocab_extractor.py

…

hyde.py

…

legal_corpus_api.py

…

legal_corpus_ingestion.py

…

legal_corpus_robust.py

…

legal_templates_ingestion.py

…

main.py

Add OCR Kombi Pipeline: modular 11-step architecture with multi-page support

2026-03-26 15:55:28 +01:00

metrics_db.py

…

migrate_rag_chunks.py

…

minio_storage.py

…

nibis_ingestion.py

…

nru_worksheet_generator.py

…

ocr_labeling_api.py

…

ocr_pipeline_api.py

Add Ground Truth regression test system for OCR pipeline

2026-03-18 13:46:48 +01:00

ocr_pipeline_auto.py

refactor: split ocr_pipeline_api.py (5426 lines) into 8 modules

2026-03-18 08:42:00 +01:00

ocr_pipeline_common.py

feat: add Woerterbuch category + column add/delete in grid editor

2026-03-23 16:27:12 +01:00

ocr_pipeline_geometry.py

Invalidate grid_editor_result when exclude regions change

2026-03-19 09:19:09 +01:00

ocr_pipeline_ocr_merge.py

refactor: split ocr_pipeline_api.py (5426 lines) into 8 modules

2026-03-18 08:42:00 +01:00

ocr_pipeline_overlays.py

Preserve alphabetic marker columns, broaden junk filter, enable IPA in grid

2026-03-18 11:08:23 +01:00

ocr_pipeline_postprocess.py

refactor: split ocr_pipeline_api.py (5426 lines) into 8 modules

2026-03-18 08:42:00 +01:00

ocr_pipeline_regression.py

feat: save automatic grid snapshot before manual edits for GT comparison

2026-03-24 13:16:44 +01:00

ocr_pipeline_rows.py

refactor: split ocr_pipeline_api.py (5426 lines) into 8 modules

2026-03-18 08:42:00 +01:00

ocr_pipeline_session_store.py

Add OCR Kombi Pipeline: modular 11-step architecture with multi-page support

2026-03-26 15:55:28 +01:00

ocr_pipeline_sessions.py

refactor: independent sessions for page-split + URL-based pipeline navigation

2026-03-24 17:05:33 +01:00

ocr_pipeline_words.py

refactor: split ocr_pipeline_api.py (5426 lines) into 8 modules

2026-03-18 08:42:00 +01:00

orientation_crop_api.py

refactor: independent sessions for page-split + URL-based pipeline navigation

2026-03-24 17:05:33 +01:00

page_crop.py

fix(ocr-pipeline): improve page crop spine detection and cell assignment

2026-03-24 09:23:30 +01:00

pdf_export.py

…

pdf_extraction.py

…

pipeline_checkpoints.py

…

pyproject.toml

…

qdrant_service.py

…

rag_evaluation.py

…

rbac.py

…

requirements.txt

Add German IPA support (wiki-pronunciation-dict + epitran)

2026-03-25 22:18:20 +01:00

reranker.py

…

self_rag.py

…

storage.py

…

template_sources.py

…

tesseract_vocab_extractor.py

…

training_api.py

…

training_export_service.py

…

trocr_api.py

…

upload_api.py

…

vocab_session_store.py

…

vocab_worksheet_api.py

…

worksheet_cleanup_api.py

…

worksheet_editor_api.py

…

zeugnis_api.py

…

zeugnis_crawler.py

…

zeugnis_models.py

…

zeugnis_seed_data.py

…