Benjamin Admin b8f1b71652 Fix: merge cell-wrap continuation rows in vocabulary extraction ...

When textbook authors wrap text within a cell (e.g. long German
translations), OCR treats each physical line as a separate row.
New _merge_wrapped_rows() detects this by checking if the primary
column (EN) is empty — indicating a continuation, not a new entry.

Handles: empty EN + DE text, empty EN + example text, parenthetical
continuations like "(bei)", triple wraps, comma-separated lists.

12 tests added covering all cases.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

2026-04-16 08:32:45 +02:00

..

data

Add German IPA support (wiki-pronunciation-dict + epitran)

2026-03-25 22:18:20 +01:00

mail

…

migrations

Add OCR Kombi Pipeline: modular 11-step architecture with multi-page support

2026-03-26 15:55:28 +01:00

models

…

ocr_kombi

Add OCR Kombi Pipeline: modular 11-step architecture with multi-page support

2026-03-26 15:55:28 +01:00

policies

…

routes

…

services

feat: Sprint 2 — TrOCR ONNX, PP-DocLayout, Model Management

2026-03-23 09:53:02 +01:00

tests

Fix: merge cell-wrap continuation rows in vocabulary extraction

2026-04-16 08:32:45 +02:00

admin_api.py

…

config.py

…

country_metadata.py

…

cv_box_detect.py

feat: run shading-based box detection alongside line detection

2026-03-16 08:12:52 +01:00

cv_box_layout.py

Bullet indentation detection: group continuation lines into bullets

2026-04-13 16:57:16 +02:00

cv_cell_grid.py

Fix: merge cell-wrap continuation rows in vocabulary extraction

2026-04-16 08:32:45 +02:00

cv_color_detect.py

Fix bullet overlap disambiguation + raise red threshold to 90

2026-03-20 18:21:00 +01:00

cv_doclayout_detect.py

feat: Sprint 2 — TrOCR ONNX, PP-DocLayout, Model Management

2026-03-23 09:53:02 +01:00

cv_graphic_detect.py

feat: Sprint 2 — TrOCR ONNX, PP-DocLayout, Model Management

2026-03-23 09:53:02 +01:00

cv_gutter_repair.py

Fix gutter repair: don't suggest corrections for words with parentheses

2026-04-15 22:38:22 +02:00

cv_ipa_german.py

Add German IPA support (wiki-pronunciation-dict + epitran)

2026-03-25 22:18:20 +01:00

cv_layout.py

feat: ImageLayoutEditor, arrow-key nav, multi-select bold, wider columns

2026-03-24 07:45:39 +01:00

cv_ocr_engines.py

Preserve = and (= tokens in grid build and cell text cleanup

2026-04-15 23:04:27 +02:00

cv_preprocessing.py

fix: swap 90°/270° rotation direction in orientation detection

2026-03-17 16:39:15 +01:00

cv_review.py

Add SmartSpellChecker + refactor vocab-worksheet page.tsx

2026-04-12 12:25:01 +02:00

cv_syllable_detect.py

Use spellchecker instead of pyphen for pipe autocorrect validation

2026-03-27 16:47:42 +01:00

cv_vocab_pipeline.py

feat: Words-First Grid Builder (bottom-up alternative zu cell_grid_v2)

2026-03-12 06:46:05 +01:00

cv_vocab_types.py

Add German IPA support (wiki-pronunciation-dict + epitran)

2026-03-25 22:18:20 +01:00

cv_words_first.py

fix(ocr-pipeline): improve page crop spine detection and cell assignment

2026-03-24 09:23:30 +01:00

dsfa_corpus_ingestion.py

…

dsfa_rag_api.py

…

eh_pipeline.py

…

eh_templates.py

…

embedding_client.py

…

full_compliance_pipeline.py

…

full_reingestion.py

…

github_crawler.py

…

grid_build_core.py

Rule (a2): switch from allow-list to block-list for symbol removal

2026-04-15 23:34:21 +02:00

grid_editor_api.py

Refactor: extract _build_grid_core into grid_build_core.py + clean StepAnsicht

2026-04-15 08:54:55 +02:00

grid_editor_helpers.py

Fix NameError: span_cells removed but still referenced in log

2026-04-13 12:20:11 +02:00

handwriting_htr_api.py

…

hybrid_search.py

…

hybrid_vocab_extractor.py

…

hyde.py

…

legal_corpus_api.py

…

legal_corpus_ingestion.py

…

legal_corpus_robust.py

…

legal_templates_ingestion.py

…

main.py

Add OCR Kombi Pipeline: modular 11-step architecture with multi-page support

2026-03-26 15:55:28 +01:00

metrics_db.py

…

migrate_rag_chunks.py

…

minio_storage.py

…

nibis_ingestion.py

…

nru_worksheet_generator.py

…

ocr_labeling_api.py

…

ocr_pipeline_api.py

Add Ground Truth regression test system for OCR pipeline

2026-03-18 13:46:48 +01:00

ocr_pipeline_auto.py

refactor: split ocr_pipeline_api.py (5426 lines) into 8 modules

2026-03-18 08:42:00 +01:00

ocr_pipeline_common.py

feat: add Woerterbuch category + column add/delete in grid editor

2026-03-23 16:27:12 +01:00

ocr_pipeline_geometry.py

Invalidate grid_editor_result when exclude regions change

2026-03-19 09:19:09 +01:00

ocr_pipeline_ocr_merge.py

refactor: split ocr_pipeline_api.py (5426 lines) into 8 modules

2026-03-18 08:42:00 +01:00

ocr_pipeline_overlays.py

Preserve alphabetic marker columns, broaden junk filter, enable IPA in grid

2026-03-18 11:08:23 +01:00

ocr_pipeline_postprocess.py

refactor: split ocr_pipeline_api.py (5426 lines) into 8 modules

2026-03-18 08:42:00 +01:00

ocr_pipeline_regression.py

feat: save automatic grid snapshot before manual edits for GT comparison

2026-03-24 13:16:44 +01:00

ocr_pipeline_rows.py

refactor: split ocr_pipeline_api.py (5426 lines) into 8 modules

2026-03-18 08:42:00 +01:00

ocr_pipeline_session_store.py

Show full Grid-Review in Ground Truth step + GT badge in session list

2026-04-10 19:34:32 +02:00

ocr_pipeline_sessions.py

Fix multi-page PDF upload: include session_id for first page

2026-04-11 16:26:25 +02:00

ocr_pipeline_words.py

refactor: split ocr_pipeline_api.py (5426 lines) into 8 modules

2026-03-18 08:42:00 +01:00

orientation_crop_api.py

refactor: independent sessions for page-split + URL-based pipeline navigation

2026-03-24 17:05:33 +01:00

page_crop.py

Fix left-side gutter detection: find peak instead of scanning from edge

2026-04-11 16:52:23 +02:00

pdf_export.py

…

pdf_extraction.py

…

pipeline_checkpoints.py

…

pyproject.toml

…

qdrant_service.py

…

rag_evaluation.py

…

rbac.py

…

requirements.txt

Add German IPA support (wiki-pronunciation-dict + epitran)

2026-03-25 22:18:20 +01:00

reranker.py

…

self_rag.py

…

smart_spell.py

Fix SmartSpellChecker: preserve leading non-alpha text like (=

2026-04-15 23:41:33 +02:00

storage.py

…

template_sources.py

…

tesseract_vocab_extractor.py

…

training_api.py

…

training_export_service.py

…

trocr_api.py

…

unified_grid.py

Unified Grid: merge all zones into single Excel-like grid

2026-04-14 23:37:55 +02:00

upload_api.py

…

vocab_learn_bridge.py

Add interactive learning modules MVP (Phases 1-3.1)

2026-04-16 07:13:23 +02:00

vocab_session_store.py

…

vocab_worksheet_api.py

Add interactive learning modules MVP (Phases 1-3.1)

2026-04-16 07:13:23 +02:00

worksheet_cleanup_api.py

…

worksheet_editor_api.py

…

zeugnis_api.py

…

zeugnis_crawler.py

…

zeugnis_models.py

…

zeugnis_seed_data.py

…