feat(pipeline): structural metadata end-to-end (Blocks D2-D4)

D2: RAG service stores section/section_title/paragraph/paragraph_num/page
from embedding service chunks_with_metadata into Qdrant payloads.

D3: Control generator prefers section > article > section_title from
Qdrant, adds page to source_citation and generation_metadata.

D4: Validated with real BGB §§ 312-312k text. Found and fixed critical
bug where Phase 3 overlap destroyed the [§ ...] section prefix, causing
only the first chunk per document to have metadata. All subsequent
chunks lost section info.

Also fixes pre-existing lint issues (unused imports, ambiguous variable
names, duplicate dict key, bare except).

456 tests passing (58 embedding + 387 pipeline + 11 rag-service).

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

This commit is contained in:

Benjamin Admin

2026-05-01 20:34:00 +02:00

parent da21339e76

commit 93099b2770

15 changed files with 1086 additions and 25 deletions

									
										rag-service/tests/conftest.py
									
		+7
		
												View File
												
				@@ -0,0 +1,7 @@

				"""Shared test fixtures for rag-service tests."""

				import os

				import sys

				# Ensure rag-service root is on sys.path so imports resolve

				sys.path.insert(0, os.path.join(os.path.dirname(__file__), ".."))