Some checks failed
Tests / Go Tests (push) Has been cancelled
Tests / Python Tests (push) Has been cancelled
Tests / Integration Tests (push) Has been cancelled
Tests / Go Lint (push) Has been cancelled
Tests / Python Lint (push) Has been cancelled
Tests / Security Scan (push) Has been cancelled
Tests / All Checks Passed (push) Has been cancelled
Security Scanning / Secret Scanning (push) Has been cancelled
Security Scanning / Dependency Vulnerability Scan (push) Has been cancelled
Security Scanning / Go Security Scan (push) Has been cancelled
Security Scanning / Python Security Scan (push) Has been cancelled
Security Scanning / Node.js Security Scan (push) Has been cancelled
Security Scanning / Docker Image Security (push) Has been cancelled
Security Scanning / Security Summary (push) Has been cancelled
CI/CD Pipeline / Go Tests (push) Has been cancelled
CI/CD Pipeline / Python Tests (push) Has been cancelled
CI/CD Pipeline / Website Tests (push) Has been cancelled
CI/CD Pipeline / Linting (push) Has been cancelled
CI/CD Pipeline / Security Scan (push) Has been cancelled
CI/CD Pipeline / Docker Build & Push (push) Has been cancelled
CI/CD Pipeline / Integration Tests (push) Has been cancelled
CI/CD Pipeline / Deploy to Staging (push) Has been cancelled
CI/CD Pipeline / Deploy to Production (push) Has been cancelled
CI/CD Pipeline / CI Summary (push) Has been cancelled
ci/woodpecker/manual/build-ci-image Pipeline was successful
ci/woodpecker/manual/main Pipeline failed
All services: admin-v2, studio-v2, website, ai-compliance-sdk, consent-service, klausur-service, voice-service, and infrastructure. Large PDFs and compiled binaries excluded via .gitignore.
50 lines
1.2 KiB
Python
50 lines
1.2 KiB
Python
"""
|
|
BQAS - Breakpilot Quality Assurance System
|
|
|
|
LLM-based quality assurance framework for voice service with:
|
|
- LLM Judge (Qwen2.5-32B based evaluation)
|
|
- RAG Judge (Specialized RAG/Correction evaluation)
|
|
- Synthetic Test Generation
|
|
- Golden Test Suite
|
|
- Regression Tracking
|
|
- Automated Backlog Generation
|
|
- Local Scheduler (Alternative zu GitHub Actions)
|
|
"""
|
|
|
|
from bqas.judge import LLMJudge, JudgeResult
|
|
from bqas.rag_judge import (
|
|
RAGJudge,
|
|
RAGRetrievalResult,
|
|
RAGOperatorResult,
|
|
RAGHallucinationResult,
|
|
RAGPrivacyResult,
|
|
RAGNamespaceResult,
|
|
)
|
|
from bqas.metrics import BQASMetrics, TestResult
|
|
from bqas.config import BQASConfig
|
|
from bqas.runner import BQASRunner, get_runner, TestRun
|
|
|
|
# Notifier wird separat importiert (keine externen Abhaengigkeiten)
|
|
# Nutzung: from bqas.notifier import BQASNotifier, Notification, NotificationConfig
|
|
|
|
__all__ = [
|
|
# Intent Judge
|
|
"LLMJudge",
|
|
"JudgeResult",
|
|
# RAG Judge
|
|
"RAGJudge",
|
|
"RAGRetrievalResult",
|
|
"RAGOperatorResult",
|
|
"RAGHallucinationResult",
|
|
"RAGPrivacyResult",
|
|
"RAGNamespaceResult",
|
|
# Metrics & Config
|
|
"BQASMetrics",
|
|
"TestResult",
|
|
"BQASConfig",
|
|
# Runner
|
|
"BQASRunner",
|
|
"get_runner",
|
|
"TestRun",
|
|
]
|