Tests and Evidence

Raven Expanded Public Test Catalogue

Expanded public-safe catalogue with status, scope, evidence level, boundary and lessons learned.

Date range2026-03-01 to 2026-07-16

Days covered138

Evidence artifacts13867

Evidence-source records905639

Scenarios counted1247

Replay references1030

Qualification references460

Test references323990

Finding pages233

Expanded Public Test Catalogue

ID	Status	Evidence Level	Scope	Input	Output	Boundary	Evidence	Related Findings	Related Reports	Lessons Learned
TEST-FVV-001	PASS_WITH_ACCEPTED_EXCEPTIONS	INTERNAL_ENGINEERING	requirements baseline, component records, interface contract checks and explicit non-production boundaries	Public-safe artifact set and internal/synthetic programme outputs	PASS_WITH_ACCEPTED_EXCEPTIONS	Internal engineering evidence; production runtime and external validation remain outside this proof.	EV-FORMAL-VV	Phase II Finding set	Phase II Research Reports	Preserve boundary, status and limitations before promotion.
TEST-CONT-001	PASS_WITH_ACCEPTED_EXCEPTIONS	INTERNAL_ENGINEERING	architecture, configuration, targeted regression and public-safe package status	Public-safe artifact set and internal/synthetic programme outputs	PASS_WITH_ACCEPTED_EXCEPTIONS	Internal assurance baseline; not a certification by an external auditor.	EV-CONTINUOUS-ASSURANCE	Phase II Finding set	Phase II Research Reports	Preserve boundary, status and limitations before promotion.
TEST-PRECUST-001	PASS_WITH_ACCEPTED_EXCEPTIONS	INTERNAL_ENGINEERING	A-series internal Finding candidates, validators, promotion gates and disclosure boundaries	Public-safe artifact set and internal/synthetic programme outputs	PASS_WITH_ACCEPTED_EXCEPTIONS	Several candidates remain blocked for human approval, NDA context or stronger evidence.	EV-PRE-CUSTOMER-FINDINGS	Phase II Finding set	Phase II Research Reports	Preserve boundary, status and limitations before promotion.
TEST-SANDBOX-001	PASS_WITH_ACCEPTED_EXCEPTIONS	INTERNAL_ENGINEERING	component execution classification, integration checks, recovery, observability and component honesty	Public-safe artifact set and internal/synthetic programme outputs	PASS_WITH_ACCEPTED_EXCEPTIONS	Some components are adapters, fixtures or contract-only; component honesty is preserved.	EV-SANDBOX-RUNTIME-QUALIFICATION	Phase II Finding set	Phase II Research Reports	Preserve boundary, status and limitations before promotion.
TEST-DEFECT-001	DEFECT_CLOSURE_MATRIX_READY	INTERNAL_ENGINEERING	runtime qualification defect closure, partial closures, externally reviewable issues and pilot-required issues	Public-safe artifact set and internal/synthetic programme outputs	DEFECT_CLOSURE_MATRIX_READY	Closure matrix is not an aggregate production PASS; remaining defects keep their explicit status.	EV-DEFECT-CLOSURE	Phase II Finding set	Phase II Research Reports	Preserve boundary, status and limitations before promotion.
TEST-ISP-TWIN-001	INTERNALLY_REPRODUCIBLE	INTERNAL_SYNTHETIC	regional ISP synthetic signals, blind evaluation, component honesty and decision-packet execution	Public-safe artifact set and internal/synthetic programme outputs	INTERNALLY_REPRODUCIBLE	Synthetic ISP model; customer topology, SLA and live operational context still require pilot intake.	EV-REGIONAL-ISP-TWIN	Phase II Finding set	Phase II Research Reports	Preserve boundary, status and limitations before promotion.
TEST-SOT2-001	PASS in tested scope	INTERNAL_SYNTHETIC	100 deterministic blind synthetic ISP operational scenarios	Public-safe artifact set and internal/synthetic programme outputs	PASS in tested scope	Internal synthetic only; no customer or external validation.	EV-SOT2-100-SCENARIO	Phase II Finding set	Phase II Research Reports	Preserve boundary, status and limitations before promotion.
TEST-ADV-001	Failures preserved; accepted exceptions remain	INTERNAL_ENGINEERING	unfair, incomplete, contradictory and misleading synthetic scenarios	Public-safe artifact set and internal/synthetic programme outputs	Failures preserved; accepted exceptions remain	Used to discover weak behaviour, not to claim broad correctness.	EV-FASTTRACK-PRE-PILOT	Phase II Finding set	Phase II Research Reports	Preserve boundary, status and limitations before promotion.
TEST-RUNTIME-001	PASS_WITH_ACCEPTED_EXCEPTIONS	INTERNAL_ENGINEERING	runtime tests, performance workloads and unauthorized persistent write checks under internal constraints	Public-safe artifact set and internal/synthetic programme outputs	PASS_WITH_ACCEPTED_EXCEPTIONS	Production-like internal tests do not equal customer production activation.	EV-FASTTRACK-PRE-PILOT	Phase II Finding set	Phase II Research Reports	Preserve boundary, status and limitations before promotion.
TEST-AUTON-001	PASS_WITH_ACCEPTED_EXCEPTIONS	INTERNAL_ENGINEERING	defect evidence, production-like runtime boundaries, validation records and accepted exceptions	Public-safe artifact set and internal/synthetic programme outputs	PASS_WITH_ACCEPTED_EXCEPTIONS	Autonomous qualification remains internal and does not replace human or external review.	EV-AUTONOMOUS-QUALIFICATION	Phase II Finding set	Phase II Research Reports	Preserve boundary, status and limitations before promotion.
TEST-RESEARCH-001	PASS_WITH_ACCEPTED_EXCEPTIONS	INTERNAL_ENGINEERING	dossier engine, Finding engine, claim ledger, data requirements and evidence knowledge graph integration	Public-safe artifact set and internal/synthetic programme outputs	PASS_WITH_ACCEPTED_EXCEPTIONS	Category, patent, production RBAC and pilot validation remain bounded workstreams.	EV-RESEARCH-CERTIFICATION	Phase II Finding set	Phase II Research Reports	Preserve boundary, status and limitations before promotion.
TEST-PUBLIC-001	generated as bounded public-safe statements	INTERNAL_ENGINEERING	public evidence release copy, claim boundaries, Voice statements and Mira statements	Public-safe artifact set and internal/synthetic programme outputs	generated as bounded public-safe statements	Browser TTS quality is not a proof of runtime intelligence.	EV-AUTONOMOUS-QUALIFICATION	Phase II Finding set	Phase II Research Reports	Preserve boundary, status and limitations before promotion.