Files
semantica/docs/reference/evals.md
T
KaifAhmad1andClaude Sonnet 4.6 946a1089c8 docs: premium redesign — Mintlify v4, dark/cream theme, full module coverage
- Migrate from mint.json to docs.json (Mintlify v4)
- Theme: maple, emerald green + near-black dark / cream light palette
  (#059669 primary, #0A0A0A dark bg, #FAF7F0 light bg)
- Typography: Lexend headings, Inter body
- 5-tab navigation: Documentation, Quick Start, API Reference, Cookbook, FAQ
- Homepage: removed badge stickers, redundant h2, added blockquote tagline,
  full 27-module reference table with semantica.mcp_server added
- quickstart.md: CodeGroup per pipeline step, pattern vs LLM options,
  AccordionGroup for patterns and troubleshooting
- faq.md: full AccordionGroup structure across 5 sections
- reference/explorer.md: NEW — FastAPI explorer, Ontology Hub, Distance
  Intelligence, CLI reference, REST API endpoints
- reference/mcp_server.md: NEW — MCP stdio server, 12 tools with I/O
  examples, 3 resources, Claude Desktop/VS Code/Windsurf/Cline config
- docs.json: explorer added to Output group, mcp_server to Utilities group
- Chat, feedback (thumbs/suggest/raise), OG/Twitter metadata, search topbar
- All reference pages reformatted with Mintlify JSX components

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-05-22 21:52:50 +05:30

1.4 KiB

title, description, icon
title description icon
Evals Module Evaluation framework for measuring Knowledge Graph quality, extraction accuracy, and pipeline performance. chart-line

Measure and benchmark Knowledge Graph quality, extraction accuracy, and pipeline performance.

**Coming Soon** — This module is currently in active development. Documentation will be available in an upcoming release.

Planned Capabilities

The Evals module will provide a comprehensive evaluation framework covering:

Area What It Measures
KG Quality Completeness, consistency, schema compliance
Extraction Accuracy NER precision/recall/F1, relation extraction metrics
Pipeline Performance Throughput, latency, error rates per step
Deduplication Merge accuracy, false positive/negative rates
Reasoning Inference correctness, rule coverage

See Also

Extraction module to evaluate. Graph quality assessment. Pipeline performance metrics. Deduplication accuracy evaluation.