mirror of
https://github.com/semantica-agi/semantica.git
synced 2026-09-10 04:00:35 +00:00
KaifAhmad1andClaude Sonnet 4.6
946a1089c8
- Migrate from mint.json to docs.json (Mintlify v4) - Theme: maple, emerald green + near-black dark / cream light palette (#059669 primary, #0A0A0A dark bg, #FAF7F0 light bg) - Typography: Lexend headings, Inter body - 5-tab navigation: Documentation, Quick Start, API Reference, Cookbook, FAQ - Homepage: removed badge stickers, redundant h2, added blockquote tagline, full 27-module reference table with semantica.mcp_server added - quickstart.md: CodeGroup per pipeline step, pattern vs LLM options, AccordionGroup for patterns and troubleshooting - faq.md: full AccordionGroup structure across 5 sections - reference/explorer.md: NEW — FastAPI explorer, Ontology Hub, Distance Intelligence, CLI reference, REST API endpoints - reference/mcp_server.md: NEW — MCP stdio server, 12 tools with I/O examples, 3 resources, Claude Desktop/VS Code/Windsurf/Cline config - docs.json: explorer added to Output group, mcp_server to Utilities group - Chat, feedback (thumbs/suggest/raise), OG/Twitter metadata, search topbar - All reference pages reformatted with Mintlify JSX components Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
45 lines
1.4 KiB
Markdown
45 lines
1.4 KiB
Markdown
---
|
|
title: "Evals Module"
|
|
description: "Evaluation framework for measuring Knowledge Graph quality, extraction accuracy, and pipeline performance."
|
|
icon: "chart-line"
|
|
---
|
|
|
|
> Measure and benchmark Knowledge Graph quality, extraction accuracy, and pipeline performance.
|
|
|
|
<Warning>
|
|
**Coming Soon** — This module is currently in active development. Documentation will be available in an upcoming release.
|
|
</Warning>
|
|
|
|
---
|
|
|
|
## Planned Capabilities
|
|
|
|
The Evals module will provide a comprehensive evaluation framework covering:
|
|
|
|
| Area | What It Measures |
|
|
|------|-----------------|
|
|
| **KG Quality** | Completeness, consistency, schema compliance |
|
|
| **Extraction Accuracy** | NER precision/recall/F1, relation extraction metrics |
|
|
| **Pipeline Performance** | Throughput, latency, error rates per step |
|
|
| **Deduplication** | Merge accuracy, false positive/negative rates |
|
|
| **Reasoning** | Inference correctness, rule coverage |
|
|
|
|
---
|
|
|
|
## See Also
|
|
|
|
<CardGroup cols={2}>
|
|
<Card title="Semantic Extract" icon="magnifying-glass" href="semantic_extract">
|
|
Extraction module to evaluate.
|
|
</Card>
|
|
<Card title="Knowledge Graph" icon="diagram-project" href="kg">
|
|
Graph quality assessment.
|
|
</Card>
|
|
<Card title="Pipeline" icon="gear" href="pipeline">
|
|
Pipeline performance metrics.
|
|
</Card>
|
|
<Card title="Deduplication" icon="copy" href="deduplication">
|
|
Deduplication accuracy evaluation.
|
|
</Card>
|
|
</CardGroup>
|