Commit Graph
1303 Commits
Author SHA1 Message Date
KaifAhmad1andClaude Sonnet 4.6 68b8b370d6 fix: address PR #434 code-quality review findings
- add_decision: pass valid_from/valid_until through kwargs path so
  temporal bounds are not silently dropped into metadata (Codex P1)
- add_decision: raise ValueError when Decision object and kwargs are
  both provided, instead of silently ignoring the kwargs (Codex P2)
- fix guard condition to exclude decision_maker (non-None default)
  to avoid false-positive ValueError on plain add_decision(obj) calls
- test_395: remove unused `import time`; strengthen as_of test with
  concrete assertions on scenarios list (github-code-quality)
- test_unreleased: remove unused `import time`; drop unused `snap =`
  assignment; drop unused `provider =` assignment (github-code-quality)

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-04-02 20:34:59 +05:30
KaifAhmad1andClaude Sonnet 4.6 f8ec5ac010 test: cover add_decision kwargs form and VectorStore inmemory backend
- test_add_decision_kwargs_form: verifies add_decision() accepts kwargs
  directly (category, scenario, reasoning, outcome, confidence) without
  requiring a Decision object
- test_add_decision_kwargs_and_object_both_return_id: verifies both call
  forms return a non-empty string ID
- test_agent_context_inmemory_store_and_retrieve: verifies AgentContext
  with VectorStore(backend="inmemory") stores memories without faiss-cpu

Closes #433

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-04-02 20:25:34 +05:30
KaifAhmad1andClaude Sonnet 4.6 40fe1d587a chore: remove docs/bugs folder
Not needed — issue tracked in #433 and fix is self-contained in the code and existing docs.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-04-02 20:20:19 +05:30
KaifAhmad1andClaude Sonnet 4.6 29a608f60e fix: add_decision kwargs support and quickstart VectorStore backend
Fixes #433

- ContextGraph.add_decision() now accepts keyword arguments (category,
  scenario, reasoning, outcome, confidence, entities, decision_maker)
  in addition to a Decision object, matching documented behaviour.
  Both call forms return the decision ID string.
- Quickstart snippets in README, getting-started.md, and index.md
  changed from VectorStore(backend="faiss") to VectorStore(backend="inmemory")
  so they work without faiss-cpu installed.
- docs/reference/context.md methods table updated to reflect the dual
  signature of add_decision().
- docs/bugs/quickstart_api_mismatch.md added to track the issue.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-04-02 20:16:56 +05:30
KaifAhmad1andClaude Sonnet 4.6 4f0cf282a1 test: add comprehensive test suites for Temporal Semantics (#395) and all Unreleased changelog features
- tests/test_395_temporal_semantics_comprehensive.py — 113 tests covering
  #396–#399: bitemporal model, temporal consistency validation, query
  time-range aggregation, ContextGraph.state_at(), causal chain trace_at_time()
- tests/test_unreleased_changelog_comprehensive.py — 92 tests covering all
  unreleased changelog gaps: AgentContext checkpoints (#399), audit trail /
  named tags / rollback protection (#394), snapshot schema compatibility (#393),
  ContextGraph pagination & min_weight & thread safety (#385), SKOS helpers
  (#319), SHACL quality tiers & export (#318), OllamaProvider base_url (#408),
  DatalogReasoner multi-hop & graph load (#371)

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-03-28 18:44:03 +05:30
Mohd Kaif ebfce8c5ab Merge pull request #416 from Hawksight-AI/ontology
feat(#319): SKOS Vocabulary Module
2026-03-28 14:23:40 +05:30
KaifAhmad1andClaude Sonnet 4.6 34bc7a45b9 docs(#319): add CHANGELOG entry for SKOS Vocabulary Module
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-03-28 14:15:02 +05:30
KaifAhmad1andClaude Sonnet 4.6 71d037f581 feat(#319): SKOS Vocabulary Module — namespace helpers, store helpers, OntologyEngine APIs, tests, docs
Extends the existing ontology and triplet-store stack with first-class
SKOS support without adding any new top-level packages.

### semantica/ontology/namespace_manager.py
- `get_skos_uri(local_name)` — build full skos:core# URI from local name
- `build_concept_scheme_uri(name)` — slug a human name into a stable
  ConceptScheme URI anchored at the configured base URI

### semantica/triplet_store/triplet_store.py
- `add_skos_concept(concept_uri, scheme_uri, pref_label, ...)` — asserts
  ConceptScheme + Concept triples, prefLabel, altLabel, broader, narrower,
  related, definition, notation via existing `add_triplets()` API
- `get_skos_concepts(scheme_uri=None)` — SPARQL SELECT via `execute_query()`,
  collapses multi-valued bindings into concept dicts

### semantica/ontology/engine.py
- `list_vocabularies()` — list all skos:ConceptScheme instances
- `list_concepts(scheme_uri)` — list concepts in a scheme with alt labels
- `search_concepts(query, scheme_uri=None)` — case-insensitive substring
  search over prefLabel + altLabel; sanitises user input against SPARQL injection

### tests
- `TestSKOSOntologyEngine` (14 tests) in test_ontology_comprehensive.py
- `TestSKOSTripletStore` (6 tests) in test_triplet_store.py
- All 1162 existing + new tests pass, 0 failures

### docs/reference/ontology.md
- New "SKOS Vocabulary Management" section: data-model table, import
  examples (add_skos_concept + rdflib bulk), list/search API, NamespaceManager helpers

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-03-28 13:59:23 +05:30
Mohd Kaif 6651386074 Merge pull request #415 from Hawksight-AI/ontology
SHACL Shape Generation & Validation
2026-03-27 18:08:03 +05:30
KaifAhmad1andClaude Sonnet 4.6 a219c2f44e docs(#318): add CHANGELOG entry for SHACL Shape Generation & Validation
Covers Phase 1 (generation), Phase 2 (runtime validation), all 5
security/reliability fixes, test results, and README updates.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-03-27 17:56:07 +05:30
KaifAhmad1andClaude Sonnet 4.6 dae368532c feat(#318): SHACL Shape Generation & Validation (Phase 1 + Phase 2)
Phase 1 — Generation:
- Add SHACLGenerator, SHACLGraph, NodeShape, PropertyShape to ontology_generator.py
- 6-stage pipeline: class index → node shapes → property shapes → inheritance propagation → quality tier → serialization
- Three output formats: Turtle, JSON-LD, N-Triples
- Three quality tiers: basic / standard (default) / strict (sh:closed)
- 3-level+ inheritance propagation, cycle-safe, no duplicate shapes
- No-domain properties attach to all node shapes
- OntologyEngine.to_shacl(), export_shacl() added to engine.py
- RDFExporter.export_shacl() added to rdf_exporter.py

Phase 2 — Runtime Validation:
- Add SHACLViolation, SHACLValidationReport, _run_pyshacl to ontology_validator.py
- OntologyEngine.validate_graph() with shacl= or ontology= arguments
- explain_violations(): rule-based plain-English explanations for all 7 SHACL constraint types
- summary(), to_dict() on SHACLValidationReport for pipeline and LLM consumers
- pyshacl/rdflib are optional deferred imports (pip install semantica[shacl])

Security & reliability fixes:
- Replace path-heuristic (len/newline) with os.path.exists() in validate_graph
- Add shacl_format parameter to validate_graph and _run_pyshacl; thread format through correctly
- Fix validate_output format alias map in to_shacl (json-ld, n-triples aliases)
- Deep-copy PropertyShape in _propagate_inheritance (dataclasses.replace) — no shared mutable refs
- Deterministic Turtle prefix output via sorted(graph.prefixes.items())
- Use full rdf:type URI in sh:ignoredProperties — no prefix dependency

Tests & docs:
- Add TestSHACLGeneration (16 tests) to test_ontology_comprehensive.py
- Add TestSHACLHierarchicalAndValidation (18 tests) to test_ontology_advanced.py
- 34 new tests, 0 failures, 0 regressions across 1111-test suite
- Update README: Unreleased section, Features, Modules table, Ontology code block, Installation

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-03-27 17:42:46 +05:30
Mohd KaifandClaude Sonnet 4.6 b282487b17 docs: rewrite and polish documentation site (#413)
- Rewrote index.md to match README (tagline, badges, Problem/Solution text)
- Improved getting-started, concepts, quickstart, installation, faq, use-cases, contributing, glossary, learning-more, examples, modules, architecture, cookbook, deep-dive pages: tighter prose, fixed headings/bullets, removed inconsistencies and duplicate sections
- Removed overuse of emojis from headings in integration pages (docling, snowflake)
- Fixed change_management reference page: closed unclosed JSON code block that broke the right TOC, demoted noisy sub-headings to bold text
- CSS layout: widened content area (max-width 1440px grid, left sidebar 11rem, right TOC narrowed to 11rem for broader content), tightened TOC spacing and font size, fixed word-wrap/overflow on TOC links
- Added mkdocs_local.yml for local serving without mkdocs-jupyter plugin

Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-03-26 18:38:21 +05:30
Mohd Kaif 21c7933ec1 Merge pull request #412 from Hawksight-AI/context
feat(#402): Temporal GraphRAG Integration — TemporalGraphRetriever & …
2026-03-26 14:43:21 +05:30
KaifAhmad1andClaude Sonnet 4.6 c46e531dcd docs(#402): add changelog entry for Temporal GraphRAG Integration
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-03-26 14:40:41 +05:30
KaifAhmad1andClaude Sonnet 4.6 0f0800f109 feat(#402): Temporal GraphRAG Integration — TemporalGraphRetriever & TemporalQueryRewriter
- Add TemporalGraphRetriever to context_retriever.py (no new file per project convention)
  - Drop-in wrapper for ContextRetriever; filters related_entities/related_relationships
    via reconstruct_at_time(); at_time=None is a true passthrough
  - Returns new RetrievedContext objects (no in-place mutation)
  - Graceful ImportError if temporal modules unavailable

- Add at_time + header_template to ContextRetriever._generate_reasoned_response()
  and query_with_reasoning()
  - Temporal header prepended to LLM context block only when at_time is set
  - Naive datetimes normalised to UTC before formatting
  - Header built with str.replace (not .format) to prevent format-string injection

- Add TemporalQueryRewriter + TemporalQueryResult to semantica/kg/
  - Regex-only (default) and LLM-assisted extraction modes
  - Resolves temporal phrases via TemporalNormalizer (deterministic, zero LLM)
  - Word-boundary guards on intent keywords; year fallback for noun-phrase dates
  - Never calls reconstruct_at_time — extraction only

- Export TemporalGraphRetriever from semantica.context
- Export TemporalQueryRewriter, TemporalQueryResult from semantica.kg

- Add 99 tests across two new test files
  - tests/context/test_temporal_retriever.py (56 tests)
  - tests/kg/test_temporal_query_rewriter.py (43 tests)

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-03-26 14:20:38 +05:30
Mohd KaifandClaude Sonnet 4.6 9e68266563 feat(#401): Temporal Provenance & Export (#411)
* feat(#401): temporal provenance, OWL-Time export, stable snapshot schema

- ProvenanceTracker: auto-attach recorded_at (UTC) to every new record;
  add query_recorded_between(), revision_history(), export_audit_log()
- RDFExporter.export_to_rdf: add include_temporal + time_axis params;
  emit OWL-Time triples (time:Interval, time:Instant, inXSDDateTimeStamp)
  for relationships with valid_from/valid_until; TemporalBound.OPEN
  represented via semantica:openEndedInterval instead of time:hasEnd
- TemporalVersionManager.create_snapshot: stamp format_version "1.0"
  on every snapshot; add validate_snapshot() and migrate_snapshot()
- New: semantica/kg/schemas/temporal_snapshot_v1.json (JSON Schema draft-2020)
- Tests: 28 new tests covering all acceptance criteria (451 passing, 0 failed)

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

* docs(#401): add changelog entry for temporal provenance & export

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

---------

Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-03-26 12:38:24 +05:30
Mohd Kaif c66f8160dd Merge pull request #410 from Hawksight-AI/semantic-extract
feat(semantic-extract): temporal metadata extraction from text (#400)
2026-03-25 22:33:06 +05:30
KaifAhmad1andClaude Sonnet 4.6 b1e1c9f0d9 docs(changelog): add entry for temporal metadata extraction (#400)
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-03-25 22:31:06 +05:30
Mohd Kaif cef2b4314a Delete PR_DESCRIPTION_SEMANTIC_EXTRACT.md 2026-03-25 22:28:37 +05:30
KaifAhmad1andClaude Sonnet 4.6 b9af181625 feat(semantic-extract): temporal metadata extraction from text (#400)
- Add `extract_temporal_bounds: bool = False` to `extract_relations_llm()`.
  When True the LLM prompt is extended with a calibrated confidence scale
  and four few-shot examples; each returned Relation gains valid_from,
  valid_until, temporal_confidence, and temporal_source_text in metadata.
  Low confidence (<0.5) with non-null dates logs a WARNING. Default False
  preserves 100% backward compatibility.

- Add `RelationWithTemporalOut` / `RelationsWithTemporalResponse` Pydantic
  schemas so the four temporal fields are captured from structured LLM
  output (separate from RelationOut which uses extra="ignore").

- New `semantica/kg/temporal_normalizer.py` — `TemporalNormalizer` class
  (zero LLM calls, pure regex + dateutil arithmetic):
    * normalize(value) → (start, end) UTC datetimes or None
    * Resolution order: ISO 8601 → partial dates (year/month/Q) →
      ambiguity detection → domain phrase map → relative phrases
    * normalize_phrase(phrase) → metadata dict or None
    * Default phrase map covers 13 domains: General, Policy, Healthcare,
      Drug Discovery, Cybersecurity, Supply Chain, Finance, Energy
    * TemporalAmbiguityWarning for DD/MM/YYYY-style ambiguous inputs
    * Custom phrase_map at construction (merged over defaults)

- Add `TemporalAmbiguityWarning(UserWarning)` to exceptions.py.
- Export `TemporalNormalizer` from `semantica/kg/__init__.py`.
- Propagate `extract_temporal_bounds` through `_extract_relations_chunked`
  and add flag to cache key to prevent cross-mode cache pollution.

- 53 new tests in tests/semantic_extract/test_temporal_extraction.py;
  zero real LLM calls, suite runs in ~3.5s. 873 existing tests unaffected.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-03-25 21:42:57 +05:30
Mohd Kaif 05fa3247b7 Merge pull request #409 from Hawksight-AI/semantic-extract
fix(semantic-extract): pass base_url as host when initialising Ollama…
2026-03-24 19:48:49 +05:30
KaifAhmad1andClaude Sonnet 4.6 42899c1416 docs(changelog): add entry for OllamaProvider base_url fix (#408)
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-03-24 19:44:56 +05:30
KaifAhmad1andClaude Sonnet 4.6 19665b9db2 fix(semantic-extract): pass base_url as host when initialising OllamaProvider client
Closes #408

Previously `_init_client` assigned the raw `ollama` module to
`self.client`, so the `base_url` parameter was silently ignored and
every request hit the default localhost:11434. Now an `ollama.Client`
instance is created with `host=self.base_url`, so remote Ollama servers
are reachable.

Three regression tests added to prevent recurrence:
- default base_url is forwarded as host
- custom base_url (e.g. http://192.168.1.3:11434) is forwarded as host
- self.client is never the raw module

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-03-24 19:36:22 +05:30
Mohd Kaif 07dc579faf Merge pull request #407 from Hawksight-AI/context
feat(context): add temporal awareness to ContextGraph and AgentContext
2026-03-24 13:28:25 +05:30
KaifAhmad1andClaude Sonnet 4.6 96e438c81c docs(changelog): add entry for temporal awareness in context graph (#399)
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-03-24 13:25:16 +05:30
KaifAhmad1andClaude Sonnet 4.6 c483352d7a fix(context): resolve review issues in temporal awareness PR
- Fix max_depth error message: "1 and 20" -> "1 and 100" to match actual check
- Fix Cypher query at_time param to RFC3339 UTC (append Z) for unambiguous DB comparisons
- Fix _normalize_temporal_input to raise ValueError on unparseable strings instead of returning raw input
- Fix datetime.now() -> datetime.utcnow() in recorded_at stamps and checkpoint timestamps (matches codebase convention, avoids wrong local time on Windows)
- Wrap TemporalVersionManager() construction in flush_checkpoint with clear RuntimeError

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-03-24 13:20:54 +05:30
KaifAhmad1andClaude Sonnet 4.6 01ba7d113b feat(context): add temporal awareness to ContextGraph and AgentContext
- Add valid_from/valid_until fields to Decision dataclass and record_decision()
- Add include_superseded and as_of filters to find_precedents_by_scenario()
- Add _decision_matches_temporal_filters() and _normalize_temporal_input() helpers
- Add ContextGraph.state_at(timestamp) for point-in-time graph snapshots
- Stamp recorded_at on causal relationship edges
- Add CausalChainAnalyzer.trace_at_time() for transaction-time causal chain tracing
- Add AgentContext.checkpoint(), diff_checkpoints(), flush_checkpoint() for named context snapshots
- 93 tests passing (33 context_graph, 36 causal_analyzer, 24 agent_context)

Closes #399

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-03-24 12:18:25 +05:30
Mohd Kaif cdd45331fa Merge pull request #406 from Hawksight-AI/semantic-extract
Harden spaCy NER Fallback in Semantic Extract
2026-03-23 23:33:18 +05:30
KaifAhmad1 a3a0848577 Fix semantic extract spaCy fallback review issues 2026-03-23 23:31:01 +05:30
Mohd Kaif eeda5f5b80 Merge branch 'main' into semantic-extract 2026-03-23 23:16:19 +05:30
KaifAhmad1 62b03d4fa5 Harden spaCy NER fallback in semantic extract 2026-03-23 23:12:48 +05:30
Mohd Kaif 8a2b07b864 Merge pull request #405 from Hawksight-AI/kg
Deterministic Temporal Reasoning Engine and Query Integration
2026-03-23 19:55:15 +05:30
KaifAhmad1 0773e24075 Update changelog for temporal reasoning PR 2026-03-23 19:48:56 +05:30
KaifAhmad1 8de7cc1b6d Fix temporal reasoning review issues 2026-03-23 19:43:12 +05:30
KaifAhmad1 c6dc9d87aa Add deterministic temporal reasoning engine 2026-03-23 19:12:18 +05:30
Mohd Kaif 781b103436 Merge pull request #404 from Hawksight-AI/kg
Implement temporal point-in-time correctness (#397)
2026-03-23 17:24:32 +05:30
KaifAhmad1 e4f0c8993c Update changelog for temporal query PR follow-ups 2026-03-23 17:20:34 +05:30
KaifAhmad1 b2b823a5c3 Fix temporal query review follow-ups 2026-03-23 17:13:02 +05:30
KaifAhmad1 3c863e860e Implement temporal point-in-time correctness (#397) 2026-03-23 16:39:49 +05:30
Mohd Kaif 4c74da7682 Merge pull request #403 from Hawksight-AI/kg
Core temporal data model overhaul (#396)
2026-03-23 16:20:17 +05:30
KaifAhmad1 de84ab6d06 Update changelog for temporal PR follow-ups 2026-03-23 16:16:14 +05:30
KaifAhmad1 8be16f782e Fix temporal revision integrity follow-ups 2026-03-23 16:12:29 +05:30
KaifAhmad1 9faa5661f8 Core temporal data model overhaul (#396) 2026-03-23 15:53:13 +05:30
Mohd Kaif 3e0fbf8e95 Merge pull request #394 from ZohaibHassan16/feat/gitgraph
feat: implement full audit trail, named tags, and rollback protection
2026-03-22 20:20:38 +05:30
OpenAI CodexandKaifAhmad1 29f5c72533 docs(changelog): note PR #394 audit trail fixes
Co-authored-by: KaifAhmad1 <kaifahmad087@gmail.com>
2026-03-22 20:15:58 +05:30
OpenAI CodexandKaifAhmad1 e13ea740cd merge: resolve main conflicts for PR #394
Co-authored-by: KaifAhmad1 <kaifahmad087@gmail.com>
2026-03-22 20:12:01 +05:30
OpenAI CodexandKaifAhmad1 e2b79ada9a fix(change-management): preserve snapshot compatibility and audit integrity
Co-authored-by: KaifAhmad1 <kaifahmad087@gmail.com>
2026-03-22 19:45:58 +05:30
Mohd Kaif c6f8f0dd04 Merge pull request #393 from ZohaibHassan16/fix/snapshot-key-mismatch
fix: Map nodes/edges to resolve silent snapshot restore failure
2026-03-22 17:44:51 +05:30
Mohd Kaif 4147f0ca3b Merge branch 'main' into fix/snapshot-key-mismatch 2026-03-22 17:42:32 +05:30
OpenAI CodexandKaifAhmad1 ad84cb5897 docs(changelog): note PR #393 snapshot fixes
Co-authored-by: KaifAhmad1 <kaifahmad087@gmail.com>
2026-03-22 17:41:49 +05:30