Commit Graph
159 Commits
Author SHA1 Message Date
KaifAhmad1 8aa2ee3dc8 Merge main into docs and resolve README Discord badge conflict 2026-02-18 16:36:23 +05:30
KaifAhmad1 3f211dfb23 Update Discord invite links across docs and community files 2026-02-18 16:32:12 +05:30
KaifAhmad1 59ae0bdf44 Fix documentation snippets: Add missing imports and correct parameter names
- Add 'from datetime import datetime' import in e-commerce examples
- Change 'max_results=5' to 'limit=5' for find_precedents_by_scenario calls
- Fix docs/reference/context.md e-commerce example
- Fix semantica/context/context_usage.md e-commerce example
- Ensure documentation examples are self-contained and copy-paste ready
- Match actual API parameter names for correct behavior
- All 62 tests still passing successfully
2026-02-17 14:35:17 +05:30
KaifAhmad1 33c90d8277 Fix Context Graph features - resolve method conflicts and integration issues
- Fix method name conflicts: add_decision -> add_decision_simple, find_precedents -> find_precedents_by_scenario
- Fix Decision ID handling: align tests with Decision model UUID generation behavior
- Fix AgentContext integration: proper handling of context_graph backend in get_causal_chain
- Fix Policy engine: remove invalid auto_generate_id parameter from deserialization
- Fix node type consistency: handle lowercase 'decision' type across all methods
- Fix timestamp handling: proper conversion for string and datetime objects
- Update documentation: correct method names and Decision model usage in examples
- All 62 Context Graph tests passing successfully
- Production ready with comprehensive verification
2026-02-17 13:43:08 +05:30
KaifAhmad1 14f5e05336 Update context documentation with user-friendly approach and strategic emoji placement
- Enhanced README.md with strategic emojis for better visual appeal
- Updated context_usage.md with detailed, user-friendly examples
- Improved docs/reference/context.md with accessible language
- Added AgentContext sections with progressive learning approach
- Maintained professional appearance while improving readability
- Consistent documentation across all context module files
2026-02-16 17:40:50 +05:30
Sameer Kadam 20755e69e2 feat(graph): add Apache AGE backend integration with configuration, registration, tests and documentation (#311) 2026-02-15 15:57:07 +05:30
KaifAhmad1 db64dce596 fix: Remove broken link to non-existent decision_tracking.md
- Remove broken link from reference/context.md that was causing CI failure
- Decision tracking functionality is now integrated into the context module
- Fix mkdocs build strict mode warning about missing target file
- Ensure documentation builds successfully in CI pipeline
2026-02-13 18:41:29 +05:30
KaifAhmad1 7ad48df600 feat: Add comprehensive context engineering with decision tracking, KG algorithms, and context graphs
- Add decision tracking system with DecisionRecorder, DecisionQuery, CausalChainAnalyzer, PolicyEngine
- Implement KG algorithm integration with centrality, community detection, embeddings, path finding
- Add vector store integration with hybrid search and custom similarity weights
- Enhance context graphs with advanced analytics and decision support
- Update documentation with comprehensive context module reference
- Add production examples for banking and healthcare use cases
- Update README to highlight context graph framework capabilities
- Add comprehensive test suite for all new features
2026-02-12 23:04:29 +05:30
KaifAhmad1 bbbc2fb126 fix(docs): Correct broken link in pgvector documentation
- Fix relative link to vector_store_usage.md
- Resolve MkDocs strict mode warning
- Ensure docs build passes CI
2026-02-12 14:14:34 +05:30
Sameer6305 99b3c1524a docs(vector_store): Add pgvector documentation
- Setup instructions with Docker
- Connection string format
- Usage examples
- Index types (HNSW, IVFFlat)
- Migration notes
2026-02-11 14:32:05 +05:30
KaifAhmad1 6fc69aef2e [FEATURE] Enhanced Graph Algorithms in KG Module #292
This commit introduces comprehensive enhancements to the Knowledge Graph (KG) module with:

Major Enhancements:
- Complete algorithm suite with 30+ graph algorithms
- Unified provenance tracking system for all operations
- Comprehensive documentation and test coverage
- Enterprise-grade functionality

New Algorithm Components:
- NodeEmbedder: Node2Vec, DeepWalk, Word2Vec algorithms
- SimilarityCalculator: Cosine, Euclidean, Manhattan, Correlation metrics
- PathFinder: Dijkstra, A*, BFS, K-shortest paths
- LinkPredictor: Preferential attachment, Jaccard, Adamic-Adar
- CentralityCalculator: Degree, Betweenness, Closeness, PageRank
- CommunityDetector: Louvain, Leiden, Label propagation
- ConnectivityAnalyzer: Components, bridges, density analysis

Provenance System:
- GraphBuilderWithProvenance: Graph construction with tracking
- AlgorithmTrackerWithProvenance: Algorithm execution tracking
- Execution IDs and metadata tracking for reproducibility

Test Coverage:
- 5 comprehensive test suites with 40+ test methods
- End-to-end testing for all algorithms
- Real-world scenario testing
- Provenance integration testing

Documentation:
- Updated all module documentation with algorithm listings
- Enhanced KG reference documentation
- Comprehensive usage examples and API documentation

Technical Improvements:
- Unified provenance system integration
- Enhanced error handling and recovery
- Performance optimizations
- NetworkX compatibility with fallback implementations

Resolves: #292
Parent: Context Graphs feature
2026-02-10 21:49:11 +05:30
KaifAhmad1 affe3aa8bd release: v0.2.7 with Snowflake connector, Arrow export, and benchmark suite
- Add Snowflake connector with multi-authentication support (PR #276)
- Add Apache Arrow export with explicit schemas (PR #273)
- Add comprehensive benchmark suite with regression CLI (PR #289)
- Update version to 0.2.7 across all files
- Update documentation and citations
- 44/44 tests passing, zero breaking changes
2026-02-09 12:55:23 +05:30
KaifAhmad1 ad06957f93 Fix card icons and remove unused files
- Replace problematic Material Design Icons with verified working icons
- Fix icon rendering issues in provenance.md and change_management.md
- Replace :material-route: with :material-link-variant: for Complete Lineage
- Replace :material-account-tree: with :material-graph: for Knowledge Graph Versioning
- Replace :material-schema: with :material-shape: for Ontology Versioning
- Replace :material-audit: with :material-clipboard-check: for Audit Trail Compliance
- Replace :material-bridge: with :material-share-variant: for Bridge Axiom Support
- Remove PR_DESCRIPTION.md and SNOWFLAKE_IMPLEMENTATION.md unused files
- All cards now display consistently with proper icons
2026-02-05 22:06:46 +05:30
KaifAhmad1 f45b7a26ba Fix card icons and replace logo across documentation
- Fix invalid Material Design Icons in provenance.md reference cards
- Replace old 'Semantica Updated Logo.png' with new 'Semantica Logo.png'
- Update README.md, docs/index.md, and docs/DOCS_README.md logo references
- Remove old logo files and add new logo to docs assets
- All documentation now uses consistent, valid icons and new branding
2026-02-05 21:16:51 +05:30
KaifAhmad1 d3b579208c Comprehensive documentation cleanup and improvements
## Documentation Changes

### 📚 Major Improvements
- **Cleaned up all documentation files** - Removed redundant content and improved clarity
- **Restructured Resources section** - Removed unnecessary files, kept only essential ones
- **Added Snowflake integration** - Complete integration guide with examples
- **Improved navigation** - Better organization and user experience

### 🗂️ File Changes
- **docs/concepts.md** - Rewritten to be clean and user-friendly
- **docs/modules.md** - Updated with current modules and removed emojis
- **docs/glossary.md** - Reorganized thematically instead of alphabetically
- **docs/getting-started.md** - Made more concise and practical
- **docs/community.md** - Clean, focused community guide
- **docs/contributing.md** - Clear contribution guidelines
- **docs/faq.md** - Comprehensive FAQ with practical answers
- **docs/license.md** - Clean license explanation
- **docs/css/custom.css** - Fixed CSS syntax and organization

### 🔧 Technical Changes
- **mkdocs.yml** - Updated navigation, removed redundant files
- **docs/integrations/snowflake.md** - New comprehensive Snowflake guide
- **docs/reference/ingest.md** - Added Snowflake references
- **Removed files**: changelog.md, release-guide.md, change_management_usage.md, community-projects.md, architecture.md, governance.md, citation.md

### 🎯 Benefits
- **Better user experience** - Clean, easy to navigate documentation
- **Reduced redundancy** - No duplicate or unnecessary content
- **Professional quality** - Enterprise-ready documentation
- **Consistent style** - Uniform formatting across all files

This commit includes all documentation improvements while maintaining the main branch's stability.
2026-02-05 17:43:16 +05:30
KaifAhmad1 e47327ebb5 Remove version selector from documentation header
- Delete version-selector.js file
- Remove version selector styles from custom.css
- Update mkdocs.yml to remove version-selector.js reference
- Clean up header for better user experience
2026-02-05 14:48:53 +05:30
Sameer6305 0a66e1c6ea fix: address Copilot review feedback for Snowflake ingestor 2026-02-04 00:17:25 +05:30
Sameer6305 06d5fad6b9 feat: add Snowflake ingestor for native data warehouse ingestion 2026-02-03 23:27:25 +05:30
Mohd Kaif e9dfcff873 Merge pull request #273 from Sameer6305/feature/arrow-exporter
feat: add Apache Arrow exporter
2026-02-03 21:29:45 +05:30
KaifAhmad1 a4ab3fd9e3 Release v0.2.6 2026-02-03 10:38:40 +05:30
Sameer6305 4ab8b4d72b feat: add Apache Arrow exporter 2026-02-02 22:56:53 +05:30
KaifAhmad1 78e552853d [DOCS] Replace Semantica Logo with New Clean Design - Fixes #266
- Updated README.md with new logo reference
- Updated docs/index.md with new logo reference
- Updated docs/DOCS_README.md documentation
- Added new clean, professional logo (Semantica Updated Logo.png)
- Removed old illustrated logo (semantica_logo.png)

The new logo is minimal, scales well, and better represents Semantica as an enterprise-grade semantic layer.
2026-02-02 15:15:55 +05:30
KaifAhmad1 079ae5cd10 Fix MkDocs CI: Add provenance to nav, update CHANGELOG, add PR description 2026-01-31 20:29:03 +05:30
KaifAhmad1 6391dcdf72 Add comprehensive W3C PROV-O compliant provenance tracking module
- Implemented provenance tracking across all 17 Semantica modules
- Added W3C PROV-O compliant schemas (prov:Entity, prov:Activity, prov:Agent, prov:wasDerivedFrom)
- Created ProvenanceManager with InMemory and SQLite storage backends
- Implemented SHA-256 integrity verification for tamper detection
- Added bridge axiom support for domain transformations (L1→L2→L3)
- Created provenance-enabled versions of all modules (opt-in with provenance=True)
- Added comprehensive test suite (237 tests covering edge cases and real scenarios)
- Updated README with accurate claims and compliance disclaimers
- Added complete documentation (usage guide and API reference)
- Zero breaking changes - fully backward compatible
2026-01-31 20:11:38 +05:30
KaifAhmad1 b3f3ac413c Add Enhanced Change Management Module with comprehensive testing and documentation
- New semantica.change_management module with persistent version storage
- Core classes: TemporalVersionManager, OntologyVersionManager, ChangeLogEntry
- Storage backends: SQLite (persistent) and InMemory (fast)
- Features: SHA-256 checksums, detailed entity/relationship diffs, email validation
- Compliance: HIPAA, SOX, FDA 21 CFR Part 11 support with audit trails
- Testing: 104 tests (100% pass) - unit, integration, compliance, performance
- Performance: 17.6ms for 10k entities, 510+ ops/sec concurrent
- Documentation: Complete usage guide and API reference
- Backward compatible with simplified class names
2026-01-30 15:51:07 +05:30
KaifAhmad1 3968a450a8 chore: release v0.2.5 2026-01-27 22:01:25 +05:30
KaifAhmad1 37bc3add62 Update documentation and changelog for Pinecone support 2026-01-26 21:44:44 +05:30
KaifAhmad1 b3a239ccb1 feat: enhance semantic extraction with BYOM support, NER aggregation, RE implementation, and Triplet improvements
- Implemented 'Bring Your Own Model' (BYOM) support for NER, Relation, and Triplet extraction
- Added NER aggregation strategies (simple, max, average)
- Implemented Relation Extraction via Sequence Classification with entity markers
- Enhanced Triplet Extraction with REBEL post-processing and lazy loading
- Updated all extractors to prioritize runtime options over config defaults
- Added extensive tests and examples (huggingface_demo.py)
- Updated documentation and CHANGELOG
2026-01-24 20:53:21 +05:30
KaifAhmad1 b382a7df6e chore: release version 0.2.4 2026-01-22 12:50:07 +05:30
KaifAhmad1 b96e71ae72 feat(ontology): Implement OntologyIngestor and update exports
- Added OntologyIngestor in semantica/ingest/ontology_ingestor.py
- Updated semantica/ontology/__init__.py to export OntologyIngestor
- Updated semantica/ingest/methods.py to use OntologyIngestor
- Added tests for ontology ingestion
- Cleaned up temporary files
2026-01-21 13:46:46 +05:30
KaifAhmad1 fa8544c6d6 Release v0.2.3: Update version, changelog, and documentation 2026-01-20 12:08:46 +05:30
KaifAhmad1 1568237ce7 Add high-performance VectorStore ingestion and docs 2026-01-19 13:32:16 +05:30
KaifAhmad1 c6316ba4bd Release 0.2.2 2026-01-15 00:42:07 +05:30
KaifAhmad1 dd7fcd3ddb [FEATURE] Performance Bottlenecks and Scaling Limitations in semantic_extract #186
- Implemented high-throughput parallel batch processing across all core extractors (NERExtractor, RelationExtractor, TripletExtractor, EventDetector, SemanticNetworkExtractor) using ThreadPoolExecutor.

- Added max_workers configuration parameter (default: 1) to all extractor extract() methods.

- Implemented parallel processing for large document chunking in _extract_entities_chunked and _extract_relations_chunked.

- Enhanced ProgressTracker to be thread-safe.

- Optimized setUpClass in tests to reduce Groq LLM initialization overhead.

- Updated documentation and usage examples.
2026-01-14 00:11:30 +05:30
KaifAhmad1 428fc3b83a chore(release): bump version to 0.2.1 and update release docs 2026-01-12 17:48:07 +05:30
KaifAhmad1 8c3f7f1f0a fix(semantic-extract): resolve incomplete output #176, relax constraints, and add Groq support 2026-01-12 17:15:21 +05:30
KaifAhmad1 87a08e0240 chore: Prepare release v0.2.0 2026-01-10 23:32:10 +05:30
KaifAhmad1 f338b66274 feat: Add provenance metadata and robust fallback chains to semantic extraction
- Implemented ML/LLM -> Pattern -> Last Resort fallback chains for NER, Relation, and Triplet extractors to prevent empty results.
- Added provenance metadata (batch_index, document_id) to all extraction schemas (Entity, Relation, Triplet, etc.).
- Unified batch processing API with progress tracking across all extractors.
- Updated documentation (module usage and reference docs) to reflect new features.
- Added robustness and batch provenance tests.
2026-01-10 20:43:09 +05:30
KaifAhmad1 a5c531fd29 Fix semantic extraction empty returns, schema validation, and update docs 2026-01-09 18:39:09 +05:30
KaifAhmad1 957c122116 docs: add Docling integration guide, clear code example, and fix parser consistency issues 2026-01-08 21:27:48 +05:30
KaifAhmad1 dcd6f25f87 docs: fix KnowledgeGraph mismatch and update tests for issue #144 2026-01-07 15:01:47 +05:30
KaifAhmad1 e712949872 Enhance LLM extraction methods with auto-chunking, robust parsing and improved diagnostics (#149) 2026-01-07 03:03:19 +05:30
KaifAhmad1 2b43fa4699 fix: update discord badge to a reliable static version 2026-01-06 12:00:23 +05:30
KaifAhmad1 7f7c36f94d docs: update badges, discord links, and version mentions 2026-01-06 11:54:17 +05:30
KaifAhmad1 d7b686f32a Release v0.1.1: Docling support, version bump, and documentation updates 2026-01-06 00:21:20 +05:30
KaifAhmad1 04eea7e7eb Update documentation: reduce code examples, add cookbook links, improve structure
- Reduced code examples in all guide pages (getting-started, quickstart, concepts, modules, examples, use-cases, learning-more)
- Added comprehensive cookbook links with descriptions (topics, difficulty, time, use cases)
- Improved structure and organization across all guide pages
- Updated use-cases.md to only include use cases with corresponding cookbooks
- Removed 'Last Updated: 2024' from all documentation files
- Enhanced navigation with better 'Next Steps' sections
2025-12-31 15:19:08 +05:30
KaifAhmad1 35391382d3 docs: configure github pages deployment and fix broken links 2025-12-31 12:37:36 +05:30
KaifAhmad1 aee046ec8b release: update version to 0.1.0 and add CLI, server, and worker entry points
Summary of changes:
- Update version to 0.1.0 in pyproject.toml and __init__.py files
- Add semantica/cli.py with click-based interface
- Add semantica/server.py with FastAPI-based REST API
- Add semantica/worker.py for background task processing
- Update documentation and changelog for v0.1.0
2025-12-31 12:12:20 +05:30
KaifAhmad1 8cde40d753 Remove trading notebooks and supply chain risk management notebook
- Deleted cookbook/use_cases/trading/01_Risk_Assessment.ipynb
- Deleted cookbook/use_cases/trading/02_News_Sentiment_Analysis.ipynb
- Deleted cookbook/use_cases/supply_chain/02_Supply_Chain_Risk_Management.ipynb
- Removed empty trading directory
- Updated documentation to reflect 14 cookbooks (down from 15)
- Removed all references from README.md, docs/cookbook.md, docs/use-cases.md, docs/index.md, and STRATEGIES_SUMMARY.md
2025-12-30 23:33:27 +05:30
KaifAhmad1 af17585087 Remove Smart Grid Management notebook and update cookbook count to 15 2025-12-30 20:20:11 +05:30