Commit Graph
394 Commits
Author SHA1 Message Date
KaifAhmad1 68f4eb6d2d chore: align reasoning module documentation and notebooks with implementation 2025-12-08 13:29:45 +05:30
KaifAhmad1 75ffcb1031 Standardize notebooks to handler-based pipeline API: add explicit step dependencies, use data injection for inputs, remove legacy func/args usage; update supply chain, intelligence, forensics, healthcare examples; refresh pipeline docs. 2025-12-07 23:03:39 +05:30
KaifAhmad1 902b332d9b cookbook(trading): migrate to StructuredDataParser.parse_data and dict access; fix backtesting notebook parsing and iteration; minor doc updates 2025-12-07 20:43:05 +05:30
KaifAhmad1 9837feec9b Refactor Unstructured Cookbook imports for better modularity 2025-12-07 16:15:50 +05:30
KaifAhmad1 1829b46340 Enhance Unstructured to Ontology Cookbook with LLM and Visualization 2025-12-07 16:14:11 +05:30
KaifAhmad1 694141297f Enhance Ontology Cookbook with visualization and advanced features 2025-12-07 15:58:53 +05:30
Semantica Bot 7878b4a222 cookbook/ontology: add worked example for object vs data properties; align worksFor to Schema.org; add optional hierarchy visualization; plus commit pending changes across notebooks, docs, and ontology modules 2025-12-07 15:21:16 +05:30
KaifAhmad1 6b7f230b37 docs(normalize): standardize docs to class usage; update cookbook notebooks; fix Colab link; correct text_normalizer.normalize → normalize_text 2025-12-07 00:17:57 +05:30
Mohd Kaif 4c98802cef Update README.md 2025-12-06 18:13:03 +05:30
Mohd Kaif 11e52b53e3 Update README.md 2025-12-06 18:08:11 +05:30
KaifAhmad1 4cff74d8a6 Docs: remove KG QA nav and fix links to modules quality section for strict mkdocs build 2025-12-06 17:56:02 +05:30
KaifAhmad1 dd39c544fc Remove kg_qa module and exports; update docs and notebooks to remove KG QA references and add temporary notices; adjust README Quality Assurance examples; add roadmap entry for KG QA in Q1; refine wording per request 2025-12-06 17:34:57 +05:30
KaifAhmad1 01791562f1 refactor(kg): Remove ConflictDetector and Deduplicator from kg module
- Remove ConflictDetector and Deduplicator from semantica.kg module
- Update all imports to use semantica.conflicts and semantica.deduplication
- Update all notebooks to use class-based API (no convenience functions)
- Fix method signatures: pass graph parameter to methods instead of constructor
- Update calculate_centrality calls to use specific methods (calculate_degree_centrality, etc.)
- Fix detect_communities and analyze_connectivity return value handling
- Update all documentation (kg_usage.md, docs/reference/kg.md)
- Remove conflict_detector.py and deduplicator.py from kg module
- Update registry.py to remove conflict and deduplicate task types
2025-12-06 16:17:27 +05:30
KaifAhmad1 d258ef6880 refactor(kg): Remove ConflictDetector and Deduplicator from kg module
- Remove ConflictDetector and Deduplicator from semantica.kg module
- Update all imports to use dedicated semantica.conflicts and semantica.deduplication modules
- Update all cookbook notebooks to use class-based API instead of convenience functions
- Fix calculate_centrality calls to use specific methods (calculate_degree_centrality, calculate_betweenness_centrality)
- Update detect_communities and analyze_connectivity calls to pass graph parameter
- Update documentation (kg_usage.md, docs/reference/kg.md) to reflect changes
- Remove conflict and deduplicate task types from method registry
2025-12-06 15:57:48 +05:30
KaifAhmad1 6dd9837aa6 Refactor ingest module and enhance documentation
- Removed deprecated 'build' convenience function from semantica/ingest/__init__.py to resolve conflicts and promote class-based usage.
- Updated 'docs/reference/ingest.md' to include missing main classes: FeedIngestor, EmailIngestor, DBIngestor, and MCPIngestor.
- Added 'Stream Monitoring' usage example to 'semantica/ingest/ingest_usage.md'.
- Completely rewrote 'cookbook/introduction/02_Data_Ingestion.ipynb' to provide a comprehensive, runnable guide covering all ingestion submodules and helper classes.
2025-12-06 14:32:10 +05:30
KaifAhmad1 0c10d5c876 Update Graph Store module documentation and notebooks
- Enhanced Graph Store notebook with comprehensive examples and clean formatting
- Fixed GraphStore API usage across all documentation files
- Updated examples to use keyword arguments (labels, properties, start_node_id, end_node_id, rel_type)
- Removed emojis and links from notebook for cleaner markdown
- Made summary section more concise
- Ensured consistency across cookbook notebooks, docs, and module code
2025-12-06 13:31:56 +05:30
KaifAhmad1 7da9f902e3 Update export module notebooks: comprehensive documentation and API consistency
- Enhanced introduction/15_Export.ipynb with complete module architecture documentation
- Enhanced advanced/05_Multi_Format_Export.ipynb with all export formats and classes
- Removed HTMLExporter references from intelligence notebooks (class doesn't exist)
- Fixed OWLExporter usage in healthcare notebook (removed invalid export_knowledge_graph call)
- Updated all notebooks to use only class imports, no convenience functions
- Added comprehensive documentation for all exporter classes and methods
- Improved markdown structure and learning objectives in both notebooks
2025-12-05 21:49:37 +05:30
KaifAhmad1 1e51f6621a chore: make Pages setup step more resilient 2025-12-05 18:53:26 +05:30
KaifAhmad1 9cfd1b4a17 fix: rename docs/README.md to resolve strict mode warning
- Rename docs/README.md to docs/DOCS_README.md to avoid conflict with index.md
- Resolves WARNING about README.md conflicting with index.md in strict mode
- This allows CI build to pass with --strict flag
2025-12-05 18:48:56 +05:30
KaifAhmad1 3923de649e fix: resolve all MkDocs strict mode link warnings
- Change reference/ directory links to reference/core.md
- Change all ../LICENSE links to GitHub URLs
- Change ../README.md link to GitHub URL
- Resolve all 'unrecognized relative link' INFO messages
2025-12-05 18:43:31 +05:30
KaifAhmad1 032b797359 fix: change README.md link to GitHub URL to resolve strict mode warning
- Replace relative ../README.md link with absolute GitHub URL
- Fixes CI build failure in strict mode
2025-12-05 18:38:56 +05:30
KaifAhmad1 29af88145a fix: correct anchor links in getting-started.md
- Update cookbook.md anchor references from #introduction to #core-tutorials
- Update cookbook.md anchor references from #use-cases to #industry-use-cases
2025-12-05 18:35:20 +05:30
KaifAhmad1 52e8a290a5 fix: resolve remaining MkDocs build warnings
- Fix anchor links in cookbook.md (#core-tutorials, #industry-use-cases)
- Convert all notebook links to GitHub URLs for proper resolution
- Fix intelligence notebook filenames
- Update all use case notebook links to use absolute GitHub paths
- Resolve all WARNING level issues in MkDocs strict build
2025-12-05 18:26:25 +05:30
Mohd Kaif 053b31acf4 Update mkdocs.yml 2025-12-05 18:09:12 +05:30
Mohd Kaif 7c660e299d Update embeddings.md 2025-12-05 18:02:59 +05:30
KaifAhmad1 8b6e9a1e36 refactor: update embedding API in all notebooks and documentation
- Update all notebooks to use generate_embeddings() instead of generate()
- Update docs/reference/embeddings.md to remove references to removed components
- All notebooks now use data_type='text' parameter for embedding generation
- Updated 11 notebooks across introduction, use_cases, and advanced directories
2025-12-05 17:54:09 +05:30
KaifAhmad1 24b9fe3eb3 Refactor deduplication module documentation and notebook
- Restructured 18_Deduplication.ipynb with comprehensive module overview
- Added detailed explanations of module capabilities and architecture
- Improved markdown formatting and removed emojis
- Reorganized content to focus on module capabilities rather than individual classes
- Added clear examples for all major features
- Updated documentation for consistency across all files
2025-12-05 16:00:12 +05:30
KaifAhmad1 7d61f5b3ca Refactor core module: update config and lifecycle managers, add core_usage.md, update notebooks 2025-12-05 13:24:43 +05:30
KaifAhmad1 37d75f260e feat(context): Add comprehensive memory and context management methods
- Add memory management methods to AgentContext (exists, count, get, update, delete, clear, list, batch operations)
- Add search methods (search, find_similar, get_context, expand_query)
- Add conversation methods (get_conversation, list_conversations, delete_conversation, conversation_summary)
- Add export/import methods (export, import_data, backup, restore)
- Add statistics methods (stats, health, usage_stats)
- Add similar methods to AgentMemory, ContextRetriever, ContextGraphBuilder, EntityLinker
- Improve error messages with clear, actionable messages
- Update documentation (context_usage.md) with all new methods
- Update notebook (19_Context_Module.ipynb) - remove emojis, add new methods, clean formatting
- Improve error handling in methods.py
2025-12-05 00:44:08 +05:30
Mohd Kaif f35b2239c3 Merge pull request #65 from Hawksight-AI/conflicts
Remove statistics functionality and update documentation
2025-12-04 22:26:11 +05:30
KaifAhmad1 a93700813f refactor(conflicts): Remove statistics functionality and update documentation
Resolved merge conflicts by:
- Removing statistics functionality from ConflictResolver and ConflictAnalyzer
- Removing detect_and_resolve convenience function
- Updating all documentation and examples
- Adding by_source analysis capability
- Updating method signatures to match new API
2025-12-04 22:19:04 +05:30
KaifAhmad1 e483ad164f Format GraphRAG Complete notebook: Add proper line breaks and formatting to all cells 2025-12-04 15:55:09 +05:30
KaifAhmad1 2b5a2be030 Merge branch 'main' of https://github.com/Hawksight-AI/semantica 2025-12-04 13:12:53 +05:30
KaifAhmad1 5071b60c79 Clean up cookbook: remove redundant notebooks and update documentation
- Remove 5 redundant use case notebooks:
  - renewable_energy/05_Supply_Chain_Analysis.ipynb
  - finance/05_Market_Intelligence.ipynb
  - trading/03_Real_Time_Market_Data.ipynb
  - intelligence/04_Network_Analysis_Intelligence_Reports.ipynb
  - healthcare/06_Medical_Literature_GraphRAG.ipynb
- Remove introduction/02_Configuration_Basics.ipynb
- Renumber all notebooks sequentially (01-18 for introduction, etc.)
- Update docs/cookbook.md:
  - Remove references to deleted notebooks
  - Update all notebook paths to use full GitHub URLs
  - Add missing Intelligence Analysis and Law Enforcement Forensics entries
- Remove duplicate docs/cookbook directory
2025-12-04 13:12:35 +05:30
Mohd Kaif b88dcaf793 Delete cookbook/introduction/02_Configuration_Basics.ipynb 2025-12-04 12:39:15 +05:30
KaifAhmad1 8b3680cd14 Refactor: Clean up 01_Welcome_to_Semantica notebook
- Remove Best Practices section
- Remove Key Concepts Explained section and all subsections
- Remove Next Steps section
- Remove Troubleshooting section
- Keep only essential introduction and framework architecture content
2025-12-03 23:36:36 +05:30
KaifAhmad1 57a1943ba6 Improve code quality in cookbook notebooks
- Remove unnecessary try-except blocks
- Simplify error handling with print statements
- Clean spacing issues (indentation, blank lines, trailing whitespace)
- Ensure consistent code formatting across all notebooks
2025-12-03 19:04:03 +05:30
KaifAhmad1 ca0b9028e0 Update cookbook documentation: Add PyPI installation instructions and update module lists
- Add PyPI installation instructions to all 72 cookbook notebooks
- Update module lists to include all 8 ingestion modules (FileIngestor, WebIngestor, FeedIngestor, StreamIngestor, DBIngestor, RepoIngestor, EmailIngestor, MCPIngestor)
- Reorder sections: Overview before Installation in all notebooks
- Remove duplicate content from introduction notebooks
- Update docs/cookbook.md with PyPI installation section and enhanced module descriptions
2025-12-03 17:22:48 +05:30
KaifAhmad1 7c5c9d9117 docs: organize cookbook notebooks and add Colab integration
- Add numbering to all notebooks for better sorting
  - Introduction: 01-19
  - Advanced: 01-12
  - Use cases: numbered within each category
- Add Google Colab badges to all 72 notebooks
- Clean up Welcome notebook with proper code cells
- Remove unnecessary print statements and verbose content
2025-12-03 13:00:36 +05:30
KaifAhmad1 2f0dc32276 docs: add numbering to cookbook notebooks and improve formatting
- Number all introduction notebooks (01-19)
- Number all advanced notebooks (01-12)
- Number all use case notebooks within each category
- Clean up Welcome notebook with proper code cells
- Remove unnecessary print statements
- Improve notebook organization and sorting
2025-12-03 12:42:32 +05:30
KaifAhmad1 f8ce4dbf14 chore: update Dependabot configuration
- Set weekly schedule for Python dependencies
- Set monthly schedule for GitHub Actions
- Disable PR creation (monitoring only)
2025-12-03 11:58:41 +05:30
KaifAhmad1 2a7bdca157 chore: improve Dependabot configuration
- Add specific schedule times (Mondays at 9:00 AM)
- Add ignore rule for major version updates
- Improve configuration comments
2025-12-03 11:41:55 +05:30
KaifAhmad1 ba04b0bbc6 docs: remove email addresses and add discussion templates
- Remove email addresses from support, security, contributing, and community docs
- Replace email contacts with GitHub Issues and Security Advisories
- Add discussion templates for Q&A, Ideas, Showcase, and General discussions
- Update SUPPORT.md with Discussions section
2025-12-03 11:19:07 +05:30
KaifAhmad1 52714f870d Fix documentation formatting, resolve import conflicts, and update styling 2025-12-02 17:02:55 +05:30
Mohd Kaif a053431aa9 Merge pull request #59 from Hawksight-AI/staging
Update module with explicit parameters and docs
2025-12-02 15:29:14 +05:30
KaifAhmad1 6ebc094f56 Merge main into staging, resolve conflicts keeping local changes 2025-12-02 15:28:41 +05:30
KaifAhmad1 f1699c4f80 feat(semantic_extract): Update module with explicit parameters and docs
## Code Changes
- NamedEntityRecognizer: Added methods, confidence_threshold, merge_overlapping, include_standard_types
- RelationExtractor: Added relation_types, bidirectional, confidence_threshold, max_distance
- EventDetector: Added event_types, extract_participants, extract_location, extract_time
- TripleExtractor: Added include_temporal, include_provenance
- CoreferenceResolver: Added resolve() alias method
- Removed deprecated build() functions from all modules

## Documentation Changes
- docs/reference/semantic_extract.md: Added parameter tables and detailed examples
- docs/reference/kg.md: Updated examples after build removal
- docs/reference/embeddings.md: Updated examples after build removal
- docs/concepts.md: Updated GraphRAG and core concepts examples
- docs/LIBS_README.md: Updated all references to build functions
2025-12-02 15:22:44 +05:30
Mohd Kaif 54a5090324 Merge pull request #58 from Hawksight-AI/ingest
Add 7 new data source ingestors for RAG and Graph Analytics
2025-12-01 23:26:24 +05:30
KaifAhmad1 4364f409a0 feat(ingest): Add 7 new data source ingestors
- Add PandasIngestor for DataFrame, CSV, JSON ingestion
- Add DuckDBIngestor for CSV, Parquet, Excel with SQL queries
- Add MongoIngestor for MongoDB document databases
- Add ElasticIngestor for Elasticsearch indices
- Add RESTIngestor for generic REST API endpoints
- Add HuggingFaceIngestor for ML datasets from HuggingFace Hub
- Add GDriveIngestor for Google Drive files and folders

- Update registry, methods, and config for new ingestors
- Add comprehensive documentation and code examples
- Add optional dependencies to pyproject.toml
2025-12-01 23:20:56 +05:30
Mohd Kaif 3d9a4c1d89 Update README.md 2025-12-01 20:29:07 +05:30