Commit Graph
12 Commits
Author SHA1 Message Date
KaifAhmad1 311a7b43b1 feat(cli): modern Rich terminal styling across all modules
## Summary

Overhaul the CLI and all library modules to produce polished, modern
terminal output comparable to tools like uv, gh, and cargo. Rich was
already a declared dependency but barely used — this commit wires it
throughout every layer.

## Changes by layer

### semantica/cli.py — visual overhaul
- Add imports: `box`, `Panel`, `Rule`, `Syntax`, `Text` from Rich
- Add 7 style constants (`_BRAND`, `_KEY`, `_VAL`, `_DIM`, `_SUCCESS`,
  `_WARN_STY`, `_TABLE_BOX`) for a consistent colour palette
- `_ok()` now prefixes output with a green ✓ checkmark
- New `_info()` helper (neutral · bullet, respects --quiet)
- New `_warn()` helper (yellow ⚠ prefix, never suppressed)
- New `_pprint()` helper: renders dicts/lists as syntax-highlighted JSON
  (Rich Syntax, monokai theme) instead of raw Python repr; strings
  pass through unchanged; respects --quiet
- `info` command: banner replaced with a rounded Rich Panel showing
  version + tagline; component table uses SIMPLE_HEAD box
- All 7 table sites updated: `box=SIMPLE_HEAD`, `show_edge=False`,
  consistent `_KEY`/`_VAL` column styles (KG Stats, Reasoning Engines,
  Recent Decisions, Configured Backends, Backup Info, MCP Tools)
- `_run_build()`: `console.status(spinner="dots")` wraps the blocking
  build call; skipped under --quiet / --json
- `parse`, `extract`, `embed generate`, `reason run`, `reason explain`,
  `deduplicate`: each wraps its long-running operation in a status
  spinner, guarded by --quiet / --json
- All 30+ `console.print(result)` calls replaced with `_pprint()`
- All raw `[yellow]Warning:[/yellow]` and "not running" patterns
  replaced with the new `_warn()` / `_WARN_STY` style

### semantica/explorer/__init__.py
- Error messages use `Console(stderr=True)` with `[bold red]Error:[/bold red]`
- Graph loading wrapped in `console.status()` spinner
- Startup info replaced with a cyan-bordered Rich Panel showing URL,
  API docs, and health endpoint

### Library internals — replace print() with structured logger calls
All modules below had active `print()` calls that bypassed the logging
framework, corrupted spinners, and polluted stdout in piped/programmatic
use. All replaced with appropriate `self.logger.*` calls:

- `semantica/kg/graph_builder.py` — 23 calls: entity resolution
  progress, graph structure steps, GraphStore persistence timing, and
  the two `='*60` completion banners → `self.logger.info/debug()`
- `semantica/semantic_extract/methods.py` — 4 verbose-mode debug
  prints → `logger.debug()`
- `semantica/semantic_extract/relation_extractor.py` — progress +
  error prints → `self.logger.debug/warning()` with `exc_info`
- `semantica/semantic_extract/triplet_extractor.py` — same pattern
- `semantica/semantic_extract/semantic_network_extractor.py` — batch
  error prints → `self.logger.warning/error()`
- `semantica/semantic_extract/coreference_resolver.py` — error print
  → `self.logger.error()`
- `semantica/semantic_extract/providers.py` — debug print →
  `self.logger.debug()`

### Tooling
- `benchmarks/benchmarks_runner.py`: Rule banner, ✓/✗/⚠ status lines,
  Rule separators around regression alert
- `benchmarks/infrastructure/compare.py`: removed manual ANSI escape
  codes; comparison output is now a Rich Table with SIMPLE_HEAD;
  summary uses coloured Rule + styled SUCCESS/FAILURE messages
- `cookbook/advanced/snowflake_ingestion_examples.py`: `_section()`
  helper using Rule; tabular data rendered as Rich Table; result lines
  use ✓/✗/⚠ prefixes; logger.error already present, retained
- `docs_check.py`: `pass`/`FAIL` lines use `[bold green]` /
  `[bold red]`; summary uses styled output

## Tests
- `tests/test_cli_commands.py`: fix 3 pre-existing mock mismatches
  - `test_kg_stats_json_with_mock`: mock now uses `compute_metrics()`
    (the method the code actually calls) instead of `get_statistics()`
  - `test_dry_run_not_needed_extract_is_read_only` and
    `test_stdin_input`: mock now provides `NERExtractor`,
    `RelationExtractor`, `TripletExtractor`, `EventDetector`
    (the classes the code imports) instead of `SemanticAnalyzer`
  Result: 230/230 tests pass (was 227/230)
- `tests/verify_rich_cli.py`: new verification script; exercises all
  14 command groups (92 --help checks, table rendering, dry-run
  formatting, --json mode, _pprint helper); 111 pass, 0 fail
2026-06-04 12:34:12 +05:30
dependabot[bot] 2d9bbf08b1 deps(deps): update pytest-benchmark requirement from >=4.0.0 to >=5.2.3 (#522)
Updates the requirements on [pytest-benchmark](https://github.com/ionelmc/pytest-benchmark) to permit the latest version.
- [Changelog](https://github.com/ionelmc/pytest-benchmark/blob/master/CHANGELOG.rst)
- [Commits](https://github.com/ionelmc/pytest-benchmark/compare/v4.0.0...v5.2.3)

---
updated-dependencies:
- dependency-name: pytest-benchmark
  dependency-version: 5.2.3
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2026-05-01 18:05:17 +05:30
ZohaibHassan16 91ba5219d0 feat(dedup): implement semantic relationship and triplet dedup v2 (#336) 2026-02-22 11:56:11 +05:00
ZohaibHassan16 2af0fe3214 feat(dedup): implement two-stage scoring prefilter (#335) 2026-02-21 03:11:29 +05:00
ZohaibHassan16 60389a0e57 feat(dedup): implement candidate generation v2 (#334) 2026-02-20 00:39:21 +05:00
KaifAhmad1 bb95c00a88 fix(benchmarks): Update vector storage test for backend store compatibility
- Fix test_vector_storage_manager_overhead to work with backend stores
- Handle both in-memory vectors and backend store vector_ids
- Ensure benchmark works with FAISS backend and other vector stores
2026-02-12 13:16:34 +05:30
KaifAhmad1andZohaibHassan16 3f12e78ca0 fix: resolve CI import errors with proper test-only mocking
- Remove mock files from main semantica module (keep test environment clean)
- Enhance conftest.py with pre-emptive sys.modules mocking
- Create mock arrow_exporter module at runtime before imports
- Fix pyarrow 'pa' alias and schema mocking issues
- Ensure benchmark tests run without heavy dependencies
- All tests pass with zero changes to main codebase structure

Co-authored-by: ZohaibHassan16 <zohaib.hassan16@example.com>
Co-authored-by: KaifAhmad1 <kaifahmad087@gmail.com>
2026-02-07 17:23:57 +05:30
KaifAhmad1andZohaib Hassan 1ff05eef42 fix: resolve CI import errors with conditional ArrowExporter handling
- Add conditional import for ArrowExporter in semantica/export/__init__.py
- Create fallback dummy class when ArrowExporter is not available in CI
- Enhanced conftest.py with pre-emptive module mocking
- Fix pyarrow 'pa' alias and schema mocking issues
- Ensure benchmark tests run without heavy dependencies
- All 138 benchmarks now pass in local testing environment

Co-authored-by: Zohaib Hassan <zohaib.hassan16@example.com>
Co-authored-by: Mohd Kaif <kaifahmad087@gmail.com>
2026-02-07 17:11:55 +05:30
KaifAhmad1andZohaib Hassan e5e012cb5e fix: add comprehensive mocking for CI environment
- Create mock_arrow_exporter.py in benchmarks/export/ directory
- Enhance conftest.py to handle missing ArrowExporter imports
- Add module-level mocking for semantica.export.arrow_exporter
- Patch sys.modules to prevent import errors in CI
- Ensure benchmark tests run without heavy dependencies
- Fix pyarrow and pdfplumber import issues for CI compatibility

Co-authored-by: Zohaib Hassan <zohaib.hassan16@example.com>
Co-authored-by: Mohd Kaif <kaifahmad087@gmail.com>
2026-02-07 16:31:28 +05:30
KaifAhmad1andZohaib Hassan 48114a1d86 fix: enhance mocking system for CI environment
- Add pyarrow, arrow, and pa to HEAVY_LIBS for proper mocking
- Enhance MockFinder to handle pyarrow and arrow modules
- Add specific 'pa' alias mocking to prevent NameError
- Improve RobustMock to handle pyarrow patterns like pa.schema
- Ensure CI compatibility with heavy library dependencies
- Fix pdfplumber and pyarrow import issues in benchmark tests

Co-authored-by: Zohaib Hassan <zohaib.hassan16@example.com>
Co-authored-by: Mohd Kaif <kaifahmad087@gmail.com>
2026-02-07 16:18:52 +05:30
KaifAhmad1andZohaib Hassan 21269ea501 feat: enhance benchmark suite with comprehensive testing and fixes
- Fix division by zero error in bulk_loader.py for production stability
- Enhance mocking system in conftest.py for PIL/Pillow and heavy libraries
- Add comprehensive benchmark_results.md with detailed performance metrics
- Include all 138 benchmark results with performance analysis
- Add production recommendations and optimization insights
- Ensure environment-agnostic CI/CD compatibility
- Maintain zero breaking changes while adding robust testing

Co-authored-by: Zohaib Hassan <zohaib.hassan16@example.com>
Co-authored-by: Mohd Kaif <kaifahmad087@gmail.com>
2026-02-07 16:08:14 +05:30
ZohaibHassan16 9b05622f8c feat(perf): benchmark suite with regressive CLI 2026-02-06 16:31:33 +05:00