Files
semantica/docs/reference/graph_store.md
T
Mohd Kaif 5d70d0c10d docs: replace Exported Classes import blocks with summary tables (all 25 modules) (#567)
* docs: replace Exported Classes import blocks with summary tables across all 25 modules

* docs: add method/parameter tables to parse, ingest, ontology, normalize, triplet_store, change_management, conflicts, export, graph_store, provenance, and semantic_extract modules
2026-05-24 15:49:58 +05:30

11 KiB
Raw Blame History

title, description, icon
title description icon
Graph Store Module Unified interface for Neo4j, FalkorDB, Apache AGE, and Amazon Neptune graph databases. server

semantica.graph_store provides a single API for persisting and querying knowledge graphs in production graph databases. Swap backends with a one-line change — no application code changes needed.

Exported Classes

Class Role
GraphStore Unified interface: add_node, add_edge, query, find_paths, get_neighbors
QueryEngine Parameterized Cypher execution with result caching and explain plans
GraphAnalytics Centrality, community detection, shortest path, and PageRank on stored graphs
Neo4jStore Production workloads via Bolt — supports APOC and GDS plugins
ApacheAgeStore PostgreSQL + AGE extension — no separate graph server needed
AmazonNeptuneStore AWS Neptune — SPARQL, Gremlin, and openCypher endpoints
FalkorDBStore Redis-based — sub-millisecond latency for real-time applications

What You Get

Unified interface across Neo4j, FalkorDB, Apache AGE, Amazon Neptune, and NetworkX. Parameterized Cypher construction, query optimization, and result caching. Centrality, community detection, and path algorithms running directly against the backend. Batched node and edge loading with configurable batch sizes — 10100× faster than individual writes. Create indexes and uniqueness constraints to optimize query performance. Find paths between nodes with hop limits and relationship type filters.

Quick Start

```python from semantica.graph_store import GraphStore
store = GraphStore(
    backend="neo4j",
    uri="bolt://localhost:7687",
    user="neo4j",
    password="password",
)
```
```python store.create_index(label="Person", property="name") store.create_index(label="Organization", property="name") ``` ```python store.create_nodes(entities) store.add_edges(relationships) ``` ```python results = store.query( "MATCH (p:Person)-[:WORKS_FOR]->(o:Organization) WHERE o.name = $org RETURN p", parameters={"org": "Apple Inc."}, ) ```

GraphStore Methods

Method Returns Description
create_nodes(entities) List[str] Create nodes from entity list, returns node IDs
add_edges(relationships) List[str] Add edges from relationship list, returns edge IDs
query(cypher, parameters) List[dict] Execute Cypher query with optional parameters
create_index(label, property) None Create an index for faster lookups
delete_node(node_id) bool Delete a node by ID
delete_edge(edge_id) bool Delete an edge by ID
get_node(node_id) dict Retrieve a node by ID
get_neighbors(node_id) List[dict] Get all neighbors of a node

Backends

```python from semantica.graph_store import GraphStore
store = GraphStore(
    backend="neo4j",
    uri="bolt://localhost:7687",
    user="neo4j",
    password="password",
    database="neo4j",    # optional — targets default database
)
```

Best for: production workloads, complex Cypher queries, Bloom visualization.
```python store = GraphStore( backend="falkordb", host="localhost", port=6379, graph_name="semantica", ) ```
Best for: ultra-low latency queries over Redis protocol, edge deployments.
```python store = GraphStore( backend="apache_age", connection_string="postgresql://user:pass@localhost/graphdb", graph_name="semantica", ) ```
Best for: teams already running PostgreSQL who want graph queries without a separate service. See the [Apache AGE Guide](../graph_stores/apache_age) for setup.
```python from semantica.graph_store import GraphStore
# IAM authentication (recommended for production)
store = GraphStore(
    backend="neptune",
    endpoint="your-cluster.cluster-xxxx.us-east-1.neptune.amazonaws.com",
    port=8182,
    region="us-east-1",
    use_iam_auth=True,    # uses boto3 default credential chain
)

# Gremlin traversal
results = store.query("g.V().hasLabel('Person').limit(10)")

# openCypher query
results = store.query(
    "MATCH (p:Person)-[:WORKS_FOR]->(o:Organization) RETURN p, o",
    query_language="opencypher",
)
```

Best for: managed AWS deployments needing both SPARQL and Gremlin support.
```python store = GraphStore(backend="networkx") ```
Best for: development, testing, and graphs that fit in RAM. Data is not persisted.
| Backend | Query Language | Deployment | IAM Auth | Best For |
| ------- | -------------- | ---------- | -------- | -------- |
| Neo4j | Cypher | Self-hosted / Aura | No | Production, complex traversals, Bloom UI |
| FalkorDB | Cypher | Redis-based | No | Ultra-low latency, edge deployments |
| Apache AGE | OpenCypher | PostgreSQL extension | No | Teams already on Postgres |
| Amazon Neptune | SPARQL / Gremlin / openCypher | AWS managed | Yes | Cloud-native, multi-model, compliance |
| NetworkX | Python API | In-memory | No | Development, unit testing |

Graph Operations

# Add a single node
store.add_node(
    "apple_inc",
    node_type="Organization",
    properties={"founded": 1976, "hq": "Cupertino"},
)

# Add a directed relationship
store.add_edge(
    "steve_jobs", "apple_inc",
    "FOUNDED",
    properties={"year": 1976},
)

# Bulk operations — use for large datasets
store.create_nodes(entities)
store.add_edges(relationships)

# Delete
store.delete_node("node_id")
store.delete_edge("edge_id")

# Get neighbors
neighbors = store.get_neighbors(
    "apple_inc",
    relationship_type="HAS_EMPLOYEE",
    direction="in",    # "in" | "out" | "both"
)

# Path traversal between two nodes
paths = store.find_paths(
    start_node="steve_jobs",
    end_node="apple_inc",
    max_hops=3,
    relationship_types=["FOUNDED", "WORKED_AT"],
)

QueryEngine

QueryEngine handles query construction, optimization, and caching:

from semantica.graph_store import QueryEngine, GraphStore

store  = GraphStore(backend="neo4j", uri="bolt://localhost:7687", user="neo4j", password="password")
engine = QueryEngine(store, cache_ttl=300)   # cache results for 5 minutes

# Build parameterized Cypher
query, params = engine.build_query(
    node_labels=["Person"],
    filters={"department": "Engineering"},
    return_fields=["name", "email"],
    limit=50,
)
results = engine.execute(query, params)

# Explain query plan (Neo4j)
plan = engine.explain(query, params)
print(plan["profile"])

# Flush query cache
engine.clear_cache()

GraphAnalytics

Built-in graph analytics that run directly against the stored backend — no data export required:

from semantica.graph_store import GraphAnalytics, GraphStore

store     = GraphStore(backend="neo4j", uri="bolt://localhost:7687", user="neo4j", password="password")
analytics = GraphAnalytics(store)

# Centrality
centrality  = analytics.degree_centrality(node_label="Person", relationship_type="KNOWS")
betweenness = analytics.betweenness_centrality(node_label="Person")

# Community detection
communities = analytics.detect_communities(
    node_label="Person",
    relationship_type="KNOWS",
    algorithm="louvain",
)
print(f"Detected {len(communities)} communities")

# Shortest path
path = analytics.shortest_path("alice", "charlie", relationship_type="KNOWS")
print(f"Hops: {len(path) - 1}, Path: {' → '.join(path)}")

# All paths up to max_hops
all_paths = analytics.all_paths("alice", "charlie", max_hops=4)
Method Description
degree_centrality(node_label, relationship_type) Degree-based node importance
betweenness_centrality(node_label) Bridge-based importance
pagerank(node_label, relationship_type, damping) PageRank scores
detect_communities(node_label, relationship_type, algorithm) Louvain / Label Propagation
shortest_path(source, target, relationship_type) Minimum-hop path
all_paths(source, target, max_hops) All paths up to max depth

Schema Management

# Index for fast label lookups
store.create_index(label="Person", property="name")

# Inspect current schema
schema = store.get_schema()
print(schema["labels"])
print(schema["indexes"])
print(schema["constraints"])

Tips and Common Pitfalls

**Use `NetworkX` for development, Neo4j or FalkorDB for production.** `backend="networkx"` requires zero setup and runs in memory — ideal for local development and CI tests. Switch to a persistent backend before deploying — no code changes needed, just the backend parameter. **Create indexes before bulk loading.** `store.create_index(label="Person", property="name")` makes `MATCH` queries on `name` orders of magnitude faster. Without indexes, every query does a full scan. Create indexes first, then load data. **Use `create_nodes()` and `add_edges()` for loading multiple nodes and edges.** Individual `add_node()` calls issue one network round-trip each. Loading in bulk is significantly faster for initial graph population. **Use parameterized queries, never string interpolation.** `store.query("WHERE n.name = $name", parameters={"name": user_input})` prevents Cypher injection attacks. Never use `f"WHERE n.name = '{user_input}'"`. **Enable `QueryEngine` caching for read-heavy workloads.** `QueryEngine(store, cache_ttl=300)` avoids repeated round-trips for identical queries within the cache window — useful for analytics dashboards that refresh frequently with the same aggregation queries. **Apache AGE requires the PostgreSQL extension installed.** `backend="apache_age"` calls the AGE extension functions. If AGE is not installed in your PostgreSQL instance, you'll get a `ProgrammingError`. See the [Apache AGE Guide](../graph_stores/apache_age) for setup instructions. Build the graph before persisting it. PostgreSQL-based graph storage setup. RDF triple store for semantic web and SPARQL queries. Visualize graphs stored in any backend.