mirror of
https://github.com/semantica-agi/semantica.git
synced 2026-08-29 04:26:20 +00:00
* refactor(export): centralize graph-payload key normalization
Graph payloads circulate under two vocabularies, entities/relationships and nodes/edges, and consumers each reconciled them locally with competing idioms. The same payload could be exported, silently dropped, or rejected depending on which consumer read it.
Add normalize_graph_payload() to utils.helpers as the single place that decision is made. Both spellings present with one empty resolves to the populated one, which is the shape JSONExporter emits; both non-empty and different is refused, since there is no basis to prefer either and picking one would silently discard the other; a non-empty mapping with no recognized key raises rather than returning empty collections, with require_recognized=False for callers that should degrade.
Adopt it in the three exporters that genuinely alias. LPGExporter read nodes with entities as the default, so it dropped every entity when nodes was present but empty, losing everything on a JSON round-trip. ArangoAQLExporter had the same idiom plus a manual fallback. Neo4jCSVExporter routes its mapping branch through the shared resolver so the reference implementation cannot drift; its attribute branch stays local, since objects are not mappings.
Also feed LPGExporter._generate_indexes the resolved entities. It read entities directly, so a nodes/edges payload produced no indexes even once node generation was fixed.
CSVExporter and JSONExporter are deliberately excluded: they write entities, relationships, nodes and edges as separate outputs by design rather than reconciling two spellings of one collection, so normalizing there would rename output files.
* fix(export): reject non-mapping input to the YAML exporters
export_yaml declared Union[Dict[str, Any], List[Dict[str, Any]]], but both
YAML exporters read their payload by key, so a list reached .get() and
surfaced as a bare AttributeError from inside the exporter, naming neither
the offending argument nor the shape expected.
Reject rather than wrap. These formats distinguish entities from
relationships from triplets, so inferring which collection a bare list
represents would silently mislabel the records, and wrapping it under an
unrecognised key would write a structurally valid file with every
collection empty - trading a loud failure for silent data loss.
Validate in the exporters, matching the existing precedent in
Neo4jCSVExporter._normalize_graph, so direct users of the classes get the
same contract as callers of the convenience wrapper. Narrow the wrapper
type hint to Dict[str, Any] to match.
* fix(export): address YAML exporter review findings
- semantica/export/yaml_exporter.py — import Sequence from typing
instead of collections.abc. `Sequence[str]` in _require_mapping's
annotation is evaluated at function-definition time; collections.abc.Sequence
only became subscriptable in Python 3.9, so on the 3.8 this project
declares support for, importing this module raised TypeError.
typing.Sequence has supported subscripting since 3.5.3. Mapping stays
imported from collections.abc since it's only used for isinstance.
- tests/export/test_yaml_exporter_input_validation.py — clean up each
test's tempfile.mkdtemp() dir via addCleanup instead of leaking it,
and read exported YAML through a context manager instead of an
unclosed yaml.safe_load(open(...)).
* fix(export): reject YAML export payloads with no recognized key
Both YAML exporters built their output from a fixed set of `.get(key, [])`
lookups, so a mapping keyed by anything else serialized to a structurally
valid file with every collection empty. Nothing signalled the loss: no
exception, no warning, and the progress log reported a completed export.
The only way to notice was to open the file. The realistic trigger is
re-exporting an `export_json` payload, whose `{"data", "count", "metadata"}`
envelope drops every record.
- SemanticNetworkYAMLExporter.export_semantic_network now resolves its
collections through normalize_graph_payload(), which raises rather than
returning empty collections for an unrecognized mapping. Adopting the
shared resolver rather than repeating the check locally also brings the
'nodes'/'edges' aliases, so ContextGraph.to_dict() — the most direct path
from this library's own graph type to YAML, used in
examples/capability_gap_context_graphs_example.py — exports its records
instead of an empty file.
- export_for_pipeline built its nested semantic network from the same
defaulted lookups and had the same defect; it goes through the resolver
too.
- YAMLSchemaExporter.export_ontology_schema gets the equivalent check over
its own key set. Schemas are a separate vocabulary with no aliasing, so
_require_recognized_keys lives in this module rather than in the shared
graph resolver.
- 'metadata' is deliberately not sufficient to make a payload recognized.
An export_json envelope carries one, so accepting it would readmit the
case this fix is most likely to be needed for.
- An empty mapping is still exported: an empty graph is legitimate and has
no records to lose.
- SemanticNetworkYAMLExporter.export() serializes before creating the
output directory, so a rejected export leaves nothing behind.
The two rejections keep distinct exception types, following what the
codebase already does: a payload of the wrong *type* cannot be exported at
all and raises ProcessingError, matching Neo4jCSVExporter._normalize_graph;
a mapping whose *contents* are unusable raises ValidationError, matching
normalize_graph_payload. _require_mapping therefore runs first at every
entry point, so a non-mapping never reaches the resolver.
Docstring Raises sections, export_usage.md and docs/reference/export.md
record the accepted input shapes and both failures.
Closes #953.
* fix(export): reject payloads whose records resolve to nothing
Addresses the Qodo findings on #958.
Presence-only recognition (finding 1): checking that a recognized key is
present answered "did the caller use our vocabulary" when the question that
matters is "did anything the caller supplied survive". A payload like
{"entities": [], "data": [...records...]} cleared the check, resolved to
empty, and dropped every record under 'data' -- the silent-empty export by a
narrower route.
- utils/helpers.py — split the check in two. _require_recognized_keys keeps
the presence rule; _require_nothing_dropped runs after resolution and
refuses a payload that resolved to nothing while an unread key still holds
records. Only a non-empty list counts as evidence: ContextGraph.to_dict()
always carries a populated 'statistics' dict, and an empty graph must stay
exportable, so 'metadata', 'statistics' and 'count' are named as context
rather than records.
- export/yaml_exporter.py — the schema path had the same hole and now runs
both checks through the shared helpers rather than its own copy, so the
two vocabularies cannot drift apart in what counts as a silent-empty
export.
Progress reported success on a failed write (finding 3): export_semantic_
network stops its tracking as completed once serialization returns, but
export() then creates the directory and writes the file. A failure there
left the tracker showing a completed export with no output.
- export/yaml_exporter.py — the serialization span now says it serialized,
not that it exported, and export() opens its own span around the
filesystem work that stops as failed on error. Nothing reports a completed
export until the bytes are on disk.
Finding 2 (export_yaml no longer accepts List[Dict]) is the intended
resolution of #952 rather than a regression: wrapping a bare list under a
guessed key is what would mislabel the records. The signature, docstring and
PR description already record the narrowed contract.
Tests cover both directions of each fix, including that an empty
ContextGraph still exports and that a failing write is not reported as
completed.
* fix(export): validate collection values and make Neo4j mappings strict
Two gaps at the boundary the shared normalizer is supposed to own.
_resolve_collection() resolved on truthiness alone, so a recognized key
could still hold something that is not a collection of records:
{"entities": "abc"} normalized to three single-character "records", and
{"entities": 42} surfaced as a raw TypeError from list() inside whichever
exporter happened to read it, naming the exporter rather than the payload
key at fault. Collection values are now validated before conversion --
strings, bytes, mappings, and non-iterable scalars are rejected by key
name, and each element must be a mapping or an attribute-carrying object,
the two record shapes the exporters actually read. None stays legal as an
absent collection, the spelling a JSON round-trip produces for []; it
cannot hide dropped records, since _require_nothing_dropped() still runs.
Every spelling present is validated, not just the one that wins, so a
malformed alias is not excused by a well-formed canonical key.
Neo4jCSVExporter._normalize_graph() opted out of the recognized-key check
for mappings, which left it able to turn {"data": [...]} into header-only
CSVs indistinguishable from a genuinely empty graph -- the exact failure
the rest of the change exists to prevent. Mapping payloads now go through
normalize_graph_payload() on its default terms. The attribute path for
graph objects is untouched. With no caller left opting out, the
require_recognized flag is removed rather than kept as a way back into
the silent-empty export.
Regression tests cover the malformed values end to end through every
export path that reads the normalizer, and assert the rejected Neo4j
export writes no CSV files.
* fix(export): close YAML schema and record validation gaps
Fix 1 -- _require_usable_schema silent data loss (P1):
_require_usable_schema() passed all values from _SCHEMA_KEYS into
_require_nothing_dropped() as evidence that records survived. Scalar
metadata fields such as version='1.0' and uri='http://...' are truthy
strings, so any one of them caused _require_nothing_dropped() to return
early and silently discard records stored under an unread key alongside
them (e.g. {'version': '1.0', 'nodes': [{'id': 'c1'}]}). Fixed by
building the resolved list from only non-empty list/tuple values of
recognised schema keys.
Fix 2 -- _is_record accepts modules and type objects (P2):
_is_record() accepted any object with __dict__, which includes Python
modules and class objects. Elements that passed _coerce_records then
reached exporters and raised AttributeError (e.g. module 'math' has no
attribute 'get') rather than a ValidationError at the validation
boundary. Fixed by excluding types.ModuleType and type from the
__dict__ branch while preserving support for all user-defined
attribute-bearing record objects.
Tests: 101 tests pass across
tests/utils/test_normalize_graph_payload.py
tests/export/test_yaml_exporter_key_recognition.py
tests/export/test_yaml_exporter_input_validation.py
tests/export/test_neo4j_csv_exporter.py
* fix(export): close exception-type and record-shape gaps in normalize_graph_payload
LPGExporter and ArangoAQLExporter called normalize_graph_payload() with no
type guard, so non-mapping input raised ValidationError from inside the
resolver while the YAML and Neo4j exporters raised ProcessingError for the
identical mistake -- inconsistent with the exception-type contract this PR
establishes. Both now use the shared _require_mapping() guard (moved from
yaml_exporter.py into utils/helpers.py so all three can use it).
Neo4jCSVExporter._normalize_graph checked isinstance(graph, dict), so a
non-dict Mapping (MappingProxyType, ChainMap) fell through to the
object-attribute branch and was rejected, even though the identical payload
exported fine via the other three exporters. Now checks isinstance(graph,
Mapping).
normalize_graph_payload() accepts dataclass/attribute-bearing object
records, but LPGExporter/ArangoAQLExporter call .get(...) directly on
resolved entities -- an object-shaped record passed validation only to
crash with a raw AttributeError once used, the exact failure this
boundary exists to prevent. Records are now converted to plain dicts at
the boundary (_coerce_records -> new _record_to_dict), so every consumer
gets a uniform shape regardless of which reading the caller used.
Two non-empty spellings of the same collection holding identical records
in a different order were rejected as conflicting, since the check used
plain list equality. Comparison is now an order-independent multiset of
each record's canonical JSON form.
* docs(changelog): add entry for #958 YAML export input hardening
Documents the full arc of #958 -- the normalize_graph_payload()
centralization, YAML input validation, both review rounds from
@Sameer6305, and the exception-type/record-shape follow-up fixes -- plus
closes #956, #952, #953.
---------
Co-authored-by: Pravit Ampapathini <pravitampapathini@Pravits-MacBook-Air-3.local>
Co-authored-by: Sameer Kadam <sskadam6305@gmail.com>
Co-authored-by: KaifAhmad1 <kaifahmad087@gmail.com>
16 KiB
16 KiB
title, description, icon
| title | description | icon |
|---|---|---|
| Export Module | Export knowledge graphs to RDF, Parquet, LPG, ArangoDB AQL, CSV, GraphML, OWL, JSON-LD, Arrow, and vector formats. | file-export |
semantica.export serializes knowledge graphs to every downstream format:
- RDF: Turtle, JSON-LD, N-Triples, RDF/XML: with optional W3C PROV-O provenance inline
- Analytics: Apache Parquet and Arrow for Spark, BigQuery, Databricks
- Graph databases: Cypher
CREATEstatements for Neo4j; AQLINSERTfor ArangoDB - Standard formats: GraphML, GEXF, Graphviz DOT, CSV, OWL 2.0
- Vector export: NumPy
.npz, FAISS index, binary for embedding pipelines
Exported Classes
| Class | Output formats | Notes |
|---|---|---|
RDFExporter |
Turtle, JSON-LD, N-Triples, RDF/XML | export_to_rdf() → string; export() → file |
ParquetExporter |
.parquet |
Requires pyarrow; explicit typed schema |
LPGExporter |
Cypher CREATE |
Neo4j and Memgraph compatible |
ArangoAQLExporter |
AQL INSERT |
Vertex and edge collections |
GraphExporter |
GraphML, GEXF, Graphviz DOT | Standard graph interchange formats |
OWLExporter |
OWL 2.0 in Turtle/XML | Ontology serialization |
CSVExporter |
.csv |
export_entities() and export_relationships() |
VectorExporter |
JSON, NumPy .npz, FAISS index, binary |
Embedding vector export |
ArrowExporter |
Apache Arrow IPC | Requires pyarrow; zero-copy transfer |
DistanceExporter |
CSV, JSONL | Pairwise distance metrics; takes a graph arg |
ReportGenerator |
HTML, Markdown, JSON, plain text | Analytics reports |
NamespaceManager |
: | RDF namespace extraction and declaration generation |
Getting Started
from semantica.export import RDFExporter
# Export a knowledge graph dict to Turtle
exporter = RDFExporter()
rdf_str = exporter.export_to_rdf(graph, format="turtle")
with open("output.ttl", "w") as f:
f.write(rdf_str)
Or use the one-liner convenience functions:
from semantica.export import export_rdf, export_csv, export_lpg
export_rdf(graph, "output.ttl", format="turtle")
export_csv(graph, "output_base") # writes entities and relationships as CSV
export_lpg(graph, "import.cypher", method="cypher")
Quick Export
```python from semantica.export import RDFExporterexporter = RDFExporter()
rdf_str = exporter.export_to_rdf(graph, format="turtle")
```
exporter = ParquetExporter(compression="snappy")
exporter.export_entities(entities, "nodes.parquet")
exporter.export_relationships(relationships, "edges.parquet")
```
exporter = LPGExporter()
exporter.export(graph, "import.cypher") # Cypher CREATE statements
```
Exporters
Export to W3C RDF formats: Turtle, JSON-LD, N-Triples, and RDF/XML.**`export_to_rdf()` returns a string; `export()` writes to a file:**
```python
from semantica.export import RDFExporter
exporter = RDFExporter()
# Returns RDF string
turtle_str = exporter.export_to_rdf(graph, format="turtle") # Turtle
jsonld_str = exporter.export_to_rdf(graph, format="jsonld") # JSON-LD
nt_str = exporter.export_to_rdf(graph, format="ntriples") # N-Triples
xml_str = exporter.export_to_rdf(graph, format="rdfxml") # RDF/XML
# Accepted format aliases: "ttl" -> turtle, "nt" -> ntriples, "xml" -> rdfxml,
# "json-ld" -> jsonld, "rdf" -> rdfxml
# Write directly to file
exporter.export(graph, "output.ttl", format="turtle")
# Also available
exporter.export_knowledge_graph(graph, "output.ttl", format="turtle")
```
<Warning>
**`export_to_rdf()` returns a string: it does not write a file.** Call `export()` or `export_knowledge_graph()` to write directly to disk.
</Warning>
<Tip>
**Use `export_to_rdf()` + string for inspection, `export()` for production.** In notebooks or debug sessions, `export_to_rdf()` is handy for quick inspection. For CI pipelines and pipelines writing files, `export()` is a single call.
</Tip>
<Tip>
**Use `turtle` for human readability, `ntriples` for streaming.** Turtle is compact and readable for debugging and sharing. N-Triples (`.nt`) is line-oriented: one triple per line: making it safe to stream, concatenate, and process with standard Unix tools.
</Tip>
**Namespace management:**
```python
from semantica.export import NamespaceManager, RDFExporter
ns_manager = NamespaceManager()
# ns_manager.namespaces contains the built-in prefix dict (rdf, rdfs, owl, xsd, semantica)
# Add custom namespaces by updating the dict directly
ns_manager.namespaces["ex"] = "http://example.org/"
ns_manager.namespaces["schema"] = "https://schema.org/"
# Generate Turtle prefix declarations
decls = ns_manager.generate_namespace_declarations(
ns_manager.namespaces, format="turtle"
)
print(decls) # @prefix ex: <http://example.org/> . etc.
```
**Temporal export (OWL-Time):**
```python
# Pass include_temporal=True to embed OWL-Time interval triples
turtle_str = exporter.export_to_rdf(
graph,
format="turtle",
include_temporal=True,
time_axis="valid", # "valid" | "transaction" | "both"
)
```
exporter = ParquetExporter(compression="snappy")
# compression: snappy | gzip | brotli | zstd | lz4 | none
# Export entities and relationships as separate Parquet files
exporter.export_entities(entities, "nodes.parquet")
exporter.export_relationships(relationships, "edges.parquet")
# Export full knowledge graph (writes entities.parquet and relationships.parquet)
exporter.export_knowledge_graph(graph, "output_base")
# → output_base_entities.parquet, output_base_relationships.parquet
# Generic export from list or dict
exporter.export(entities, "entities.parquet")
exporter.export(graph, "output_base")
```
<Warning>
**`ParquetExporter` and `ArrowExporter` require `pyarrow`.** Both fall back to a no-op stub class if `pyarrow` is not installed. Install with `pip install pyarrow` before using these exporters.
</Warning>
<Tip>
**Use `ParquetExporter` for downstream analytics.** Parquet preserves column types (int, float, datetime) that CSV loses and is natively supported by Spark, BigQuery, Databricks, and Snowflake. Use `compression="snappy"` for a good balance of speed and compression.
</Tip>
Requires `pyarrow`: `pip install pyarrow`. Schema is explicitly typed.
```python
from semantica.export import CSVExporter
exporter = CSVExporter(delimiter=",")
exporter.export_entities(entities, "nodes.csv")
exporter.export_relationships(relationships, "edges.csv")
exporter.export_knowledge_graph(graph, "output_base")
```
```python
from semantica.export import SemanticNetworkYAMLExporter
exporter = SemanticNetworkYAMLExporter()
exporter.export(graph, "graph.yaml")
```
The YAML exporters read `entities`/`relationships`/`triplets` (with
`nodes`/`edges` accepted as aliases, so `ContextGraph.to_dict()` exports
directly). A non-empty mapping supplying none of them raises
`ValidationError` rather than writing a file with every collection empty,
as does one whose collection value is not a list of records
(`{"entities": "abc"}`).
```python
from semantica.export import LPGExporter
exporter = LPGExporter()
# Write Cypher CREATE statements to file
exporter.export(graph, "import.cypher")
# Also available
exporter.export_knowledge_graph(graph, "import.cypher")
```
**ArangoAQLExporter** writes `INSERT` statements for ArangoDB:
```python
from semantica.export import ArangoAQLExporter
exporter = ArangoAQLExporter(
vertex_collection="entities",
edge_collection="relationships"
)
# Write AQL INSERT statements to file
exporter.export(graph, "import.aql")
exporter.export_knowledge_graph(graph, "import.aql")
```
Both exporters write to a file and return `None`.
`LPGExporter`, `ArangoAQLExporter`, and `Neo4jCSVExporter` resolve mapping
payloads on the same terms as the YAML exporters above, so an unrecognized
or malformed mapping is rejected instead of exported as an empty graph.
`Neo4jCSVExporter` still reads graph *objects* off their
`nodes`/`entities` and `edges`/`relationships` attributes.
<Warning>
**`ArangoAQLExporter.export()` and `LPGExporter.export()` write to a file and return `None`.** They do not return the AQL/Cypher string. Write to a file and read it back if you need the string.
</Warning>
exporter = GraphExporter()
exporter.export(graph, "graph.graphml", format="graphml") # Gephi, yEd
exporter.export(graph, "graph.gexf", format="gexf") # Gephi streaming
exporter.export(graph, "graph.dot", format="dot") # Graphviz
```
```python
from semantica.export import OWLExporter
exporter = OWLExporter()
exporter.export(ontology, path="ontology.owl", format="owl-xml")
exporter.export(ontology, path="ontology.ttl", format="turtle")
```
```python
from semantica.export import VectorExporter
exporter = VectorExporter()
# vectors: list of dicts with 'id', 'vector', 'text', 'metadata' keys
exporter.export(vectors, "vectors.json", format="json")
exporter.export(vectors, "vectors.npz", format="numpy") # NumPy .npz
exporter.export(vectors, "vectors.bin", format="binary")
exporter.export(vectors, "vectors.faiss", format="faiss")
```
**ArrowExporter**: requires `pyarrow`:
```python
from semantica.export import ArrowExporter
exporter = ArrowExporter()
exporter.export(graph, "graph.arrow")
```
**DistanceExporter**: takes a `graph` argument at construction:
```python
from semantica.export import DistanceExporter
exporter = DistanceExporter(graph) # graph is required
# Compute all pairwise distances and write to file
exporter.to_csv("distances.csv")
exporter.to_jsonl("distances.jsonl")
# Compute with column selection and optional node subset
exporter.to_csv(
"distances.csv",
include=["source_id", "target_id", "hop_count", "distance_band"],
node_subset=["node_a", "node_b", "node_c"],
)
# Return as pandas DataFrame (requires pandas)
df = exporter.to_dataframe(include=["hop_count", "semantic_similarity"])
# Return as string (for API responses)
csv_str = exporter.to_csv_string(node_subset=["node_a", "node_b"])
jsonl_str = exporter.to_jsonl_string()
```
Available `include` columns: `source_id`, `source_type`, `target_id`, `target_type`, `hop_count`, `weighted_distance`, `semantic_similarity`, `distance_band`, `source_betweenness`, `target_betweenness`.
<Warning>
**`DistanceExporter` requires a graph at construction.** Instantiate as `DistanceExporter(graph)`, not `DistanceExporter()`. Semantic similarity columns (`semantic_similarity`) require the graph nodes to have embeddings in their properties.
</Warning>
**ReportGenerator:**
```python
from semantica.export import ReportGenerator
generator = ReportGenerator()
generator.generate_report(data, "report.html", format="html")
generator.generate_report(data, "report.md", format="markdown")
generator.generate_report(data, "report.json", format="json")
generator.generate_report(data, "report.txt", format="text")
```
Convenience Functions
from semantica.export import (
export_rdf, export_json, export_parquet, export_csv,
export_lpg, export_arango, export_graph, export_owl,
export_vector, export_arrow, export_yaml, generate_report,
)
export_rdf(graph, "output.ttl", format="turtle")
export_rdf(graph, "output.nt", format="ntriples")
export_json(graph, "output.json", format="json")
export_parquet(graph, "output_base", compression="snappy")
export_csv(graph, "output_base") # uses CSVExporter.export()
export_lpg(graph, "import.cypher", method="cypher")
export_arango(graph, "import.aql")
export_graph(graph, "graph.graphml", format="graphml")
export_owl(ontology, "ontology.owl", format="owl-xml")
export_vector(vectors,"vectors.json", format="json")
export_arrow(graph, "graph.arrow")
export_yaml(graph, "graph.yaml", method="semantic_network")
generate_report(data, "report.html", format="html")
The export_csv convenience function delegates to CSVExporter.export(). For per-type exports use the class directly (exporter.export_entities(), exporter.export_relationships()).
Format Reference
| Format string | Canonical name | Exporter | File ext | Best for |
|---|---|---|---|---|
"turtle" / "ttl" |
turtle |
RDFExporter |
.ttl |
Readable RDF, ontology sharing |
"jsonld" / "json-ld" |
jsonld |
RDFExporter |
.jsonld |
APIs, Linked Data, JSON pipelines |
"ntriples" / "nt" |
ntriples |
RDFExporter |
.nt |
Streaming RDF, line-by-line processing |
"rdfxml" / "xml" / "rdf" |
rdfxml |
RDFExporter |
.rdf |
W3C RDF/XML, broadest compatibility |
"parquet" |
parquet |
ParquetExporter |
.parquet |
Spark, BigQuery, Databricks, Snowflake |
"cypher" |
cypher |
LPGExporter |
.cypher |
Neo4j, Memgraph import |
"aql" |
aql |
ArangoAQLExporter |
.aql |
ArangoDB vertex + edge collections |
"graphml" |
graphml |
GraphExporter |
.graphml |
Gephi, yEd visualization |
"gexf" |
gexf |
GraphExporter |
.gexf |
Gephi streaming format |
"dot" |
dot |
GraphExporter |
.dot |
Graphviz rendering |
"owl-xml" |
owl-xml |
OWLExporter |
.owl |
OWL 2.0 ontology distribution |
"csv" |
csv |
CSVExporter |
.csv |
Spreadsheets, simple pipelines |
"yaml" |
yaml |
SemanticNetworkYAMLExporter |
.yaml |
Human-readable config-driven use |
"arrow" |
arrow |
ArrowExporter |
.arrow |
Zero-copy inter-process transfer |
"json" |
json |
VectorExporter |
.json |
Vector embeddings |
"numpy" |
numpy |
VectorExporter |
.npz |
NumPy arrays from embeddings |
"binary" |
binary |
VectorExporter |
.bin |
Raw float32 binary |
"faiss" |
faiss |
VectorExporter |
.faiss |
Direct FAISS index files |
"html" / "markdown" / "json" / "text" |
: | ReportGenerator |
.html / .md / .json / .txt |
Analytics reports |
- Triplet Store — Store RDF exports in a SPARQL-queryable backend.
- Ontology — Export OWL ontologies.
- Provenance — Include provenance metadata in RDF exports.
- Pipeline — Add export as a final pipeline step.