Self-hosted ingestion

Sink a shaft to your data. Pull it to the surface.

shaft runs an agent inside your network, next to the source. It extracts on-site, loads to your warehouse, and pushes out only when the destination is remote. Secrets never transit the control plane.

Start 14-day trial Read the blog

DEPTH 000 · SURFACE

Control plane

DEPTH 012 · AGENT

Extract in your VPC

DEPTH 240 · STRATA

Transform & mask

DEPTH 999 · SEAM

Load to warehouse

Available connectors

Wire a source to a target

source

PostgreSQL

Incremental extraction from a Postgres database.

postgres

source

MySQL

Incremental extraction from a MySQL or MariaDB database.

mysql

target

BigQuery

Load rows into a BigQuery table via streaming inserts.

bigquery

source

Oracle

Incremental extraction from an Oracle database.

oracle

source

Apache Kafka

Consume a Kafka topic with agent-owned offsets.

kafka

source

REST API

Paginated pull from a REST endpoint.

rest

target

gRPC Push

Stream batches to a remote ingest endpoint.

grpc-push