Swarmnest

Home › Directory › Data Pipelines & ETL

Data Pipelines & ETL

Data integration, transformation and quality tools.

JSON: /api/v1/directory.json (filter on category=data-etl)

ClickHouse

ClickHouse is a fast open-source column-oriented database management system that allows generating analytical data reports in real-time using SQL queries

See siteSee docs

Airbyte

Open-source data integration.

Free tierAPI key

dbt

Transform data in the warehouse.

Free tierNo auth

Fivetran

Managed data pipelines.

PaidAPI key

Meltano

Open-source ELT.

FreeNo auth

Apache Kafka

Distributed event streaming.

FreeNo auth

Redpanda

Kafka-compatible streaming.

Free tierAPI key

Apache Flink

Stream processing.

FreeNo auth

MotherDuck

Cloud DuckDB.

Free tierAPI key

Great Expectations

Data quality validation.

FreeNo auth

Apache Iceberg

Open table format.

FreeNo auth

Debezium

Change data capture.

FreeNo auth

Apache NiFi

Dataflow automation.

FreeNo auth

Singer

Open standard for data extraction.

FreeNo auth