← All projects

Redpanda Connect

A declarative connector framework for building data pipelines simply.

Data & Analyticsdata-pipelineetlconnectorstreamingstatelessat-least-onceopen-source
Redpanda Connect screenshot

About

Redpanda Connect (formerly Benthos) is a declarative connector framework for building data pipelines using chained, stateless processing steps. It provides transaction-based resiliency with back pressure to guarantee at-least-once delivery when connecting to compatible sources and sinks. It overlaps with integration frameworks, log aggregators, and ETL engines, serving as a complement or simpler alternative to traditional data engineering tools.

Problem

Building reliable, resilient data pipelines that guarantee message delivery without complex infrastructure is difficult.

For

data engineers and developers building data pipelines

How it works

Users define pipelines declaratively using chained, stateless processing steps; the framework handles transaction-based resiliency and back pressure automatically.

Business model

open-source

Status

launched

Company

Redpanda

Similar projects