141 Open Source Kafka Connect Software Projects
Free and open source kafka connect code projects including engines, APIs, generators, and tools.
Microservices Observability39 ⭐
🎉 Microservices Observability - Log Aggregation, Distributed Tracking, Metrics
Kafka Streams Emojitracker14 ⭐
Sample application for my talk 'Building Stateful Streaming Applications Without a Database'
Demo Scene1055 ⭐
👾Scripts and samples to support Confluent Demos and Talks. ⚠️Might be rough around the edges ;-) 👉For automated tutorials and QA'd code, see https://github.com/confluentinc/examples/
Cp Helm Charts647 ⭐
The Confluent Platform Helm charts enable you to deploy Confluent Platform services on Kubernetes for development, test, and proof of concept environments.
Wearedevs 201812 ⭐
Code for my talk "Stateful & Reactive Streaming Applications Without a Database" at WeAreDevelopers 2018
Mguenther Kafka Junit33 ⭐
Enables you to start and stop a fully-fledged embedded Kafka cluster from within JUnit and provides a rich set of convenient accessors and fault injectors through a lean API. Supports working against external clusters as well.
Spring Rdbms Cdc Kafka Elasticsearch30 ⭐
Denormalize and Index MySQL database with ElasticSearch and Kafka
Ksql Udf Deep Learning Mqtt Iot251 ⭐
Deep Learning UDF for KSQL for Streaming Anomaly Detection of MQTT IoT Sensor Data
Kafka Scala Examples37 ⭐
Examples of Avro, Kafka, Schema Registry, Kafka Streams, Interactive Queries, KSQL, Kafka Connect in Scala
All Things Cqrs529 ⭐
Comprehensive guide to a couple of possible ways of synchronizing two states with Spring tools. Synchronization is shown by separating command and queries in a simple CQRS application.
Kafka Connect Iot Mqtt Connector Example166 ⭐
Internet of Things Integration Example => Apache Kafka + Kafka Connect + MQTT Connector + Sensor Data
CQRS implementation using Debezium + Spring Cloud Stream + Kafka Connect + Kafka + Druid
Springboot Kafka Connect Streams61 ⭐
The main goal is to play with Kafka Connect and Streams. We have store-api that inserts/updates records in MySQL; Source connectors that monitor inserted/updated records in MySQL and push messages related to those changes to Kafka; Sink connectors that read messages from Kafka and insert documents in ES; Store-streams that listens for messages in Kafka, treats them using Kafka Streams and push new messages back to Kafka.
Springboot Kafka Debezium Ksql39 ⭐
The goal of this project is to play with Kafka, Debezium and ksqlDB. For this, we have: research-service that inserts/updates/deletes records in MySQL; Source Connectors that monitor change of records in MySQL and push messages related to those changes to Kafka; Sink Connectors and kafka-research-consumer that listen messages from Kafka and insert/update documents in Elasticsearch; finally, ksqlDB-Server that listens to some topics in Kafka, does some joins and pushes new messages to new topics in Kafka.
Schema Registry Transfer Smt34 ⭐
Kafka Connect Transform to copy Avro schemas between Schema Registries
Kafka Connect File Pulse174 ⭐
🔗 A multipurpose Kafka Connect connector that makes it easy to parse, transform and stream any file, in any format, into Apache Kafka
Postgres Kafka Demo116 ⭐
Fully reproducible, Dockerized, step-by-step, demo on how to stream tables from Postgres to Kafka/KSQL back to Postgres. Detailed blog post published on Medium.
"eCupcakesFactoryOnContainers" is based on a simplified "Microservices" architecture and docker containers. Core intent of this reference application is to provide reference implementation for .Net developers to easily get started with containerized microservices using .Net Core and Kafka.
Hivemq Mqtt Tensorflow Kafka Realtime Iot Machine Learning Training Inference263 ⭐
Real Time Big Data / IoT Machine Learning (Model Training and Inference) with HiveMQ (MQTT), TensorFlow IO and Apache Kafka - no additional data store like S3, HDFS or Spark required
Iiot Integration Apache Plc4x Kafka Connect Ksql Opc Ua Modbus Siemens S726 ⭐
Industrial IoT (IIoT) Integration and Data Processing with Apache PLC4X, Kafka Connect, KSQL (OPC-UA, Modbus, Siemens S7)
KafkaCenter is a unified platform for Kafka cluster management and maintenance, producer / consumer monitoring, and use of ecological components.
Stream Reactor836 ⭐
Streaming reference architecture for ETL with Kafka and Kafka-Connect. You can find more on http://lenses.io on how we provide a unified solution to manage your connectors, most advanced SQL engine for Kafka and Kafka Streams, cluster monitoring and alerting, and more.
Change data capture for a variety of databases. Please log issues at https://issues.redhat.com/browse/DBZ.
Kafka Connect Jenkins29 ⭐
Kafka Connect Connector for Jenkins Open Source Continuous Integration Tool
Kafka Connect Ftp45 ⭐
A Kafka Connect Source for FTP servers - Monitors files on an FTP server and feeds changes into Kafka
Kafka Connect Mongo27 ⭐
Kafka mongo connector (deeply inspired by https://github.com/DataReply/kafka-connect-mongodb)
Jcustenborder Kafka Connect Twitter116 ⭐
Kafka Connect connector to stream data in real time from Twitter.
Kafka Connectors Tests32 ⭐
Test suite for Kafka Connect connectors based on Landoop's Coyote and docker.
Kafka Connect Storage Common43 ⭐
Shared software among connectors that target distributed filesystems and cloud storage.
Kafka Helm Charts68 ⭐
In-deprecation. For Lenses please check lensesio/lenses-helm-charts. Soon Stream Reactor will also get its own Helm repository.
Hpgrahsl Kafka Connect Mongodb143 ⭐
**Unofficial / Community** Kafka Connect MongoDB Sink Connector - Find the official MongoDB Kafka Connector here: https://www.mongodb.com/kafka-connector
Fast Data Connect Cluster25 ⭐
Create Kafka-Connect clusters with docker . You put the Kafka, we put the Connect.
Kafka Connect Kcql Smt26 ⭐
Kafka-Connect SMT (Single Message Transformations) with SQL syntax (Using Apache Calcite for the SQL parsing)
Kafka Connect Github Source380 ⭐
Get a stream of issues and pull requests for your chosen GitHub repository
Kafka Connect118 ⭐
equivalent to kafka-connect :wrench: for nodejs :sparkles::turtle::rocket::sparkles:
Sequelize Kafka Connect37 ⭐
:gem: nodejs kafka connect connector for MySQL, Postgres, SQLite and MSSQL
Kafka Connect Mq Source69 ⭐
This repository contains a Kafka Connect source connector for copying data from IBM MQ into Apache Kafka.
Kafka Connect Mq Sink26 ⭐
This repository contains a Kafka Connect sink connector for copying data from Apache Kafka into IBM MQ.