How To Stream Data From Kafka To Snowflake Using S3 and Snowpipe
In this article we will see how to stream data from kafka to snowflake using S3 and Snowpipe. Code used in this article …
Blog
Building Weather Alert Application using Python, Airflow, Kafka, ksqlDB, Faust and Docker
In this article we will see how to build a simple weather alert application using Python, Airflow, Kafka, ksqlDB, Faust …
Integrating Kafka Connect With Amazon Managed Streaming for Apache Kafka (MSK)
In this article we will see how to integrate Kafka connect with Amazon Managed Streaming for Apache Kafka (MSK). Code …
Snowflake Connector For Kafka
In this article we will see how to use the Snowflake connector to stream data from Kafka to Snowflake. The Snowflake …
Stream logs from EC2 to CloudWatch
In this article we will see how to send log files generated by an application running in EC2 to CloudWatch using …
Exploring ELK in Docker with Pi-hole logs
In this article we will see how to use elk in Docker with the help of logs from Pi-hole. Code used in this article can …
Exploring ksqlDB in Docker, headless ksqlDB and ksqlDB in Kubernetes
ksqlDB is built on top of Kafka Streams, a lightweight, powerful Java library for enriching, transforming, and …
Install Kafka using Ansible, monitor using Prometheus and Grafana
In this article we will see how to install Confluent Kafka using Ansible and to monitor the metrics using Prometheus and …
Exploring Kafka tombstone records in ksqlDB, MongoDB and Postgres
In this article we will see how to generate a tombstone record in Kafka and to observe the behavior in ksqlDB, MongoDB …
How to generate test data for Kafka using Faker
In this article we will see how to generate test data for Kafka using Faker. We could also generate test data using …