Cricket Analytics: Integrating Mage AI, dbt, Snowflake, and Superset
In this article, we’re diving into a data engineering demo project that’s all about bringing cricket player …
AWS
Stream AWS CloudWatch logs to Snowflake
CloudWatch logs provide insight into logs from many AWS services, but third-party observability/application performance …
Load and analyze documents in Snowflake
In this article, we will see how to analyze documents in Snowflake database using Amazon Textract. Amazon Textract is a …
Integrating Amazon MSK connect with Amazon MSK
Amazon Managed Streaming for Apache Kafka (Amazon MSK) is a managed service for Apache Kafka. In my previous article …
How to load XML to Redshift from S3 using AWS Lambda
In this article we will see how to load XML from an s3 bucket into Redshift using AWS Lambda and Redshift copy commands. …
How to pull data from API using AWS Lambda & stream to Snowflake using Snowpipe
In this article we will see how to get/pull data from an api, store in S3 and then stream the same data from S3 to …
AWS SAM in a Docker container
In this article we will see how to install AWS SAM in a docker container and to create an AWS Lambda using AWS SAM. …
How To Install Discourse In AWS Lightsail
In this article we will see How To Install Discourse In AWS Lightsail. Discourse is modern open source discussion/forum …
Exploring XML In Snowflake
In this article we will see how to load and use XML files in snowflake. Code used in this article can be found here. …
How To Stream Data From Kafka To Snowflake Using S3 and Snowpipe
In this article we will see how to stream data from kafka to snowflake using S3 and Snowpipe. Code used in this article …