How to query Apache Iceberg tables in S3 and AWS Glue using external tables in Snowflake
As data platforms grow, one of the most expensive patterns is duplicating raw data across multiple storage engines. If …
Blog
How to set up Immich on Windows for self-hosted photo management
I have been using self-hosted services for a while now. It all started with Pogoplug, the cost effective plug and play …
Automatically Generate ER Diagrams for Your dbt Models with dbt-model-erd
Overview Not enough teams focus on conceptual modeling of data before creating dbt models. Even fewer maintain …
Automating Snowpipe Deployment with dbt
Overview Snowpipe is Snowflake’s most cost-efficient method for continuous data ingestion, automatically loading …
No-Code Data Replication from RDS to S3 and Snowflake
Overview There are multiple ways to replicate data from an Amazon RDS instance to your preferred analytics platform. An …
How to get started with Home Assistant in a virtual machine
My journey into smart home automation began with Samsung SmartThings, which worked well initially. However, as Samsung …
Workflow Orchestration with Prefect : Part I - Introduction
What is Orchestration ? Orchestration in the context of IT and software development refers to the automated …
How to copy data between s3 buckets
Overview Transferring data between Amazon S3 buckets is a common requirement for many AWS users. This guide will walk …
Cricket Analytics: Integrating Mage AI, dbt, Snowflake, and Superset
In this article, we’re diving into a data engineering demo project that’s all about bringing cricket player …
Ultimate guide on how to host dbt docs
Overview dbt (data build tool) is a popular open-source tool used for transforming data in your data warehouse. dbt Docs …