DEV Community

#dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Iceberg v3 Is Everywhere: What Data Engineers Must Know Now

Iceberg v3 Is Everywhere: What Data Engineers Must Know Now

Comments
9 min read
Dashboards were built for eyes. Here's how to make analytics work for AI agents

Dashboards were built for eyes. Here's how to make analytics work for AI agents

Comments
4 min read
Fabric Engines on 1B Rows: Pick by Query Shape

Fabric Engines on 1B Rows: Pick by Query Shape

Comments
7 min read
Snowflake vs Databricks: How to Compare Them

Snowflake vs Databricks: How to Compare Them

Comments
8 min read
Building a Zero-AWS Power Grid OLAP Explorer in the Browser with DuckDB-Wasm and Apache Parquet

Building a Zero-AWS Power Grid OLAP Explorer in the Browser with DuckDB-Wasm and Apache Parquet

Comments
5 min read
From the USGS Seismic API to a Public Andean Observatory with dbt, DuckDB, and GitHub Actions

From the USGS Seismic API to a Public Andean Observatory with dbt, DuckDB, and GitHub Actions

Comments
5 min read
MySQL to ClickHouse with Binlog CDC: A Copy-Paste Walkthrough Through Polaris

MySQL to ClickHouse with Binlog CDC: A Copy-Paste Walkthrough Through Polaris

Comments
13 min read
Data-cleaning edge cases that break integrations: Excel serial dates, ERP negatives and match keys

Data-cleaning edge cases that break integrations: Excel serial dates, ERP negatives and match keys

Comments
4 min read
Warehouse, Lake, Lakehouse or Mesh? A Healthcare Guide

Warehouse, Lake, Lakehouse or Mesh? A Healthcare Guide

Comments
4 min read
Polars vs pandas vs DuckDB: An Honest Benchmark on 10M Rows (Time, Memory, Correctness)

Polars vs pandas vs DuckDB: An Honest Benchmark on 10M Rows (Time, Memory, Correctness)

Comments 1
20 min read
Turning German company websites into structured B2B data (HRB, VAT ID, directors)

Turning German company websites into structured B2B data (HRB, VAT ID, directors)

Comments
2 min read
Apache Spark Architecture: Driver, Executors and DAG

Apache Spark Architecture: Driver, Executors and DAG

Comments
9 min read
Same Row Count, Missing Records: 4 Ways a Count Check Can Fool You

Same Row Count, Missing Records: 4 Ways a Count Check Can Fool You

Comments
3 min read
The Air Says +5 C. The Road Says -1. Surface Temperature From 3,501 Stations in 10 Countries.

The Air Says +5 C. The Road Says -1. Surface Temperature From 3,501 Stations in 10 Countries.

Comments
6 min read
Getting Started with Apache Polaris: The Setup I Recommend

Getting Started with Apache Polaris: The Setup I Recommend

Comments
9 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.