Skip to content
Navigation menu
Search
Powered by Algolia
Search
Log in
Create account
DEV Community
Close
#
dataengineering
Follow
Hide
Posts
Left menu
👋
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
Right menu
Iceberg v3 Is Everywhere: What Data Engineers Must Know Now
DataDriven
DataDriven
DataDriven
Follow
Nov 19
Iceberg v3 Is Everywhere: What Data Engineers Must Know Now
#
dataengineering
#
apacheiceberg
#
interview
#
database
Comments
Add Comment
9 min read
Moderation
Dashboards were built for eyes. Here's how to make analytics work for AI agents
Datafaro
Datafaro
Datafaro
Follow
Nov 19
Dashboards were built for eyes. Here's how to make analytics work for AI agents
#
analytics
#
ai
#
dataengineering
#
llm
Comments
Add Comment
4 min read
Moderation
Fabric Engines on 1B Rows: Pick by Query Shape
Sai Prudhvi Neelakantam
Sai Prudhvi Neelakantam
Sai Prudhvi Neelakantam
Follow
Nov 19
Fabric Engines on 1B Rows: Pick by Query Shape
#
fabric
#
powerbi
#
dataengineering
#
spark
Comments
Add Comment
7 min read
Moderation
Snowflake vs Databricks: How to Compare Them
Keshav
Keshav
Keshav
Follow
Nov 19
Snowflake vs Databricks: How to Compare Them
#
dataengineering
#
snowflake
#
databricks
#
cloud
Comments
Add Comment
8 min read
Moderation
Building a Zero-AWS Power Grid OLAP Explorer in the Browser with DuckDB-Wasm and Apache Parquet
GIAN FRANCO AROCUTIPA AROCUTIPA
GIAN FRANCO AROCUTIPA AROCUTIPA
GIAN FRANCO AROCUTIPA AROCUTIPA
Follow
Nov 18
Building a Zero-AWS Power Grid OLAP Explorer in the Browser with DuckDB-Wasm and Apache Parquet
#
duckdb
#
sql
#
dataengineering
#
javascript
Comments
Add Comment
5 min read
Moderation
From the USGS Seismic API to a Public Andean Observatory with dbt, DuckDB, and GitHub Actions
GIAN FRANCO AROCUTIPA AROCUTIPA
GIAN FRANCO AROCUTIPA AROCUTIPA
GIAN FRANCO AROCUTIPA AROCUTIPA
Follow
Nov 18
From the USGS Seismic API to a Public Andean Observatory with dbt, DuckDB, and GitHub Actions
#
dataengineering
#
dbt
#
duckdb
#
githubactions
Comments
Add Comment
5 min read
Moderation
MySQL to ClickHouse with Binlog CDC: A Copy-Paste Walkthrough Through Polaris
Shubham Baldava
Shubham Baldava
Shubham Baldava
Follow
Nov 18
MySQL to ClickHouse with Binlog CDC: A Copy-Paste Walkthrough Through Polaris
#
mysql
#
database
#
dataengineering
#
clickhouse
Comments
Add Comment
13 min read
Moderation
Data-cleaning edge cases that break integrations: Excel serial dates, ERP negatives and match keys
Adan Potyondy
Adan Potyondy
Adan Potyondy
Follow
Nov 18
Data-cleaning edge cases that break integrations: Excel serial dates, ERP negatives and match keys
#
dataengineering
#
etl
#
dataquality
#
excel
Comments
Add Comment
4 min read
Moderation
Warehouse, Lake, Lakehouse or Mesh? A Healthcare Guide
Nirmitee.io
Nirmitee.io
Nirmitee.io
Follow
Nov 19
Warehouse, Lake, Lakehouse or Mesh? A Healthcare Guide
#
dataengineering
#
healthcare
#
dataarchitecture
#
datalakehouse
Comments
Add Comment
4 min read
Moderation
Polars vs pandas vs DuckDB: An Honest Benchmark on 10M Rows (Time, Memory, Correctness)
Kate Steele
Kate Steele
Kate Steele
Follow
Nov 18
Polars vs pandas vs DuckDB: An Honest Benchmark on 10M Rows (Time, Memory, Correctness)
#
python
#
datascience
#
dataengineering
#
performance
Comments
1
comment
20 min read
Moderation
Turning German company websites into structured B2B data (HRB, VAT ID, directors)
Bachir Djoukbala
Bachir Djoukbala
Bachir Djoukbala
Follow
Nov 18
Turning German company websites into structured B2B data (HRB, VAT ID, directors)
#
b2b
#
webscraping
#
python
#
dataengineering
Comments
Add Comment
2 min read
Moderation
Apache Spark Architecture: Driver, Executors and DAG
Sahil Taneja
Sahil Taneja
Sahil Taneja
Follow
Nov 18
Apache Spark Architecture: Driver, Executors and DAG
#
spark
#
pyspark
#
dataengineering
#
bigdata
Comments
Add Comment
9 min read
Moderation
Same Row Count, Missing Records: 4 Ways a Count Check Can Fool You
KAREN
KAREN
KAREN
Follow
Nov 18
Same Row Count, Missing Records: 4 Ways a Count Check Can Fool You
#
dataengineering
#
database
#
sql
#
beginners
Comments
Add Comment
3 min read
Moderation
The Air Says +5 C. The Road Says -1. Surface Temperature From 3,501 Stations in 10 Countries.
Roman Kotenko
Roman Kotenko
Roman Kotenko
Follow
Nov 18
The Air Says +5 C. The Road Says -1. Surface Temperature From 3,501 Stations in 10 Countries.
#
api
#
dataengineering
#
logistics
#
opendata
Comments
Add Comment
6 min read
Moderation
Getting Started with Apache Polaris: The Setup I Recommend
vignesh A
vignesh A
vignesh A
Follow
Nov 18
Getting Started with Apache Polaris: The Setup I Recommend
#
dataengineering
#
polaris
#
iceberg
#
spark
Comments
Add Comment
9 min read
Moderation
👋
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
We're a place where coders share, stay up-to-date and grow their careers.
Log in
Create account