DEV Community

#bigdata

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Streaming Cross-Border Liquidity Intelligence with Exactly-Once Controls Across Asia - Hong Kong Databricks FSI Community Day 2026

Streaming Cross-Border Liquidity Intelligence with Exactly-Once Controls Across Asia - Hong Kong Databricks FSI Community Day 2026

Comments
4 min read
Why Data Reconciliation Matters in AWS Glue: Finding Missing Records with Anti Joins

Why Data Reconciliation Matters in AWS Glue: Finding Missing Records with Anti Joins

Comments
4 min read
Turning Southeast Asia Credit Volatility into Faster Decisions with Databricks Liquid Clustering - Hong Kong Databricks FSI Community Day 2026

Turning Southeast Asia Credit Volatility into Faster Decisions with Databricks Liquid Clustering - Hong Kong Databricks FSI Community Day 2026

2
Comments
4 min read
Power BI Technical Article : Data Modelling, Relationships & Joins

Power BI Technical Article : Data Modelling, Relationships & Joins

Comments
9 min read
Overcoming Data Silos and Interoperability Issues in Enterprise Storage Systems

Overcoming Data Silos and Interoperability Issues in Enterprise Storage Systems

2
Comments
7 min read
The Semantic Compression Problem: Engineering AI-Ready Views for Complex SQL

The Semantic Compression Problem: Engineering AI-Ready Views for Complex SQL

Comments 1
10 min read
Mengenal Data Engineering: Pahlawan di Balik Layar Dunia Data - 23:08

Mengenal Data Engineering: Pahlawan di Balik Layar Dunia Data - 23:08

Comments
2 min read
Stream 50 million rows without OOM: Lazy chunked Query Streaming.

Stream 50 million rows without OOM: Lazy chunked Query Streaming.

Comments 1
1 min read
What a Delta table actually is: Parquet files plus a transaction log

What a Delta table actually is: Parquet files plus a transaction log

Comments
3 min read
Lakehouse vs Data Warehouse vs Data Lake: The Difference in One Picture

Lakehouse vs Data Warehouse vs Data Lake: The Difference in One Picture

Comments
2 min read
Open-source tool: Cross-database universal "field-level" data lineage analysis and visualization(Part 3 of 3)

Open-source tool: Cross-database universal "field-level" data lineage analysis and visualization(Part 3 of 3)

Comments
2 min read
Open-source tool: Cross-database universal "field-level" data lineage analysis and visualization (Part 2 of 3)

Open-source tool: Cross-database universal "field-level" data lineage analysis and visualization (Part 2 of 3)

Comments
4 min read
Pruthivika Meets Redshift: Turning Big Data into Smart Insights ☁️📊

Pruthivika Meets Redshift: Turning Big Data into Smart Insights ☁️📊

Comments
5 min read
Open-source tool: Cross-database universal "field-level" data lineage analysis and visualization (Part 1 of 3)

Open-source tool: Cross-database universal "field-level" data lineage analysis and visualization (Part 1 of 3)

Comments
2 min read
Zero-copy columnar transfer: Apache Arrow meets ClickHouse in Python.

Zero-copy columnar transfer: Apache Arrow meets ClickHouse in Python.

Comments 1
1 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.