Dataengineering

👋 Sign in for the ability to sort posts by relevant, latest, or top.

Humberto Villanueva

Oct 3

Make Document Pipelines Fail Loudly

#softwareengineering #testing #dataengineering #architecture

3 min read

Victor Amit

Oct 3

The AI Loop That Won't Let You Go - Victor Amit

#ai #machinelearning #dataengineering #opensource

20 min read

Jefferson Valandro

Oct 3

I turned Brazil's 73M-establishment company registry into second-fast lookups, with no server and no database

#duckdb #python #opendata #dataengineering

3 min read

FluxH91

Oct 3

EU SaaS Metrics Dashboard: Privacy-Friendly Product KPIs and Backend Counter Reconstruction

#observability #privacy #dataengineering

7 min read

Andrey Karazhev

Oct 2

Why a Numaflow watermark wouldn’t move

#dataengineering #distributedsystems #rust #opensource

7 min read

Mintu Ghosh

Oct 2

Opening a Parquet file in the browser without losing decimals, big integers or timestamps

#parquet #dataengineering #javascript #data

2 min read

Rahul R

Oct 2

Why Data Reconciliation Matters in AWS Glue: Finding Missing Records with Anti Joins

#dataengineering #bigdata #aws #python

4 min read

Data Tech Bridge

Oct 2

Context, Not Models: What Actually Made AI BI Reliable

#ai #dataengineering #llm #sql

25 min read

Open Human

Oct 2

Building a Data Audit Workbench That Holds Up in an Assessment

#compliance #dataengineering #audit

3 min read

Open Human

Oct 2

Building a Data Audit Workbench That Holds Up in an Assessment

#compliance #dataengineering #audit

3 min read

Aniketh Deshpande

Oct 1

What Actually Happens When You Call spark.read? One Line of Python, a Thousand Tasks

#spark #dataengineering #python #distributedsystems

42 min read

Kaushikreddy Lingi

Oct 1

An Analytics Agent's Permissions Should Survive a Bad Prompt

#ai #security #database #dataengineering

2 min read

Open Human

Oct 1

Building a Data Audit Workbench That Holds Up in an Assessment

#compliance #dataengineering #audit

3 min read

lnc

Oct 1

How to Build an Open Lakehouse on Your Laptop

#opensource #dataengineering #architecture #infrastructure

42 min read

Jigon Yoo

Oct 1

A bad batch loaded with zero errors. One row added $4.5 million.

#dataengineering #dbt #dataquality #python

5 min read

👋 Sign in for the ability to sort posts by relevant, latest, or top.