Technical Blog

Tag: #async

Deep dives into data engineering, cloud architecture, AI/ML, and the technologies that power modern data platforms.

April 22, 2024•python

High-Performance Async Python ETL: Processing Millions of API Records to BigQuery

Production-ready async Python pattern for extracting millions of API records with automatic pagination, retry logic with exponential backoff, and seamless BigQuery integration using aiohttp and uvloop for maximum throughput.

Read article

February 20, 2022•python

Concepts - Coroutine in Python

pythonasyncdata-pipelines

Deep dive into Python coroutines for building efficient data processing pipelines. Learn generator-based coroutines, the send method, coroutine decorators, and patterns for streaming data transformations.

Read article