Commit Graph

1 Commits

Author SHA1 Message Date
32fe81de30 feat: refactor data processing pipeline to use async/await for non-blocking I/O
The core data ingestion module has been rewritten to replace synchronous file reads and database writes with asynchronous coroutines using asyncio. This change eliminates thread pool overhead for I/O-bound operations, improving throughput under high concurrency. The `process_batch` function now awaits `aiofiles.open` and `asyncpg.execute`, with error handling updated to propagate exceptions through the event loop.
2025-11-23 19:30:37 +00:00