Backend-agnostic bulk data import library with schema validation, batch processing, and state management
-
Updated
May 16, 2026 - TypeScript
Backend-agnostic bulk data import library with schema validation, batch processing, and state management
Distributed job execution platform with priority scheduling, worker orchestration, fault recovery, and real-time monitoring.
Deterministic crawler sharding, lease-aware SQLite state, and safe multi-worker launches.
A distributed asynchronous job processing system designed to handle concurrent workloads reliably using Redis queues, worker orchestration, retry mechanisms, dead-letter queues, and failure recovery workflows.
To associate your repository with the worker-orchestration topic, visit your repo's landing page and select "manage topics."