Netflix Reworks Conductor for 420 Million Monthly Workflow Executions and 10X Larger Workflows

Netflix rebuilt Conductor because loading whole workflows into memory stopped scaling at 420 million executions a month. 4.0 stores tasks separately from workflow metadata and moves evaluation off the request path into per-workflow queues. Tasks per workflow went from about 2,500 to 30,000, P99 evaluation latency dropped roughly 40%, and failed lock acquisitions fell from ~2,700 per interval to essentially zero.