Insights on Robust Job Processing with Parker and Shannon Selbert in Elixir

In this episode of Software Engineering Radio, Gavin Henry interviews Shannon and Parker Selbert about robust job processing in the Elixir ecosystem. The discussion delves into the reliability, consistency, and observability aspects of Elixir job processing, particularly through the use of the Oban framework. The Selberts explain the motivation behind Oban's creation, its integration with PostgreSQL, and their experiences and lessons learned over five years. Topics include job throughput, distributed architectures, retry algorithms, and common challenges faced by new users. The conversation underscores the critical role of PostgreSQL and Elixir in ensuring the robustness of job processing.