October 13, 2023

Enhancing Complex Data Processing with DAGs in Elixir

134

clicks

Enhancing Complex Data Processing with DAGs in Elixir

Source: youtube.com

Zack Kayzer and Stephanie Lane from cars.com discuss the challenges associated with complex modules in Elixir that involve multiple private functions with intertwined data and logic. They propose using Directed Acyclic Graphs (DAGs) to sort out dependencies and maintain clear relationships between data points. They introduce an abstraction called 'Pacer.Workflow' built on top of graphing libraries like Erlang's :digraph and the Hex package LibGraph. Pacer.Workflow is designed to enhance the developer experience by providing compile-time checks, Telemetry events, and focus on documentation and example usage. The talk covers how Pacer.Workflow allows for collapsing multiple graph nodes into single representations, allowing parallel execution of functions where possible. The solution aims to simplify testing, provide granular instrumentation and metrics, and facilitate single responsibility modules. The speakers also delve into the technical details of DAGs, such as topological sorts and graph visualization, and explain how these concepts are applied in the Pacer.Workflow abstraction.

Automated Telemetry for Elixir Production Environments

Chris Bailey discusses the work that his team at Vetspire has done to automate the process of bootstrapping an easy, ergonomic Telemetry solution for Elixir production apps, making good metrics/traces/telemetry less manual, repetitive, and error-prone.

Oct 23, 2023

Balancing Technical Skills with Vision, Leadership, and Communication in Software Engineering

Miki Rezentes discusses the importance of vision, leadership, and communication in software engineering, and how these qualities contribute to the overall success of a developer, regardless of title or position.

Oct 11, 2023

Managing Elixir Development Teams

Sundi Myint discusses what is unique about managing and working with Elixir teams, including fostering effective communication. She explores the challenges of balancing different opinions on strategy, adopting new technologies, and delivering feedback to engineers.

Oct 12, 2023