November 15, 2023

Enhancing Reliability of Elixir-Based Real-Time Auctions

200

clicks

Enhancing Reliability of Elixir-Based Real-Time Auctions

Source: youtube.com

In Rafal Studnicki's experience with Whatnot, deploying an Elixir cluster that involves stateful connections and distributed state across clients is more complex than stateless services. Initially, deployments led to data inconsistencies and user disruption due to the sensitive nature of live auctions. Deployments were limited to off-peak hours to mitigate issues. The team at Whatnot aimed to improve service reliability by integrating a rigorous testing regimen into their CI pipeline and testing deployments in various conditions. They faced challenges with the Elixir cluster, which involved issues with clustering and the Delta CRDT library used by Horde, the library in charge of process distribution. Studnicki explained the debugging process, which included simulating node failures and understanding the root cause of auction disruptions during deployments. Eventually, they solved the issue by customizing the Horde library for their needs. This allowed the team to gain enough confidence in their system to move to continuous deployments, enabling them to deploy production code anytime without fear of disrupting live auctions. Studnicki also highlighted the broader benefits of Continuous Deployment (CD), which aligns with Whatnot's core principle of being responsive to customer needs by delivering value swiftly.

Securing Software with Elixir: Business and Technical Insights

Michael Lubas discusses the importance of security in Elixir software development, including how the language's design promotes safe concurrency and prevents common vulnerabilities like data races.

Nov 14, 2023

Securing Erlang Distribution Protocol in Large-Scale WhatsApp Clusters

In his talk at ElixirConf 2023, Andrew Bennett discusses WhatsApp's experience managing a large Erlang/OTP cluster and the challenges they faced with the Erlang Distribution Protocol. He highlights the development of a Native Implemented Function (NIF) called "erldist_filter_nif" that allows them to control and reduce the potential impact of certain operations on the cluster. This session provides insights into innovations pushing the boundaries of Erlang and Elixir in massive-scale production environments.

Nov 13, 2023

Kafka's Role in Scaling Backend Services and Team Structure with Elixir

Jeffery Utter discusses how the team at theScore scaled their backend services and teams using Elixir and Kafka at ElixirConf 2023. He highlights the benefits and tradeoffs of using Kafka, including enabling autonomous and decoupled teams, and provides insights into the social, organizational, and technical implications of using Kafka in an organization that heavily utilizes Elixir.

Nov 10, 2023