Migration from GenStage to Broadway for Hexdocs Pipeline

37

clicks

Migration from GenStage to Broadway for Hexdocs Pipeline

Source: dashbit.co

The blog post by Wojtek Mach details the migration of Hexdocs.pm's documentation pipeline from using GenStage to Broadway. Initially, Hexdocs.pm was a static file hosting service that evolved into an Elixir application managing documentation tarballs via SQS messages. The transition to Broadway simplified the pipeline setup, replacing custom producers with BroadwaySQS.Producer, making the solution more declarative and reducing code complexity. The change also introduced better application shutdown processes using Broadway’s

Continue reading

Related posts

Creating a Blog with Phoenix Without Using a Database

José Valim details how Dashbit created their blog using Phoenix, opting not to use a database and implementing features such as precompiling posts and live reloading.

Feb 03, 2020

Understanding How Kubernetes and the Erlang VM Interact

José Valim discusses the complementary functionalities of Kubernetes and the Erlang VM, focusing on self-healing, service discovery, automated rollouts, and configuration management.

Oct 01, 2019

Optimizing Re-compilation in Elixir Projects

Wojtek Mach discusses strategies to speed up the re-compilation processes in Elixir projects, especially focusing on identifying and managing dependencies.

Mar 23, 2020

© HashMerge 2024