Web Crawling with Elixir: Insights from Oleg Tarasenko and Tze Yiing

The podcast episode features a discussion with Oleg Tarasenko and Tze Yiing about using Elixir for web crawling. Oleg, who created the 'crawly' project, shares insights on how Elixir's concurrency model makes it ideal for orchestrating web crawling tasks. They discuss various challenges, including handling login pages and legal concerns surrounding web scraping. The conversation also touches on building a codeless scraper, and how community contributions, like those from Tze Yiing, help maintain the project. The episode emphasizes Elixir's suitability for these tasks and provides various links to resources for listeners interested in web scraping with Elixir.