We can't find the internet
Attempting to reconnect
Something went wrong!
Hang in there while we get back on track
Exploring Web Scraping Techniques and Challenges
4
clicks
Source: youtube.com
In this presentation, recorded at ElixirConf US 2025, Tyler Young delves into the complexities of web scraping from two different viewpoints: the scrapers themselves and the website operators who aim to thwart them. The talk covers essential techniques for identifying non-human traffic and provides insights into how ethical scrapers can effectively navigate these challenges. Notably, it critiques the limitations of OTP’s standard HTTP tools for scraping tasks. The session also examines leading methods in bot detection to highlight the ongoing cat-and-mouse game between scrapers and prevention tactics employed by websites.
Related posts
© HashMerge 2026