Switching from Cassandra to SQLite in Elixir for High Volume Data Processing

The presentation by Jace Warren from Savi Solutions highlights the challenges faced with their Cassandra cluster, which was initially chosen for its low latency, high performance, and scalability needed for processing billions of records daily, for clients such as Burger King and Little Caesars. As the cluster faced issues and costs rose, the solution was to move to SQLite. The talk covers detailed strategies and learnings from setting up and migrating the databases, Cassandra, and SQLite schema designs, SQLite partitioning, navigating multiple SQLite databases through Ecto, and executing zero-downtime migrations. The essence of the talk was to present how Cassandra and SQLite differed in trading off capabilities and how they could both integrate with Elixir to create distributed, scalable, and fault-tolerant applications.