May 17, 2023

Implementing OpenAI ChatGPT Streaming with Elixir

186

clicks

Implementing OpenAI ChatGPT Streaming with Elixir

Source: fly.io

Phoenix LiveView

The content focuses on the implementation of real-time streaming of OpenAI's ChatGPT responses using Elixir. The author describes the problem of creating an interactive experience similar to OpenAI Chat UI and proposes a solution using Server Sent Events with Elixir. Initially, he introduces the `Req` library, a high-level HTTP client developed by Wojtek Mach, and explains its advantages and integration with the lower-level `Finch` library. To tackle the challenge, a function named `gpt_stream` is created, which uses the `Req.post!` function to initiate a stream and process the data using a callback function. The post provides detailed code examples and outlines the steps for setting up the streaming API call, handling the server sent events, and appending data. The author concludes with an example of calling the `gpt_stream` function and leaves further data processing, such as broadcasting to a `pid` or using `PubSub`, to the reader.

Continue reading

Related posts

Exploring Nx and Tensors Beyond Machine Learning in Elixir

This post by Jason Stiebs explores the use of NX with Elixir for efficient math programming. It explains how tensors can be used to perform various mathematical operations and highlights the potential of NX for tasks like machine learning and image manipulation.

May 10, 2023

Handling Elixir Project Development Post Ecto Dump

Mark Ericksen offers a solution for developers who have deleted old migration files and are now facing a chicken-and-the-egg problem when bootstrapping a new server or setting up a clean database. By adding a step in the mix.exs file's ecto.setup task and using the ecto.load command with specific flags, developers can safely continue development with a structure.sql file generated from mix ecto.dump and without the older migrations.

May 08, 2023

Integrating SortableJS in Phoenix LiveView for Drag-and-Drop Lists

In this blog post, Berenice Medel introduces the use of LiveView hooks to integrate SortableJS into LiveView applications. The post provides a step-by-step guide on how to create a list component with draggable items, including adding necessary logic and improving the appearance of the list items.

May 03, 2023

© HashMerge 2024