The backend Dagster pipeline is tied into the Reddit API via the praw library, allowing for complex and scheduled queries to build up a database of high-quality posts to draw from. This can easily be extended by using any Dagster resources or operations, allowing for plug-and-play integration to any other data source supported by dagster (or an easily-implementable Dagster resource definition) you want to include in the Only Newsletter. Describe the trends, topics, or subjects you want to hear about and Gemini will check the cached list of high-quality data from previous queries and perform any of the defined pipeline runs for up-to-the-minute data from Reddit (and soon, Discord and Twitter) to draw from. Gemini then constructs a high-quality newsletter specifically tailored to the content you want to know about and serves it to you via a Flask SPA built with Alpine.js, HTMX, and Tailwind for a maximally-lightweight turnaround time. In the future, I'd like to integrate email signups and define Gemini in the Dagster scheduling resources so I can finally mass-unsubscribe from all the newsletters clogging my inbox to keep up with this stuff -- and stick to reading the Only AI Newsletter.
Category tags: