We’ve revived our tech blog and will be sharing a bunch of stuff around our AI process and what it means to be an “AI first” company. Here’s an in-depth first piece about what it takes to develop a successful real life product with LLMs.

LLMs are fundamentally matching the patterns they’ve seen, and their abilities are constrained by mathematical boundaries. Embedding tricks and chain-of-thought prompting simply extends their ability to do more sophisticated pattern matching. The mathematical results imply that you can always find compositional tasks whose complexity lies beyond a given system’s abilities.

Overview of the performance of different caching solutions for Rails comparing Redis to some competitors.