Lenny AI - our first demo project

As our very first demo project, we chose to build an AI chatbot we call Lenny. Lenny is a conversational AI assistant similar to ChatGPT. Lenny is not nearly as smart as ChatGPT because it is powered by a less powerful model - the open source Meta Llama 3.1 8B model. In benchmarks run by Artificial Analysis, this Large Language Model (LLM) scores a 66 vs 100 for GPT-4o (the model that powers ChatGPT).

Our considerations for this project were to bash out a workable demo as fast as possible as cheaply as possible. We were able to get this project live within a day of Meta (ie Facebook) releasing the new model. We got the idea to launch this when we learned that Cloudflare offered Llama 3.1 8B as part of its Woker AI services.

We love Cloudflare and were confident if they were behind this service, they would make things easier and cheaper. We were not disappointed. Using the right tool for the job changes everything. That's the core principle behind our approach to solving problems.