17 days ago

The Department of “Engineering The Hell Out Of AI”

Link: https://ea.rna.nl/2024/02/07/the-department-of-engineering-the-hell-out-of-ai/

ChatGPT has acquired the functionality of recognising an arithmetic question and reacting to it with on-the-fly creating python code, executing it, and using it to generate the response. Gemini’s contains an interesting trick Google plays to improve benchmark results.

These (inspired) engineering tricks lead to an interesting conclusion about the state of LLMs.