6 days ago

No-IT. Really. No. I. T.

The world is waking up to the systemic vulnerabilities of our massive dependence on interdependent large logical (IT) landscapes. These not only lead to inertia — change becomes harder and harder —, but also to a brittleness of our organisations — and …

3 months, 12 days ago

Don’t forget all the things that a core team performs to a tee, but that you never see

The third ‘fragmentation wave’ of the IT-revolution is upon us, it seems. Fragmentation is a repeated pattern in the IT-revolution, that has given us object oriented programming and agile/DevOps as solutions to managing complexity. Now, it is the organ…

4 months, 12 days ago

Ain’t No Lie — The unsolvable(?) prejudice problem in ChatGPT and friends

Thanks to Gary Marcus, I found out about this research paper. And boy, is this is both a clear illustration of a fundamental flaw at the heart of Generative AI, as well as uncovering a doubly problematic and potentially unsolvable problem: fine-tuning …

6 months, 23 days ago

Memorisation: the deep problem of Midjourney, ChatGPT, and friends

If we ask GPT to get us “that poem that compares the loved one to a summer’s day” we want it to produce the actual Shakespeare Sonnet 18, not some confabulation. And it does. It has memorised this part of the training data. This is both sought-after an…

7 months, 3 days ago

What makes Ilya Sutskever believe that superhuman AI is a natural extension of Large Language Models?

I came across a 2 minute video where Ilya Sutskever — OpenAI’s chief scientist — explains why he thinks current ‘token-prediction’ large language models will be able to become superhuman intelligences. How? Just ask them to act like one.

7 months, 22 days ago

Artificial General Intelligence is Nigh! Rejoice! Be very afraid!

Should we be hopeful or scared about imminent machines that are as intelligent or more than humans? Surprisingly, this debate is even older than computers, and from the mathematician Ada Lovelace comes an interesting observation that is as valid now as…