A Generative AI Plateau

Computerphile (a YouTube channel I really love) released a video today titled Has Generative AI Already Peaked?. In the video, Mike Pound talks about a research paper released in April called No “Zero-Shot” Without Exponential Data: Pretraining Concept Frequency Determines Multimodal Model Performance. I think this video and the paper resonate with how I’ve felt about the hype around generative AI in the last several years. To summarize Mike’s thesis, he’s developing a view, which the paper corroborates, that producing a general intelligence through large training data that can solve new, and previously unseen problems (a “zero-shot”) is an exponential data problem....

May 9, 2024 · 3 min · David Rinaldo

Containers, Home Labs, and AI

It’s been a while since I’ve posted! Thought I’d give an update on a recent change I made in my home lab I’m calling “The Great VM Migration” but do it as a thinly veiled demonstration of something far cooler, ChatGPT. I asked ChatGPT to write this post through a conversation. It got some things wrong, and I corrected it by saying “Not quite what I meant, …” and explaining where it got it wrong....

January 14, 2023 · 5 min · David Rinaldo