Llm

The last few weeks, the autoresearch repository by Andrew Karparthy has made some waves. Everybody seemed to be hyped for LLMs doing deep learning research, while I had a look at the README and thought: “Well, that sounds like hyperparameter optimization with extra steps.” Below you can see the progress plot Karparthy published as part of the repo. The LLM runs 83 experiments over eight hours and successfully reduces the validation metric by around 0.0282 bits per byte. ...

AI is everywhere right now, and you cannot escape it. The tech bubble is full of articles and think pieces that either promise a brave new world of software engineering or the downfall of the craft. And let’s not talk about all the companies that are shoving AI features in the faces of their customers if they want them or not. I am not even the first one to comment on this. Rants about AI are now as ubiquitous as the technology itself. AI is everywhere, and this is why I want to talk about why I don’t use it to write this blog. ...

I’ve been a member of an orchestra in my hometown since childhood. Although I only get to play my chosen instrument a few times each year, I’m still active in the orchestra’s board. Due to my profession, most things that can be done digitally fall into my domain. I do not particularly enjoy these administrative tasks, but somebody has to do them. One of these tasks is especially bothersome: writing the weekly newsletter. This newsletter is an e-mail with all important dates for the week, reminders, and an outlook of events in the next few weeks. The newsletter is also cross-posted into the orchestra’s WhatsApp group chat. Compiling this newsletter means checking several sources for information and bringing them together in a few well-written paragraphs. ...