7, and it's had mixed reviews. It seems they might have rushed this model to try to get ahead of opening eyes release of Codex for everything. People also suspect OpenAI is about to release their next big model, spud.
And if Google doesn't have a big update soon, they certainly will next month at Google Io.
All three of these model makers are trying to be the model that you use for work, and the race has never been more tight. 7. But then I think more importantly, what should you be doing right now to prepare?
How do you avoid getting locked into the wrong platform?
6 at most benchmarks, but it actually does underperform in a few. Unsurprisingly, it absolutely crushes all the coding and knowledge work benchmarks. 6 and its new mythos model.
If you're not familiar, mythos was the model that was deemed too powerful to release because of its cyber security capabilities. 7, it seems we're getting about half of the gains and capabilities without those same cyber security risks.
6. And this is one of the few benchmarks on which Claude was already behind Gemini and ChatGPT. 7 to be overly cautious.
7 doing something dangerous that they updated the system prompts to be overly skeptical. As such, it occasionally refuses to do completely safe tasks. However, this seems like something it'll be easy for Anthropic to fix without updating the model.
7 follows your instructions much more closely, where previous models were much more likely to follow your instructions loosely. 7 follows your instructions literally.
If I could speculate a little, I think this is probably the result of how all the model makers are currently training models. A lot of the rapid advancements we've seen recently are from these model makers realising that if they can verify the output, they can train the models much quicker. This works best when you're training it on coding tasks or anything for which there's a clear benchmark.
But I suspect that training it against these deterministic outcomes is going to make the model less intuitive. Perhaps that's why we're seeing these newer models follow instructions more literally, and why we can expect that trend to continue.
So what does this mean for you and how you use these models? Well, to start, it means it's more important ever that you provide very clear instructions. Watch my video on Google adding skills to Chrome to get my ideas on how I think you should go about doing this.
But in short, I think that creating robust skills and iterating on those skills is the best use of your time right now.
It's really hard to predict which model or platform you're gonna wanna hit your wagon to. And that's why investing your time into skills is such a safe bet. All the models and platforms work with skills.
Well built, robust skills will easily become your business's most important asset, and you can easily move them across any other platforms.