Specifics on the setup. Specifics on the projects.

SHOW ME THE MONEY!!!

exactly. so much text with so little actionable or notable content... actually 0

We need more of these kinds of tightly time controlled challenges for LLMs.

Isn't this exactly the point the original post is making?

Honestly thought this was some sort of satire on corporate ass-kissing at first.

So empty and full of nothing.

Why is this flagged?

HNers generally flag anything with negative sentiment or portrayal of Anthropic, Apple, and Tesla.

For the visual learners, here's a classic intro to how LLMs work: https://bbycroft.net/llm

Even if you turn the temperature down to 0, it's not deterministic. Floating points are messy. If there is even a tiny difference when it comes to the order of operations on the actual GPU that's running the billions of parallelized floating point operations over and over, it's very possible to end up with changing top probability logits.

This guy is literally smirking while talking about this. It's like he's proud of himself for being able to produce doublespeak so effectively.

He wasn't saying that both of the models suck, but that the heuristics for measuring model capability suck

> Let's say your organization wants to add "dark mode" to your site. How does that happen? A site-wide feature usually requires several people to hash out the concerns and explore costs vs. benefits. Does the UI theming support dark mode already? Where will users go to toggle dark mode? What should the default be? If we change the background color we will need to swap the font colors. What about borders and dividers? What about images? What about the company blog, and the FAQ area, which look integrated but run on a different frontend? What about that third-party widget with a static white background?

Only one or two of those questions are actually related to programming. (Even though most developers wear multiple hats.) If an organization has the resources to have a six person meeting for adding dark mode, I'd sure hope at least one of them is a designer and knowledgeable on UX. Because most of those questions are ones that they should bring up and have an answer for.