TBH, Nvidia kinda deserves this. Between the incredibly buggy forcedeth ethernet chipset, the 2010 era laptop GPUs with insane failure rates that caused a recall across the entire industry, and various other issues, Apple (and others) have legitimate reasons to avoid working with them.
Both of those issues are over 2 decades old. It's the equivalent of boycotting Apple for supporting IBM, you will not achieve anything since the "problem" is already fixed. I don't know how you can call that legitimate in good faith.
Apple had the opportunity to take Apple Silicon to the datacenter and become the #1 professional ARM microarchitecture in the world. It was Apple's stupid grudge that gave Nvidia everything they needed to sell thousands of their lazily-made Grace CPU.
Me too. Got an air filter near the bed with a quiet enough motor that all I hear is the woosh. Its also handy for when nearby forest fires degrade the air quality.
This is the way. Not that big of budget here. But if there’s something promising, I just try that for a month or so. But even then… at this moment I’m using z.ai models and those do the job. No need for anything else. So I’m staying until there is something new, same affordability, but a lot better. (Using a coding plan)
My first language is Dutch (Flemish). I didn’t even know there were three different dashes. The em dash is something I didn’t know exist, or were used, until llms came about. The hyphen is something we use when we make a list, that’s just the minus symbol right?
So em dashes are for pauses or highlighting things I guess?
The en dash you explained in your reaction.
Is there any other use for the hyphen except for making lists?
In a video of Hank Green, he interviewed an AI expert (if there even is such a thing), and he said that in the thinking part of the conversation, LLMs seems to use code language to communicate with itself, like in the usage and ordering of words, and such.
I think that there could be even more then a fingerprint in those messages.
I'll take this opportunity to repeat that the natural language interpretation of thinking traces don't appear to be "real" by any reasonable definition. Even if they can at times be useful (at least seemingly). There's research demonstrating the usage of arbitrary symbols, even just repeating a single symbol, leading to a similar improvement in ability. This makes sense if you consider how the attention mechanism and KV cache work as the sequence iteratively grows.
Basically we optimize the models to produce output with certain characteristics but that doesn't mean that what we see is the whole truth or even that the relationships in the underlying system are structured in the way that we might expect.
He’s not an expert in anybody’s estimation other than his own. He’s a blogger, tech booster, executive, SEO guy, etc. He was big into NFTs. He gloms onto every buzzy tech thing because squeezing all the “gee whiz” he can out of tech optimism is that guy’s career. He has no education in ML or anything related.
I was initially quite excited to play it until I read your comment. I'm in the same boat (hurr), been sailing for 30 years and teaching it for at least 20.
reply