brucethemoose

@brucethemoose@lemmy.world · Joined ⁨Mar⁩ ⁨2024⁩

Replying to @⁨ChunkMcHorkle@lemmy.world⁩

They’re not, though.

Have you gone outside, and seen how people use their phones? The public is utterly addicted to social media.

They won.

I think Pondsmith got it right with Cyberpunk. The future of computing is corporate controlled siloes people simply cannot escape, and the “open web” and PC as we know it is basically defunct. Maybe small circles of people will congregate in Usenet-like circles. But not at scale.

Replying to @⁨jaschen306@sh.itjust.works⁩

I have a 3090, 7800, and 128GB ram from pre-rampocalypse. It’s not nothing, but there are definitely crazier home labs.

Deepseek V4 is native 4 bit.

I am running this quant, but the quantization loss is measurably low: huggingface.co/…/DeepSeek-V4-Flash-0731-128GB-RAM…

The native MXFP4 is only a bit bigger.

huggingface.coDowntown-Case/DeepSeek-V4-Flash-0731-128GB-RAM-IK-GGUF · Hugging FaceWe’re on a journey to advance and democratize artificial intelligence through open source and open science.

Replying to @⁨themachinestops@lemmy.dbzer0.com⁩

Well, the current trajectory points to:

  • LLM capabilities topping out.

  • All the tooling around them not keeping up anyway.

  • Actual “AGI” being distant and completely unrelated to contemporary models.

  • Inference costs plummeting.

The last one is critical.

Right this second, you can run Minimax H3 on a desktop for the tiny fraction of the compute/RAM OpenAI Sora took. And it’s better.

In a month, it will be ~8X faster.

You can run DeepseekV4 flash, dirt cheap, and get what Claude was less than a year ago. And it’s gonna spread to every host out there, to systems like Cerebas ASICs that don’t even need HBM.

So… Even if you’re an AI acolyte. And we go with that for the sake of argument…

We don’t actually need all that RAM for hosting generative models?

I’m very interested to see what happens to all these datacenters over the next two-three years.

They spent all this money on something that’s gonna be cheap as dirt to run, largely run locally, and that won’t need GPUs once bitnet takes off, sooo… they can’t make money off that.

What happens then?

What happens to all those Stargate RAM wafers, and excess datacenters?

Replying to @⁨PalmTreeIsBestTree@lemmy.world⁩

I’m not sure I worded this right before, but it takes ~half a decade to plan and produce a GPU.

They can’t just switch out the bus or memory on an existing design.

So they could make a HBM gaming GPU. But they would have had to have started ~2 years ago.

…That’s extremely unlikely.

It’s unlikely they’ll even plan one now.

AMD did indeed try making HBM gaming GPUs, and it turns out it’s supremely uneconomical; they immediately pivoted to the opposite extreme (narrow bus + larger cache).

However, LPDDR GPUs appear to already be in the pipe, so that will provide some GPU market relief.

Replying to @⁨poopkins@lemmy.world⁩

If the memory wafers are largely HBM, so they can’t be used for gaming hardware.

If you’re thinking of HBM gaming GPUs, the chip design pipeline is too long. If Nvidia/AMD/Intel started making one right now, and rushed it, it would still be many years away.

…However, a lot of LPDDR5 is being made too.

Hence the rumors of AMD hedging their bets and using LPDDR for some future GPUs.

Replying to @⁨Dookieman12@piefed.social⁩

They aren’t PC components. They’re server GPUs.

They don’t even have ROPs anymore. There was a time when the Nvidia P100/A100 could technically game, but that’s generations ago.

FYI, during the crypto busts, Nvidia bought back GPUs and basically incinerated them to keep demand for new stuff up.

…I’m pretty sure that’s what they will do again.

Replying to @⁨RIotingPacifist@lemmy.world⁩

I think it’s reasonable to downvote.

This for instance:

It’s a channel funded partly by a Bill Gates subsidiary, and has to do propaganda for them to meet its budget requirements.

May be technically true, but the implication is conspiratorial.

This:

Kurzgesagt makes low quality content that’s poorly researched…

Is an opinion I would strongly contest. “Slopaganda” doesn’t fit my impression either, especially with what they’ve disclosed about their production process.

And this:

This makes sense… They should be banned.

Sounds like advocating for a ban under false pretenses, which I am vehemently against. That’s what ultimately crosses the downvote threshold for me.

…That came out as more accusatory/singled out than I intended. I don’t mean to pile on the comment.

Is the channel perfect? No. I think they’re citation-lite in the videos, have made mistakes and had bad takes. And it’s a little oversimplified for my tastes.

But on this:

I dislike how disenting opinions get downvoted on Lemmy/technology probably more than even on reddit.

I think a downvote is a fair tool, in this case.

And unlike Reddit (at least in by browser UI), Lemmy doesn’t hide the comment when it’s heavily downvoted, which I like. The comment still gets “fair” exposure like any other comment in this thread, but that doesn’t mean people have to like it.

Other Lemmy/Piefed UIs may handle this differently, though. Not sure about that.

Replying to @⁨EvergreenGuru@lemmy.world⁩

I’ve seen this repeated a ton, so looked into it for myself, especially the “Bill Gates influence” angle.

I don’t buy it.

They aren’t perfect, but every Kurzgesagt video I’ve seen is above par for YouTube. And on the few topics I already knew something about, they seem to cover stuff well.

The criticism, on the other hand, was (to me) entirely unconvincing when investigated. It was mostly “I personally don’t like the agenda these facts point to.”

EDIT

And all that aside:

No one should be banned for the wrong reason.

If Kurzgesagt should be taken down, it shouldn’t be from a dysfunctional AI detection filter. It should be over whatever they actually did wrong.

Replying to @⁨brave_lemmywinks@lemmy.world⁩

They are, they’re trying, they’re pushing other platforms constantly. Kurzgesagt already does, heavily.

But are users switching? Nope.

They hardly even know they exist.

Sometimes I even see such a comment on YouTube, a user questioning YouTube; yet they didn’t even watch the video long enough to see the creator promoting an alternative platform.

They’ve already scrolled to the next video, algorithmically fed to them.

YouTube has an iron grip on YT users, and they know it. Even if ALL creators band together, IMO there’s basically nothing the creators can do.