• 0 Posts
  • 705 Comments
Joined 8 months ago
cake
Cake day: November 24th, 2025

help-circle
  • What a fucking moronic oped. Open-weight models developed by China do not need to be run on Chinese infrastructure. You can run open weight models anywhere you want on any infrastructure you want. Contrast this with ChatGPT, Grok, and Claude: you can’t run them locally because they hold the models to be proprietary and you have to run it on their corporate infrastructure.

    The whole essay reeks of orientalism, so it’s no wonder this knuckle dragger doesn’t know what the fuck he’s talking about.






  • Because NVidia made a whole bunch of GPUs that are specifically for parallel processing massive amounts of information and floating point math, which is what is needed for machine learning, model training, LLMs, and everything else we call “a.i.”

    They took on a huge amount of investment in 2024, raising $25B in debt to fund more production. In the last 3 years they have sold a ton of hardware. That hardware was bought by people with a ton of cash or a ton of credit.

    How much did they sell? In the last 3 years, something like the equivalent of 12GW of GPUs have been sold by NVidia alone. In the US, we have about 30GW of data centers, almost all of them were already full. So in 3 years NVidia sold about a third of the total capacity of the country.

    Those cards have nowhere to go to be powered on. They are sitting in warehouses right now. People have spent hundreds of millions on GPUs from NVidia and they are sitting in boxes doing nothing. Because there’s not 12GW of available data center space for them to go.

    It took the US something like 30 years to get to 30GW of data center capacity. Even we assume doubling every 10 years, it’s going to take another 7 years to get the next 30GW.

    And that means building a shit ton of data centers.










  • Yeah, you’re just wrong. Lemmy hates the a.i. business, not convolutional neural network transformer technologies.

    Most of lemmy is fully aware the a.i. does incredible work already in protein discovery, in cancer research, in climatology, etc. But LLMs, the stochastic parrots they are, have shown that their cost/benefit ratio is ridiculous.

    As Ed Zitron said: if your business model is selling forty dollars for 1 dollar, you don’t actually have a business model. That’s the current state of LLM services today. Everyone that is willing to pay for LLM service today is currently paying a dollar and getting back about $10 - $100 of compute in return. That’s not economically sustainable, there are no theories for, nor indications of, costs coming down for providers, and consumers are already saying it costs too much even at these prices.

    And this problem has gotten worse, not better, in the last 5 years. Costs are going up by multiples for the providers and in multiple areas. To make LLM responses more useful they now have to make the systems run dozens of inferences in parallel and select among them. The cost of fiber optics, of GPUs, of RAM, of storage, of electricity, of generators, of data center leases, of data center construction, and many other inputs has gone through the roof with some inputs jumping 300% and other inputs locking in price increases for a decade-long contract.

    There are lots of problems with LLMs, but Lemmy has a much more mixed response with open-weight LLMs or ethically sourced LLMs than it does with the business of LLMs. Because the business of LLMs is very clearly a failed business currently sucking up our entire economy.






  • The American model of free speech is anything but. It’s a narrative cover over reality.

    The US government has always and will always choose what speech is unacceptable and repress it. They have been doing so for centuries. They have killed so many people for speaking. They have entire departments dedicated to media manipulation and censorship. They have vast financial incentives organized by the government to limit speech. There have been at least 2 open purges of communists and a third purge is burgeoning as we speak.

    The American model is not actually that the government should not have the power to limit speech but rather that the government will limit violent speech if it goes against the government’s goals and will protect violent speech if it supports the government’s goals. That’s why white supremacist hate speech is protected in the US - not because America is a shining beacon of free speech but because America is shining beacon of white supremacy.