It’s more that the newer models are going to need less compute to train and run them.

Let’s talk in five years. There’s no point in discussing this right now. You’re set on what you believe you know and I’m set on what I believe I know.

And, piece of advice, don’t assume others lack tech literacy because they don’t agree with you, it just makes you look like a brat that can’t discuss things maturely and invites the other part to be a prick as well.

Especially because programming is quite fucking literally giving computers instructions, despite what you believe keyboard monkeys do. You wanker!

What? You think “developers” are some kind on mythical beings that possess the mystical ability of speaking to the machines in cryptic tongues?

They’re a dime a dozen, the large majority of “developers” are just cannon fodder that are not worth what they think they are.

Ironically, the real good ones probably brought about their demise.

I’m not talking about this being a snap transition. It will take several years but I do think this tech will evolve in that direction.

I’ve been working with LLMs since month 1 and in these short 24 months things have progressed in a way that is mind boggling.

I’ve produced more and better then ever and we’re developing a product that improves and makes some repetitive “sweat shop” tasks regarding documentation a thing of the past for people. It really is cool.

I don’t think you understand how China’s economy works. Seems very clouded by anti-China propaganda.

In reality, the working class exercises a great deal of control over the means of production in China, and the 996 culture you’re referring to is in fact illegal.

https://www.bbc.com/news/world-asia-china-58381538.amp

Again, capitalism vs communism is not defined by the existence of production/profits/markets, but how control and benefit of those systems is distributed.

Any corrupt leaders are capable of committing genocide. The difference is capitalism requires genocide to continue functioning.

you need to ask the Uyghurs how they’re feeling about their experience under the communist government

Everytime people ask regular Uyghurs, they’re usually happy enough with it. I’m guessing you mean ask Adrian Zenz and the Victims of Communism Memorial Foundation to tell the Uyghurs what they think.

How many of those instances failed due to external factors, such as illegal sanctions or a western coup or western military aggression?

Which communist states would you say have less freedom than your country? Let’s compare.

The Uyghur genocide was debunked. Even the US state department was forced to admit they didn’t have the evidence to support their claims. In reality, western intelligence agencies were trying to radicalize the Uyghurs to destabilize the region, but China has been rehabilitating them. The intel community doesn’t like their terrorist fronts to be shut down.

Imagine you had a lemmy instance that every post was a proposal for regulation in your community/region. Anyone can make a post, some will gain traction and support, some will be worthless and fall off quickly. If the proposal gains enough support it then goes to a vote post where people get to make an official vote. Could be to charge $40 for a speeding ticket instead of $50, could be a trade agreement with another region.

I think this method would give people equity in the system. Maybe it could also be scored on a curve depending on how much it effects you as an individual. Maybe having advanced education on a topic means your say has more weight to it than someone without.

I was thinking of ways to move towards this and so far my best idea is to build it and run it in parrelel with what we have now. Get it functioning and trusted and simply try to roll over what we have now. I figure something tragic would need to happen to create a power void for full implementation. Like yellowstone erupting or something. I was also thinking that we need to teach the kids. We need to give them tools to build on so they can take this kind of idea to fruition.

I am just a regular idiot, so feel free to add anything constructive.

How do you solve the problem that half the country can’t even be bothered to participate once every four years?

I assume you’re talking about the US electoral system?? That’s very different.

but how would we get people to engage with such a system?

By empowering them.

Consider how the current electoral system disempowers people:

1. Some people literally cannot vote or risk jeopardizing their job taking the day off, others face voter suppression tactics

2. The FPTP system (esp. spoiler effect) and the present political circumstances mean that there are really only two viable options for political parties for most people, so many feel that neither option represents them, let alone their individual positions on policy

3. Politics is widely considered to be corrupt and break electoral promises regularly. There is little faith in either party to represent voters

But, in a system where you are able to represent yourself at will, engagement is actually rewarding and meaningful. It won’t magically make everyone care, but direct democracy alongside voter rights reform would likely make more people think it’s worth polling.

I think you’re victim blaming. I can’t blame half the country for not wanting to participate in a symbolic gesture that will have no impact on the end result in this corrupted system.

https://pnhp.org/news/gilens-and-page-average-citizens-have-little-impact-on-public-policy/

I think the sentiment is the same with any code language.

Any other AI company, and most of that would be legitimate criticism of the overhype used to generate more funding. But how does any of that apply to DeepSeek, and the code & paper they released?

FPGAs have been a thing for ages.

If I remember it correctly (I learned this stuff 3 decades ago) they were basically an improvement on logic circuits without clocks (think stuff like NAND and XOR gates - digital signals just go in and the result comes out on the other side with no delay beyond that caused by analog elements such as parasitical inductances and capacitances, so without waiting for a clock transition).

The thing is, back then clocking of digital circuits really took off (because it’s WAY simpler to have things done one stage at a time with a clock synchronizing when results are read from one stage and sent to the next stage, since different gates have different delays and so making sure results are only read after the slowest path is done is complicated) so all CPU and GPU architecture nowadays are based on having a clock, with clock transitions dictating things like when is each step of processing a CPU/GPU instruction started.

Circuits without clocks have the capability of being way faster than circuits with clocks if you can manage the problem of different digital elements having different delays in producing results I think what we’re seeing here is a revival of using circuits without clocks (or at least with blocks of logic done between clock transitions which are much longer and more complex than the processing of a single GPU instruction).

Huh. Everything I’m reading seems to imply it’s more like a DSP ASIC than an FPGA (even down to the fact that it’s a VLIW processor) but maybe that’s wrong.

I’m curious what kind of work you do that’s led you to this conclusion about FPGAs. I’m guessing you specifically use FPGAs for this task in your work? I’d love to hear about what kinds of ops you specifically find speedups in. I can imagine many exist, as otherwise there wouldn’t be a need for features like tensor cores and transformer acceleration on the latest NVIDIA GPUs (since obviously these features must exploit some inefficiency in GPGPU architectures, up to limits in memory bandwidth of course), but also I wonder how much benefit you can get since in practice a lot of features end up limited by memory bandwidth, and unless you have a gigantic FPGA I imagine this is going to be an issue there as well.

I haven’t seriously touched FPGAs in a while, but I work in ML research (namely CV) and I don’t know anyone on the research side bothering with FPGAs. Even dedicated accelerators are still mostly niche products because in practice, the software suite needed to run them takes a lot more time to configure. For us on the academic side, you’re usually looking at experiments that take a day or a few to run at most. If you’re now spending an extra day or two writing RTL instead of just slapping together a few lines of python that implicitly calls CUDA kernels, you’re not really benefiting from the potential speedup of FPGAs. On the other hand, I know accelerators are handy for production environments (and in general they’re more popular for inference than training).

I suspect it’s much easier to find someone who can write quality CUDA or PTX than someone who can write quality RTL, especially with CS being much more popular than ECE nowadays. At a minimum, the whole FPGA skillset seems much less common among my peers. Maybe it’ll be more crucial in the future (which will definitely be interesting!) but it’s not something I’ve seen yet.

Looking forward to hearing your perspective!

And you are basically a single consumer with a personal car relative to those data centers and cloud computing providers.

YOUR workload works well with an FPGA. Good for you, take advantage of that to the best degree you can.

People;/companies who want to run newer models that haven’t been optimized for/don’t support FPGAs? You get back to the case of “Well… I can run a 25% cheaper node for twice as long?”. That isn’t to say that people shouldn’t be running these numbers (most companies WOULD benefit from the cheaper nodes for 24/7 jobs and the like). But your use case is not everyone’s use case.

And, it once again, boils down to: If people are going to require the latest and greatest nvidia, what incentive is there in spending significant amounts of money getting it to work on a five year old AMD? Which is where smaller businesses and researchers looking for a buyout come into play.

At the end of the day, every company will choose to do it faster and cheaper, and nothing about Nvidia hardware fits into either of those categories unless you’re talking about milliseconds of timing, which THEN only fits into a mold of OpenAI’s definition.

Faster is almost always cheaper. There have been decades of research into this and it almost always boils down to it being cheaper to just run at full speed (if you have the ability to) and then turn it off rather than run it longer but at a lower clock speed or with fewer transistors.

And nVidia wouldn’t even let the word “cheaper” see the glory that is Jensen’s latest jacket that costs more than my car does. But if you are somehow claiming that “faster” doesn’t apply to that company then… you know nothing (… Jon Snow).

unless you’re talking about milliseconds of timing

So… its not faster unless you are talking about time?

Also, milliseconds really DO matter when you are trying to make something responsive and already dealing with round trip times with a client. And they add up quite a bit when you are trying to lower your overall footprint so that you only need 4 notes instead of 5.

They don’t ALWAYS add up, depending on your use case. But for the data centers that are selling computers by time? Yeah,. time matters.

So I will just repeat this: Your use case is not everyone’s use case.

How are you the product if you can download, mod, and control every part of it?

Ever heard of WinRAR?

Audacity? VLC media player? Libre office? Gimp? Fruitloops? Deluge?

Literally any free open source standalone software ever made?

Just admit that you aren’t capable of approaching this subject unbiasly.

AI chatbots do not lay out facts

I agree and that’s sad but that’s also how I’ve seen people use AI, as a search engine, as Wikipedia, as a news anchor. And in any of these three situations I feel these kind of “both sides” strictly surface facts answers do more harm than good. Maybe ChatGPT is more subtle but it breaks my heart seeing people running to DeepSeek when the vision of the world it explains to you is so obviously excised from so many realities. Some people need some morals and actual “human” answers hammered into them because they lack the empathy to do so themselves unfortunately.