

Our power consumption and the 0bits into USA metric
That’s amazing! Keep us in the loop about the results
Mastodon: @greg@clar.ke


Our power consumption and the 0bits into USA metric
That’s amazing! Keep us in the loop about the results


I have a RTX4090 (24GB VRAM) plus 128GB DDR4 system RAM on Ubuntu 24.04 and I am running these models locally
| Model | Speed | Context window |
|---|---|---|
| Qwen3.8-Flash-Next UD-Q4_K_XL — 125B/6B-active hybrid MoE, 104 GB | ~16.7 tok/s | 128k tokens |
| GLM-5.3-Flash UD-IQ3_XXS — 320B/18B-active MoE, 120 GB | ~9 tok/s | 128k tokens |
| Qwen3.8-27B UD-Q4_K_M — dense hybrid, 16 GB, fully on the 4090 | ~49 tok/s | 262k tokens |
The larger models don’t fit on the GPU alone but they’re mixture-of-experts and their active weights easily fit on the 24GB. The bottleneck is my system RAM as llama.cpp has to constantly move the experts between RAM and VRAM. I’m running older hardware, AM4 CPU, DDR4 RAM, etc. so 128GB is my limit on system memory and it’s relatively slow compared to DDR5. With DDR5 I would expect a good bump in speed for Qwen 3.8 Flash Next and GLM 5.3 Flash.
I also have a Kimi subscription which I use as my daily agentic driver and use DeepSeek for random tasks (DeepSeek Flash 4.1 is really fast and cheap).


The Anthropic and OpenAI valuations require their models to replace humans. But LLM based AI can’t replace humans because LLMs can’t make decisions. I only use Chinese models now, they’re fast, and they can finish a coding task quicker than I can make an informed decision about the next task.


I’m really impressed!


My argument is that regulation should be designed to prevent immoral behaviour. Otherwise you’re fundamentally taxing morality.


I disagree, divestment in profitable companies just rewards immoral investors. Plus Zuck has full voting control over Meta so shareholder’s votes mean nothing. I just want Zuck to be held accountable under the existing laws.


So basically no consequences for Zuck abusing a generation of children for profit?


Ads or promotions may also appear during live events streamed on YouTube, such as sporting events.
I don’t have strong opinions but it looks like they’re referring to this phrasing in the ToS which suggests ads will only appear in sporting events. That’s the ToS connection. But otherwise, they advertise YouTube as an ad free experience which just isn’t true.


You can’t advertise one thing and then just add “nah j/k” in the ToS and think you’re off the hook


Does it have a load of em dashes in the text?


There will be a major reduction in shark attacks


I thought this sub was for people having thoughts about showers, not thoughts in the shower. This all makes sense now


well what if people became aware/educated and the tables turned?
I’m basing my argument on how the world is, not how the world should be


As for your claim that we should all just be happy with government mandated surveillance
I never made that claim. What the hell are you talking about?! Your whole comment is just the rambles of a mad man


my argument is that requiring ID for the Internet is really really really fucking stupid
How is that argument at all related to this conversation or the bill? What are you talking about? If this bill passes you will not require ID to user the Internet in Canada. Have you read the bill?


Is that seriously your argument? If you’re on commercial social media you’re already under horrific mass surveillance. Is that you Zuck?


This will lead to one thing. Mass surveillance. Worse than it already is.
I’m sick of this stupid argument. If you’re on commercial social media you’re already under mass surveillance FFS 🤦♂️ And if you’re arguing that now the government will have access to this data, they already do! Social media platforms already know how old you are, they even know when you’re taking a shit. It’s just not beneficial for them to take any actions to restrict kids from using their platforms because they need the next generation of addicted users.
Kids need parents that dont give them phones and let them browse the internet freely.
Commercial social media platform are multi billion dollar companies that have built some of the most sophisticated AI/ML algorithms to get people addicted to their platforms. Do you really think the average parent has a chance here? Then consider the network affect. If most of the kids at school are socializing online on these platforms then restricting your child’s access limits their socializing. Social media access for kids needs to be limited by governments.
Should we require ID to buy kitchen knives too?
I don’t think that would be effective at reducing access for minors given knives are readily available in most kitchens.
Have you read this bill? Are you sure your opinions haven’t been manipulated by social media companies that have lobbied hard and flown influencers around to speak on their behalf?
Fun fact, two things can be true at the same time. Like corporations can be bad AND people can be stupid.