Greg Clarke

@Greg@lemmy.ca · Joined ⁨Nov⁩ ⁨2022⁩

Mastodon: @greg@clar.ke

Replying to @⁨TheTechnician27@lemmy.world⁩

Ads or promotions may also appear during live events streamed on YouTube, such as sporting events.

I don’t have strong opinions but it looks like they’re referring to this phrasing in the ToS which suggests ads will only appear in sporting events. That’s the ToS connection. But otherwise, they advertise YouTube as an ad free experience which just isn’t true.

Replying to @⁨brucethemoose@lemmy.world⁩

I’ve got 128GB RAM + 24GB VRAM on a 4090. I’ve managed to get a 400B parameter model running on a single board computer with 64GB RAM by using MMAP. But I want to run Kimi K3 locally so I would need a lot more RAM / bandwidth

Gregology400B Parameter Inference on a Single Board ComputerI ran Qwen 3.5 at 397B parameters on a sub-$1000 Radxa Orion O6 using Vulkan GPU offload and MMAP.

Replying to @⁨a1studmuffin@aussie.zone⁩

My current workflow is passing a human written spec to an agent to implement with strict coding guidelines, architectural decisions, etc. The agent isn’t making any decisions about the abstractions to use, it’s just creating the objects and test suites. So I don’t mind the slower bandwidth because I’m running the heavy agentic lifting over night with no need for human supervision.

But I fully appreciate that my workflow isn’t the norm. In fact my workflow it’s the exact opposite the AI grifters like Sam Altman are selling because it still involves a human with knowledge of the systems making different decisions.