posted in Technology
If open weight models are the future, U.S. AI companies are going to have a hard time
www.fastcompany.com/91577359/why-u-s-ai-companies-cant-match-chinas-open-weight-frontier-models
Fast CompanyIf open weight models are the future, U.S. AI companies are going to have a hard timeOpenAI, Anthropic, and other Western labs have spent billions training the model weights at the heart of their most advanced systems.
Replying to @sanitation@lemmy.today
We even got open weight models that’s 27B + 1-bit (and it still has good performance)
Replying to @Mwa@thelemmy.club
Bonsai? Or whatever it’s called? It’s a con, so far; it’s not better than smaller models quantized to 3-4 bits.
I love, love the idea of bitnet, but it only seems to work with models trained from scratch, which no one has done at scale yet.
Replying to @brucethemoose@lemmy.world
yeah bonsai