Edit history

There’s this one company that has etched a small model onto the silicon directly, and can get something like 15k TPS from it at very low electricity usage, and is working in production.

They claim, they can go from model -> chip in a very short time (months not years), and that at datacentre scale, it would pay for itself in about a year vs todays infrastructure, but they have yet to prove they can properly etch the bigger models across multiple chips and have it all work together like the small model.

The downside if it works at that scale is the model will be stuck on whatever you etch into it. They did say you can apply Loras ontop of it though, so you can tweak it once built.

There’s this one company that has etched a small model onto the silicon directly, and can get something like 15k TPS from it at very low electricity usage, and is working in production.

They claim, they can go from model -> chip in a very short time (months not years), and that at datacentre scale, it would pay for itself in about a year vs todays infrastructure, but they have yet to prove they can properly etch the bigger models across multiple chips and have it all work together like the small model.

The downside if it works is the model will be stuck on whatever you etch into it. They did say you can apply Loras ontop of it though, so you can tweak it once built.

There’s this one company that has etched a small model onto the silicon directly, and can get something like 15k TPS from it at very low electricity usage, and is working in production.

They claim, they can go from model -> chip in a very short time, and that at datacentre scale, it would pay for itself in about a year vs todays infrastructure, but they have yet to prove they can properly etch the bigger models across multiple chips and have it all work together like the small model.

The downside if it works is the model will be stuck on whatever you etch into it. They did say you can apply Loras ontop of it though, so you can tweak it once built.

There’s this one company that has etched a small model onto the silicon directly, and can get something like 15k TPS from it, and is working in production.

They claim, they can go from model -> chip in a very short time, and that at datacentre scale, it would pay for itself in about a year vs todays infrastructure, but they have yet to prove they can properly etch the bigger models across multiple chips and have it all work together like the small model.

The downside if it works is the model will be stuck on whatever you etch into it. They did say you can apply Loras ontop of it though, so you can tweak it once built.