@ariadne I've always wondered. Let's take a popular task, like coding assistanse.
I have a gajillion ideas on my mind and a day is only 24 hours long, so I need an assistant.
Say, I work primarily in Go. Or JS. Or C++, or whatever, the point is I have a specialization on one or two languages.
Do I really need a several hundred gigabyte model that has EVERYTHING in it, and a whole GPU farm to run it? Can I have a little model that can do Go REALLY well, and that I can run on my 9050 xtx or less?
@ariadne I've always wondered. Let's take a popular task, like coding assistanse.
I have a gajillion ideas on my mind and a day is only 24 hours long, so I need an assistant.
Say, I work primarily in Go. Or JS. Or C++, or whgatever, the point is I have a specialization on one or two languages.
Do I really need a several hundred gigabyte model that has EVERYTHING in it, and a whole GPU farm to run it? Can I have a little model that can do Go REALLY well, and that I can run on my 9050 xtx or less?