“self host an open model”. My dude, you need pretty beefy hardware to run a slow and shit model that won’t even compare to the 0.33x models you get with a copilot subscription.
Its getting better all the time, its crazy how much better consumer level hardware can run competent models (even if it’s lower params) these days compared to just 6 months ago.
“self host an open model”. My dude, you need pretty beefy hardware to run a slow and shit model that won’t even compare to the 0.33x models you get with a copilot subscription.
Its getting better all the time, its crazy how much better consumer level hardware can run competent models (even if it’s lower params) these days compared to just 6 months ago.