His program uses quantization, but is very optimised and has builds that can fit into 96GB of memory with great results.
DS4 Flash is usually my go-to for a lot of things these days, and I don't have to worry about a cloud model stopping or telling me it's concerned about my usage.
Modern frontier LLMs know Norwegian. Wouldn't this simply be the job of RAG to do lookups as the user requests for data? Like how Gemini integrates with Google Search.
Seems like they should be building an MCP service rather than training an entirely new LLM...
I’d just plug the ports since things are going wireless and might only need the one usb-c from time to time. Hey StarLabs, perhaps put some nice flush and matching port plugs in the box?
Looks really slick. I'd love to see some more AI oriented mini PCs like the Star Byte but with OSS firmware. Think AMD Ryzen AI Halo form factor with the Gorgon Halo style APU.
Is eBay just a hive of scams now? Try searching for a Mac Studio with 512gb of RAM for example. I know it's a highly sought after item, but there are so many sellers with 0 reviews supposedly selling these at suspiciously low prices. What's going on here?
I bought some dope weight lifting shoes last week. 46 bucks after shipping, 175 new. I’m pretty stoked on that. I was looking for a 3090 recently too and i did see the 0 rep sellers with buy it nows 10% under market value. That was a little sus. Nonetheless https://www.ebay.com/help/policies/ebay-money-back-guarantee... is a thing?
Many users do like to use scrollback to copy large passages of text, which becomes difficult and cumbersome if they have to use page-up page-down to get at the other parts of it.
