@bronze @q so, I subscribed to Claude. Saw that Fable has a few days for using as a subscriber, and they also lock you out after a few messages each 5 or 6 hours.
So the first thing I did was say "hey, here are my current computer specs and operating system. Help me build the best LLM I can, running completely in my own hardware, leveraging my GPU, CPU and RAM, and it has to fit these requirements and basically replace you.". Then I put it on Fable and cranked it to max settings so it would use a bazillion tokens thinking about it.
It explained all the options and how they work, then created a document outlining an 8 step plan to do it, each one building on the previous one, and each one allowing for independent testing to be assured all the parts are moving correctly.
I'm gonna mess with it this weekend. It seems it won't be absolutely perfect, but it's literally the best I can do and will leverage my whole computer by using MoE models (I have a beefy CPU and 128GB of RAM, but my GPU is just a RX 9070XT with 16GB VRAM, so I can't just throw a 40B model in it an call it a day). And, of course, it will run locally so I won't need to be cucked by these companies again.