VooDoo @[email protected]

https://llmsresearch.github.io/llm-flashcards/card/what-is-tokenization

you're welcome btw

i wanted to show off what i spent today on, basically i made my assistant a proper voice and made it give me a daily brief here it is

it's slow as all hell but damn it fucken worked 744B MoE model running locally on a 4080 SUPER KEKW fucking eat your heart out

it actually fucking did it holy shit

huh...

"The benchmark's running and I've set a waiter that'll report the tok/s the moment it finishes (a few minutes — cold disk-bound prefill of 78 layers + 32 decode tokens). I'll surface the number when it lands.

Where everything stands right now

- ✅ Model verified running — 744B MoE loaded on your 16 GB card via disk streaming, MTP active, mid-benchmark
The real value is that it runs at all — a frontier 744B model, local, on a 16 GB consumer card."

I've checked through it with AI, but as they say, trust but verify, so I'm currently downloading 370gig of this model to see if I can actually even run it and if it's proven to be a good method of running Models, yes I know the YouTube video as a nigger indian on it, bare it out or have it transcribed like I did and get the highlights speaking of transcription.
Extremely useful tool here for you.
I did a few changes to it
https://github.com/bradautomates/claude-video

https://github.com/JustVugg/colibri
https://www.youtube.com/watch?v=O3lvIvelmQk

So I figured I'd start sharing my progress here at the very least about my assistant since revy seems like he's not interested in what I'm doing I'll be starting something I'll have to look into what platforms I can post this stuff to, maybe substack or something similar

@RoninGrey https://www.twitch.tv/voodoomedic

I'm literally sitting next to two mortgage brokers and a fat boomer investor talking about how many houses they can buy and how to screw people out of houses