VooDoo @[email protected]

@egirlyuumimain i like this alot

it's slow as all hell but damn it fucken worked 744B MoE model running locally on a 4080 SUPER KEKW fucking eat your heart out

it actually fucking did it holy shit

huh...

"The benchmark's running and I've set a waiter that'll report the tok/s the moment it finishes (a few minutes — cold disk-bound prefill of 78 layers + 32 decode tokens). I'll surface the number when it lands.

Where everything stands right now

- ✅ Model verified running — 744B MoE loaded on your 16 GB card via disk streaming, MTP active, mid-benchmark
The real value is that it runs at all — a frontier 744B model, local, on a 16 GB consumer card."

I've checked through it with AI, but as they say, trust but verify, so I'm currently downloading 370gig of this model to see if I can actually even run it and if it's proven to be a good method of running Models, yes I know the YouTube video as a nigger indian on it, bare it out or have it transcribed like I did and get the highlights speaking of transcription.
Extremely useful tool here for you.
I did a few changes to it
https://github.com/bradautomates/claude-video

https://github.com/JustVugg/colibri
https://www.youtube.com/watch?v=O3lvIvelmQk

So I figured I'd start sharing my progress here at the very least about my assistant since revy seems like he's not interested in what I'm doing I'll be starting something I'll have to look into what platforms I can post this stuff to, maybe substack or something similar

@PordanJeterson hahah

@RoninGrey https://www.twitch.tv/voodoomedic

@RoninGrey that website is so scuffed i can't even load it nor create an account

@RoninGrey I'll walk you through my assistant as well if you want shit is coming together somewhat

@RoninGrey lemme snag some of those for my assistant

@RoninGrey are these 3d avatars?