Since my fiber internet and VPN upgrades didn't fix the problem, I'm going to switch restreaming to multiple platforms off of my computer and utilize Restream, which allows up to 5 simultaneous streams for $20 a month. I could go more, but it get expensive quickly.
Maybe streaming to multiple sites simultaneously is causing the problem somehow? Worth a shot I guess. I'm all out of ideas.