I've been having some lag issues with my VR link despite having 1gig fiberoptic internet and being right next to my router, why is this?

My target bandwidth is 350, and my encoded video size is 832, I have an app that I use through my ISP to check my internet settings and I've been monitoring that throughout my VR usage and nothings been too suspicious, the games I'm playing don't lag hardware wise, but my connection to Steam Link is spotty sometimes, can anyone help me through this? My headset also says it has an excellent connection and connected to 5ghz aswell. I'm new to all of this so if theres a stupidly easy fix to this, dont be too harsh.