Detecting a weird packet loss issue.
So- I recently installed a Quad 100G Mikrotik CRS504-4XQ-IN Router into my lab recently and moved a few servers over to 100G NICs.
Around the time I did this- I also started experiencing tons of random, hard to pinpoint instances of latency across my network.
I validated flow-control was enabled for the network- and I checked various port counters to look for errors.
This- issue took me around a week or two to finally pinpoint.... this post- is going through a bit of the steps taken.