Cartrimino I’ve seen this happen to several people, they’re talking about local game. I’m pretty sure you only play custom and quick match. Can’t be a coincidence if that several threads have popped up with this problem. It probably has to do with XBOX, I do local game sometimes and it doesn’t happen (haven’t done it in a while), but I’m on PSN.
It may have to do with the game, I’m not sure, it could happen to only some people like @Cartrimino said, I’m not sure if it has to do with the Wi-Fi though. Cartrimino also said that it could do with your server, which is also a possibility, it really depends in that scenario.
I play on PSN, so I can’t really test this, if it has to do with the game, then the developers have probably noticed by now due to multiple players having this issue.