Owarh Hello, I play on Xbox too. I believe you need to change your privacy settings in your xbox. You need to enable cross-play etc...
Owarh Housesama This is the official Xbox support site, check the link and follow these simple instructions and i believe it will solve your issue. https://support.xbox.com/en-US/help/hardware-network/connect-network/multiplayer-cross-network-play