I am having the same problem as well. I own an xbox one x and there is an awful lag while playing the game. I've tried everything possible to fix the issue - I tried to tinker around in the settings and switched to a different tv, but nothing seemed to work. I even tried to follow the steps outlined in this article (https://support.partyanimals.com/article?id=213) but the graphic tab does not appear in settings.
It seems like the issue is that the game is not optimized for xbox one x, since I tried playing other games on it and they all worked fine and without any lag. This game really needs to be optimized for xbox one x - as OP said, it's currently borderline unplayable at the point.