Does the quick start feature not work for anyone else?

I just got the series x and it seems like it’s trying to remember where I was at on a game and open back to that point. But it never seems to work correctly. Is there a way to disable it or fix it?