Unable to avoid wasting modifications when setting account as residence Xbox

Been sport sharing with a pal for years and have set his account as my residence Xbox a number of instances all through these years from doing manufacturing facility resets or getting a brand new Xbox.

Needed to manufacturing facility reset my Xbox a couple of weeks in the past and now once I go to set his account as my residence Xbox I hold getting this message.

I used to be capable of set my very own account as my residence Xbox and he was capable of then reset my account as the house Xbox on his finish with no points. When he tries to set his account as the house Xbox on his finish he’s additionally getting this message and nothing we've tried has allowed both of us to set his account although he nonetheless has 4 switches left on his account