Having a problem with taking part in on two consoles directly.

I’ve a Collection X and an Xbox One S that me and my brother each play on. We each have our personal separate accounts that we play on so there shouldn’t be an issue taking part in on each consoles. The issue arises after I’ve been taking part in on the Collection X, flip off the Collection X for my brother to play when he will get dwelling, then if I’m going to play the Xbox One whereas he’s taking part in the Collection X it tells me I can’t play as a result of I’ve an energetic session on the Collection X (see picture), even thought I’m signed out on the Collection X and solely my brother is taking part in. It then makes me both signal out or finish the Collection X session which for some motive kicks my brother out of no matter recreation he’s taking part in.