The Duke and Duchess of Sussex reportedly felt "sidelined" just before making their decision to quit life as senior royals.