Have you ever tried to give the page link to
the specific user directly to see if he can enter or edit it? Maybe since you
have grant permission on specific pages, rather than the whole team site, the
external users cannot enter the team site by accepting the invitation.
Thanks,
Ella Huang