Hi Phil,
Thanks for your reply in private message with your site URL. I’ve tried to access the public-facing website and find it works fine. Does the problem occurred irregularly and just for a few of users?
Based on the situation, I recommend you to remove users’ licenses for SharePoint Online services and then re-assign licenses and permissions to these users to see if it helpful.
Thanks,
Nancy Xie