I asked this question on the Microsoft community and they sent me here. Which tells me this isn't an easy fix.
Outlook OWA/Web App calendar
Recently moved staff to Outlook OWA with an exchange server. Did not install Outlook client to prevent confusion among users. Email works fine in both OWA and App. Calendars are another matter
We have 8 team members and can only see 5 at a time. Not what we were used to with Google Calendar and Smartermail calendar. How can we see all 8 calendars at once?
Or, alternately, how do we create one calendar with everyone having Editor privileges, that is not owned by a person in the group, because, shared calendars do not show up on Outlook App. only on the "owner's" screen.
Test calendars that were deleted are still showing on screens of some people. (not all) And will not deleted from Web App, even after deleting it from phone and reinstalling.
This is becoming quite a headache.