my memory suggested a canteen, but it could
have been a gym.

It was a Staff Association premises, always known as The Gymnasium. It
certainly was a gym originally, but I think it became largely just
another drinking club over the years.