What does it mean to say that the average daytime relative humidity of a particular city is 31 percent?

This means that the air in that city has less than a third of water vapor it could contain under the same circumstances. Relative humidity is the ratio of water vapor that the air contains to the maximum amount it could carry at the same temperature. When the humidity is high the water vapor in the air is a lot and vice versa.