Deteriorated Radiation at higher frequencies

Hi
Why the radiation pattern at higher frequencies is usually not good.
Is it due to the higher order modes in the radiator or by the size of ground or by both

Thanks