Is having four cats mad?

I have three cats and we live in a big three bedroom house in the countryside where they go out and are very happy, well looked after, regularly wormed, de-fleaed, vaccinated etc. Do you think it's crazy to get a fourth one? I can certainly afford the money and time, I just feel that with three there is always one that is left out!