True.I generally ride from april to oct. If there's the odd warm day in february I might take the bike out for a quick ride around the neighborhood to shake off the cobwebs but I'll only do long rides apr-oct. Even if you wear a warm jacket and gloves, it's still unpleasant to have cold air hitting your face. Also tires have less grip on cold pavement. The hotter the weather, the more I like it. As far as I'm concerned it can't be too hot to ride (unless you ride in stop and go traffic). There's nothing like wearing a light mesh jacket and speeding down a country road in 30+ weather.
But with the right gear, you won't feel the cold on your face either.
Usually when its cold,
Balaclava and thermal base layer (also for your toes and hands)
makes a WHOLE WORLD of difference.
Since i've been skiing in -30 degrees i learned what works and what doesnt...lol