We've had Lennox HVAC systems for more than 30 years, and it's never left us without heat or AC.
When we built our current home I looked at geothermal systems, but at that time the cost payback wasn't there (in our case). They've probably changed in the 18 years since, so now it may well be a viable option.
Our current system is a 98+ % efficient furnace (propane) and the house is zoned depending upon it's use. The system works extremely well.
I wouldn't want to be without a system that doesn't circulate the air in the home-I've heard stories on here about people who can't maintain reasonable humidity levels in their basements and have to resort to dehumidifiers (and even then they don't work well). Our system keeps our basement at an even temperature and humidity level all year round.
In our area we lock in and pre-purchase propane in the summer when the prices are lowest. For our ~4,000 square foot home our propane costs run about $1,000/year and the home is kept comfortable.
Central air (in my opinion) is a must. I couldn't stand having a window unit hanging off the side of the house, and sitting around listening to the roar of the AC on a summer’s day. As I said above, it also keeps the humidity levels optimized all year, not only keeping the house comfortable, but protecting the wood floors and furniture from damage.
3 years ago I replaced our gas fired hot water system with a GE Geospring hybrid system. I have yet to use it in anything other than eco mode, even when we have company. We noticed a decrease in our propane consumption when it was installed, but didn’t see much of a bump in the electrical costs. For us it’s been very cost effective. With rebates and tax credits the cost was only marginally more than a replacement gas water heater (and much less than an on-demand system). We estimated that the energy savings would pay for it at about the 4 year mark, so we're close to it being paid for with savings.