I love horses too, but I'm with SKR8PN on this one. If you don't do an exhorbitant amount of riding and using of the horses, the occasional pleasure ride becomes pretty costly when you calculate the hours of relaxation and companionship one actually gleans from the average horse vs. the hours of work of watering, putting in hay/buying and transporting hay, feeding, caring for, fencing and the costs of vetting/farrier.
From what I can see of the people I know who have horses, when they first get them they ride frequently, then less, then seldom. Then they have big pasture ornaments whom they pet on occasion, pay big vet bills and farrier bills for, buy lots of hay for and eventually realize that they have had them so long and they haven't been ridden for so long that they have created a retirement home for a couple of hay burners.
In a practical sense, horses aren't practical..unless, of course, one does use them for other things like logging, getting in firewood, plowing, pulling, rounding up livestock, or guard animals for meat animals like sheep, cows, goats, etc.