These are a lot of "what if's" so I'll try to cover them.
First, keep in mind that without taxes everyone would be far richer. There are taxes layered on taxes, wrapped in taxes, smothered in tax-cream... so it's impossible to see the true cost of things. But a rough estimation is that your income would be between 12 and 60% higher, and goods/services would cost between 8 and 50% less.
Second, remember that other hidden tax called inflation. The government is constantly degrading the value of your savings by printing trillions of dollars and giving it to banks and the military.
The common fear that without public schools, we'd only be left with expensive "rich kids" private schools isn't founded in reality. That's like saying that if we weren't all provided with Yugos by the government, we'd only be able to choose between Lexuses and Bentleys. In a free market for education, there would be schools to cater to poor children.
Federal grants/loans for higher education are meaningless. Remember that when I trade your dollars for Olive Garden coupons, Olive Garden knows you no longer have a choice about where you can spend your money - so it can safely raise its prices. In the same way, universities that get government money know they are safe raising tuition. You'll notice the cost of attending college has gone up faster than inflation over time. That's because of scholarships, ironically.
Once I reach 85 (assuming I make it that far!) I'd hope that I've saved enough money to be able to pay for my own expenses... but if I have loving family and friends, I'm sure they'll help me out. Why is my medication expensive? By the time I hit 85, technology will have progressed so far that medicine will be phenomenally better and cheaper. I'm an optimist here.
If I lived in a poor area and we didn't have good roads, I'd get a job in a nicer city and pay the tolls for their roads! Or I'd gather investors to build a road leading to my hometown, and eventually that investment would pay off. Just like a municipal bond.