Indeed. I don't personally know any billionaires, but I've been around plenty of very wealthy people. Most of them didn't live in the style people think very wealthy people live in. For the most part, you wouldn't guess how wealthy they are by looking at them.
Many billionaires (such as Warren Buffet) did just did; continue their lifestyle of modesty. There's not that many ways to spend billions sensibly.