I grew up a mile down a back woods dirt road. I moved away from there when I was 18, and swore I'd never live on a dirt road again. So far, in 36 years, I've kept that promise to myself.
The dirt roads here (most all are paved now) are rough, rocky affairs that will poke a hole in a sport tire in no time. Lots of loose gravel and dust. I've rode on them many times in the past, and a good dirt bike background is practically a must. Was riding old school standards on 4 ply bias tires then too, be a hard go on something like a Hayabusa with Powers, Q2s, or 016s.
If the road your looking to be living on is anything like the ones here, your wife that you love is going to hate it. The dust creeps in everywhere in the summer when it's dry. Every car that goes by puts up a huge cloud that settles on everything, no matter how tight you keep the place sealed up. Dusting is a constant, never ending chore.
Clean car/truck, forget it. Mud and dirt cakes up everywhere underneath, and no matter how much you wash it, you'll never get it all out. Dust fills the interior, set something on the carpet and a cloud of dust poofs up, same with cloth seats. If the road is smooth like pavement you may escape the rattles. A rough graded dirt road will shake a car (especially the new, flimsier built ones) to pieces in just 2-3 years. Squeaks and rattles will be so common you won't even notice them anymore.
Do what you want, but even after all these years, you couldn't pay me enough to live on an unpaved road.