You would be far, far better off buying a used manufactured home to live in while you build your dream home. You will not be able to recoup more than about half of your investment in a new manufactured home. So, buy a used one for a third of the cost and it won't lose as much value. The cost of moving it will to your acreage will depend on the distance more than anything else, so search close to home.

Here is a link that might be useful: Place to look for used homes for sale.

We are doing this too. Husband myself and our 3&1 years olds. We lucked out with a conection to be able to get a modular building from a contractor friend for 3k. The building was a school class room 24x40 ( 960 sqf), has electricy just needs to be hooked up to our power. We paid 4k to have it moved and set, we will build interior walls add a kitchen and bath to make liveable. Total expense will come in around 15-17k.