Why did the government's attempt to redistribute land to freedmen fail?

The freed men's Bureau did redistribute large amounts of land to freedmen in some areas from wealthy southern planters and from abandoned plantations. Southern planters began to return and demand their land back, and vey few republicans wanted to live where the government could arbitrarily confiscate land from people, so much of the land was given back to its original owners