A Derbyshire council is considering seizing acres of farming land to build 2,000 houses on after the owners pulled out.