High construction costs and the Iran war are threatening the key manifesto pledge, the housing secretary says.