The Prime Minister insisted migrants were needed to fill 'gaps in the economy'