The FAI has faced calls for resignations but the Sport Minister said they've had to 'walk an excruciatingly difficult line'