A Liberal MP has signalled the party might back away from a fight over whether to let home-buyers and workers access retirement savings early.