A brother of former NSW premier Dominic Perrottet has been told a corruption inquiry why he kept contact with fugitive property developer Jean Nassif.