Nationals leader Matt Canavan will risk his political neck to protect a Queensland seat being eyed off by Pauline Hanson's party.