A rebound in finance stocks has helped nudge the Australian exchange in the right direction, but inflation and interest rate worries are weighing on confidence.