Bankers defend penalty on loan pre-payment