Clarke says pub brawl had an impact on his leadership