Clegg faces a backlash over talks with Labour