PM worries about ‘rising intolerance’