Four Bengal ministers may not contest polls