Yeddyurappa climbs down as loyalists dry up