CM won’t remove tainted ministers