UP mantri refuses to quit his post