‘Most in Cabinet for caste census’