Congress to decide minister’s fate