Ministers nervous after Speaker resigns