Palemar loyalists want him back as minister