Temple not on people's agenda in Ayodhya