Ludlow councillors have been accused of being biased in their decision-making about what should happen to a collapsed wall.