Councillors have pledged to fight back on violence against women and girls - but were reminded that men can be victims too.