Towards Stable Preferences for Stakeholder-aligned Machine Learning