At the same time, if you keep your composure, conductors will often side with the passenger over the OBS.
A few times, I've been involved in situations where the OBS was not only wrong, but belligerent and inappropriate. They summoned the conductor, who always supported me.