Last I went through all of my forum settings, there was no way to turn it off. Some forums have the option (that administrators can turn on and off as a usable feature), but I don't know if Xenforo does.

Usually I just flip the faces, but it's hard to flip :p, so I use :b.