The pressure is equal on both sides for a pressure balanced expansion joint. If the pressure difference is minor, it would not be a problem, but if the pressure thrust is high, then an imbalance of forces would occur and could result in forces being transmitted to adjacent equipment.
![Expjt pressubal 2](https://devptp.usbellows.com/wp-content/uploads/1990/07/expjt_pressubal_2-300x196.jpg)