Only if it is currently lower than your bladder.
If your bladder is below the water level, the pee is already displacing bath water.
It doesn’t fill with air when you pee, it just “deflates”.