For that type of use case, you would have to add in a third leg as a SIP call between server A and server B in order to connect those two parties together. Or maybe after that point in time, you can use that call leg to perform a transfer in order to move the user from A to B (as example) such that both parties now reside on the same server for their hair-pin connection.
Jeff