The reason behinds this could be because of the current fax operation (sending of T.30 signal / data)underneath the hood. Pending the time of when stop is called during the receive process would probably result in varying response times. If you waited longer and then hung up the call, does it happen any quicker?
Jeff