Dialogic HMP becomes unregistered with the SIP server immediately after load testing

Hi,

I am setting up a load testing for an application that uses Dialogic HMP Windows 3.0. The application is running on a Windows 2012 R2 virtual machine hosted in VMWare Esxi.

I am finding the application keeps becoming unregistered with the PBX (an AsteriskNow machine) either immediately after load testing, or during longer load testing runs.

I then have to shutdown and restart my application for SIP registration to occur again.

No Dialogic events occur when the application becomes unregistered and AsteriskNow simply says that extension is now Unreachable.

In the rtf logs I see this:

05/31/2017 16:20:24.346   4152        5184                                      decoder.cpp:1244      !     0 ! gc_h3r:>> OnEventTerminate: Board 1 - IP library is down numLoadedSubLibs = 0
05/31/2017 16:20:26.312   1644           0                                      [Control message from process 4152]:Client detached 
05/31/2017 16:20:32.220   1644           0                                      [Control message from process 3532]:Client attached 
05/31/2017 16:20:32.983   3532       10424                                      sm_main.cpp:340       !     0 ! gc_h3r:>> h3r_Start : gc_start_structp->version=513, media_operational_mode=EmbeddedMedia
05/31/2017 16:20:33.014   3532       10424                                      decoder.cpp:72        !     0 ! gc_h3r:Sharon - Decoder Send socket binding on IP=0x100007f : Port=45549
05/31/2017 16:20:33.014   3532       10424                                      decoder.cpp:85        !     0 ! gc_h3r:Sharon - Listening on IP=0x7f000001 : Port=60849
05/31/2017 16:20:33.015   3532       10424                                      virt_board.cpp:181    !     0 ! gc_h3r:MIME pool allocation complete size 0x5c4 number 100.
05/31/2017 16:20:33.015   3532       10424                                      virt_board.cpp:209    !     0 ! gc_h3r:NSControlData pool allocation complete size 0xff number 0.
05/31/2017 16:20:33.015   3532       10424                                      sm.cpp:2511           !     0 ! gc_h3r: Allocation: Board 1 - Sharon = 20 , H323 = 0 , SIP = 20
05/31/2017 16:20:33.015   3532       10424                                      sm.cpp:2518           !     0 ! gc_h3r: Allocation: CRNs = 20 , Extension buffers = 130
05/31/2017 16:20:33.015   3532       10424                                      sm.cpp:1086           !     0 ! gc_h3r:Initialization: delimiter: ',', IP_VIRTBOARD version: 0x117
05/31/2017 16:20:33.015   3532       10424                                      sm.cpp:472            !     0 ! gc_h3r:Initialization: SIP Board 0: IPv4 transport address: DEFAULT_HOST_IPADDR:5060
05/31/2017 16:20:33.015   3532       10424                                      sm.cpp:474            !     0 ! gc_h3r:Initialization: SIP Board 0: IPv6 transport address: DEFAULT_HOST_IPADDR:5060
05/31/2017 16:20:33.015   3532       10424                                      sm.cpp:476            !     0 ! gc_h3r:Initialization: SIP Board 0: sip_msginfo_mask: 0xf, sup_serv_mask: 0x0, dynamic_outbound_proxy_enable: 0x0
05/31/2017 16:20:33.015   3532        6608                                      sip_decoder.cpp:64    !     0 ! gc_h3r: Board 1 - Listening on IP=0x7f000001 : Port=60850
05/31/2017 16:20:33.015   3532        6608                                      sip_encoder.cpp:164   !     0 ! gc_h3r:Board 1 - Sharon on IP=0x7f000001 : Port=60849
05/31/2017 16:20:33.026   3532        6608                                      sip_sigalmanage:1294  !     0 ! gc_h3r:Board 1 - RV SIP Stack Version 6.5.0.14
05/31/2017 16:20:33.026   3532        6608                                      sip_sigal_main.:127   !     0 ! gc_h3r:Board 1 - Sigal SIP Version 5,2,2,802
05/31/2017 16:20:33.527   3532       10424                                      sm.cpp:342            !     0 ! gc_h3r:Monitor Init: SIP Board 0: transport address: 10.8.48.53
05/31/2017 16:20:33.527   3532       11496                                      mon_decenc.cpp:57     !     0 ! gc_h3r:>> MonDecoder::ctor Listening on IP=0x7f000001 : Port=60851
05/31/2017 16:20:34.027   3532       10424                                      sm.cpp:2571           !     0 ! gc_h3r: Sharon Version 5,2,2,802
05/31/2017 16:20:34.341   3532        8296 gc_h3r                  ERR1         encoder.cpp:2367      !     0 ! Encoder::sendSysMsg : encodeCallForward failed:No Call Forward data in DB.
05/31/2017 16:20:34.341   3532        8296 gc_h3r                  ERR1         board_device.cp:360   !     0 ! << CallForward , sendSysMsg(MsgType_CallForward) failed!
05/31/2017 16:20:34.365   3532        6608 gc_h3r                  ERR1         sip_register.cp:6485  !     0 ! SipRegAOR::completeEncodingOfSuccessResponse: no Service-Route header registered
05/31/2017 16:20:34.365   3532        6988 gc_h3r                  ERR1         sipheader_mgr.c:2245  !     0 ! << SipHeaderMgrFactory::DeallocateMgr - HeaderMgr 0x6183620 was already deallocated!
05/31/2017 16:20:34.408   3532        8296 gc_h3r                  ERR1         encoder.cpp:2367      !     0 ! Encoder::sendSysMsg : encodeCallForward failed:No Call Forward data in DB.
05/31/2017 16:20:34.408   3532        8296 gc_h3r                  ERR1         board_device.cp:360   !     0 ! << CallForward , sendSysMsg(MsgType_CallForward) failed!
05/31/2017 16:20:34.529   3532        9488 Dm3Odi.dll              Error        Qcd [0:0:1:5:1] CDm3StdComp::Dm3GetErrorResult() -> (Std_MsgError) Message[0x12] Xid[0x6] Src[0:0:1:5:1] Dest[4:255:0:0:0] ErrorCode[0x6]
05/31/2017 16:20:34.529   3532        9488 libipm_ipvsc            ERR1         CIPVscChannel         ipmB1C1    ---  ::OnGetParm: ch=ipmB1C1 ErrorCode=0x6 -Invalid parameter number.
05/31/2017 16:20:34.592   3532        9488 Dm3Odi.dll              Error        Qcd [0:0:1:5:1] CDm3IPVsc::ProcessGetPortInfo() -> Unknown media information type = 0x32
05/31/2017 16:20:34.592   3532        9488 Dm3Odi.dll              Error        Qcd [0:0:1:5:1] CDm3IPVsc::ProcessGetPortInfo() -> Unknown media information type = 0x0
05/31/2017 16:20:34.592   3532        9488 Dm3Odi.dll              Error        Qcd [0:0:1:5:1] CDm3IPVsc::ProcessGetPortInfo() -> Unknown media information type = 0x0
05/31/2017 16:20:34.592   3532        9488 Dm3Odi.dll              Error        Qcd [0:0:1:5:1] CDm3IPVsc::ProcessGetPortInfo() -> Unknown media information type = 0x0
05/31/2017 16:20:34.592   3532        9488 Dm3Odi.dll              Error        Qcd [0:0:1:5:1] CDm3IPVsc::ProcessGetPortInfo() -> Unknown media information type = 0x0
05/31/2017 16:20:34.592   3532        9488 Dm3Odi.dll              Error        Qcd [0:0:1:5:1] CDm3IPVsc::ProcessGetPortInfo() -> Unknown media information type = 0x0
05/31/2017 16:20:34.592   3532        9488 Dm3Odi.dll              Error        Qcd [0:0:1:5:1] CDm3IPVsc::ProcessGetPortInfo() -> Unknown media information type = 0x0
05/31/2017 16:20:34.592   3532        9488 Dm3Odi.dll              Error        Qcd [0:0:1:5:1] CDm3IPVsc::ProcessGetPortInfo() -> Unknown media information type = 0x0
05/31/2017 16:20:34.592   3532        9488 Dm3Odi.dll              Error        Qcd [0:0:1:5:1] CDm3IPVsc::ProcessGetPortInfo() -> Unknown media information type = 0x0
05/31/2017 16:20:34.592   3532        9488 Dm3Odi.dll              Error        Qcd [0:0:1:5:1] CDm3IPVsc::ProcessGetPortInfo() -> Unknown media information type = 0x0
05/31/2017 16:20:34.592   3532        9488 Dm3Odi.dll              Error        Qcd [0:0:1:5:1] CDm3IPVsc::ProcessGetPortInfo() -> Unknown media information type = 0x0
05/31/2017 16:20:34.592   3532        9488 Dm3Odi.dll              Error        Qcd [0:0:1:5:1] CDm3IPVsc::ProcessGetPortInfo() -> Unknown media information type = 0x0
05/31/2017 16:20:34.592   3532        9488 Dm3Odi.dll              Error        Qcd [0:0:1:5:1] CDm3IPVsc::ProcessGetPortInfo() -> Unknown media information type = 0x0
05/31/2017 16:20:34.592   3532        9488 Dm3Odi.dll              Error        Qcd [0:0:1:5:1] CDm3IPVsc::ProcessGetPortInfo() -> Unknown media information type = 0x0
05/31/2017 16:30:10.530   3532        6608 sip_stack               Error        000019D0   ERROR  - RA           - RA_Alloc - (raH=0x057D3468(Reg client pool),ElementPtr=0x0592CF18)=-2: No more elements are available
05/31/2017 16:30:10.530   3532        6608 sip_stack               Error        000019D0   ERROR  - RLIST        - RLIST_InsertTail - (hPoolList=0x02E1F220)=-2
05/31/2017 16:30:10.530   3532        6608 sip_stack               Error        000019D0   ERROR  - REG_CLIENT   - RvSipRegClientMgrCreateRegClient - Error - Failed to allocate new register-client object
05/31/2017 16:30:10.530   3532        6608 gc_h3r                  ERR1         sip_register.cp:2987  !     0 ! << SipRegAOR::iniRegClient - RvSipRegClientMgrCreateRegClient(hRegClientMgr=0x57d3338) failed: -2
05/31/2017 16:30:10.530   3532        6608 gc_h3r                  ERR1         sip_register.cp:3081  !     0 ! <>~SipSigalMan(): **************** Sigal Sip Board 1 Rv Stack Network Msg Summary *************
05/31/2017 16:30:18.209   3532        6608                                      sip_sigalmanage:367   !     0 ! gc_h3r:StackReceive Stats rcvdINVITE=8, rcvdINVITERetrans=4 rcvdNonInviteReq=12
05/31/2017 16:30:18.209   3532        6608                                      sip_sigalmanage:370   !     0 ! gc_h3r:StackReceive Stats rcvdNonInviteReqRetrans=1 rcvdResponse=5 rcvdResponseRetrans=0
05/31/2017 16:30:18.209   3532        6608                                      sip_sigalmanage:373   !     0 ! gc_h3r:StackSend Stats sentINVITE=0, sentINVITERetrans=0 sentNonInviteReq=5
05/31/2017 16:30:18.210   3532        6608                                      sip_sigalmanage:376   !     0 ! gc_h3r:StackSend Stats sentNonInviteReqRetrans=0 sentResponse=15 sentResponseRetrans=0
05/31/2017 16:30:18.210   3532        6608                                      sip_sigalmanage:379   !     0 ! gc_h3r:<<~SipSigalMan(): ****************** Summary Complete *****************************************
05/31/2017 16:30:18.210   3532        6608 gc_h3r                  ERR1         sip_register.cp:2888  !     0 ! SipRegAOR::~SipRegAOR - Possible memory leak of RvRegisterClient object.  (This message can appear if applications shut down without deregistering their Aliases.)
05/31/2017 16:30:18.210   3532        6608                                      sip_sigalmanage:426   !     0 ! gc_h3r:
                                                                               >>~SipSigalMan(): ******* Sigal SIP Board 1 IPC Msg Summary *******
                                                                               Total Msgs Sent = 63, Send Rate = 0 msgs/sec, Max Send Rate = 0 msgs/sec
                                                                               Total Msgs Rec  = 100, Rec Rate  = 0 msgs/sec, Max Rec Rate  = 0 msgs/sec
                                                                               Total Msgs Rec out of order = 0, Max Cached Msgs = 0, Max cached Time = 0 sec.
                                                                               <<~SipSigalMan(): ****************** Summary Complete ******************

I assume the message "RvSipRegClientMgrCreateRegClient - Error - Failed to allocate new register-client object" is where re-registration fails to occur.

Is the very high volume of traffic somehow causing the issue?

What can I do to stop this from happening?

Thanks,

Brendan