vicidial cluster - no audio on 1 dialer

[perlmutr]

Vicidial Version 2.12b0.5 SVN 2564 DB schema version 1462 asterisk version 11.22.0-vici

Test base is 3 machine cluster
Database machine, Dialer 1 and dialer 2.. both machines have 2 nic's.. one internal and 1 external for traffic.

Currently the database machine is set to not dial and the 2 dialers are set for balance dialing.
I am running a press 1 type survey campaign where the survey method is callmenu.

the callmenu prompt is sip-silence with a 1 second timeout which goes to extension which is set to an external number to basically conference the initial call with an agent on a inhouse phone system.

when i place a test call from dialer 1 the callee hears the recording and when they opt-in they are connected to an agent and all is OK.

when i repeat this scenario on dialer 2 the callee hears the recording and when they opt-in they are connected to an agent however there is no audio on either side of the conversation.

the log from a test is below. would appreciate any help. thanx in advance.. also there is no firewall other than vicidial fw. also this is an external connection.

[Nov 14 11:39:42] VERBOSE[2535] manager.c: [Nov 14 11:39:42] == Manager 'sendcron' logged on from 127.0.0.1
[Nov 14 11:39:42] VERBOSE[2536][C-00000005] pbx.c: [Nov 14 11:39:42] -- Executing [18137892016@default:1] AGI("Local/18137892016@default-00000002;2", "agi://127.0.0.1:4577/call_log") in new stack
[Nov 14 11:39:42] VERBOSE[2536][C-00000005] res_agi.c: [Nov 14 11:39:42] -- AGI Script Executing Application: (EXEC) Options: (Set(_CAMPCUST=Press1g))
[Nov 14 11:39:42] VERBOSE[2536][C-00000005] res_agi.c: [Nov 14 11:39:42] -- <Local/18137892016@default-00000002;2>AGI Script agi://127.0.0.1:4577/call_log completed, returning 0
[Nov 14 11:39:42] VERBOSE[2536][C-00000005] pbx.c: [Nov 14 11:39:42] -- Executing [18137892016@default:2] Dial("Local/18137892016@default-00000002;2", "SIP/18137892016@stratics3,,To") in new stack
[Nov 14 11:39:42] VERBOSE[2536][C-00000005] netsock2.c: [Nov 14 11:39:42] == Using SIP RTP CoS mark 5
[Nov 14 11:39:42] VERBOSE[2536][C-00000005] app_dial.c: [Nov 14 11:39:42] -- Called SIP/18137892016@stratics3
[Nov 14 11:39:48] VERBOSE[2536][C-00000005] app_dial.c: [Nov 14 11:39:48] -- SIP/stratics3-00000004 is making progress passing it to Local/18137892016@default-00000002;2
[Nov 14 11:39:57] WARNING[1820] chan_sip.c: Timeout on fa5592ecfe99fcb1a46c375b024eb344 on non-critical invite transaction.
[Nov 14 11:39:59] VERBOSE[2536][C-00000005] app_dial.c: [Nov 14 11:39:59] -- SIP/stratics3-00000004 answered Local/18137892016@default-00000002;2
[Nov 14 11:39:59] VERBOSE[2535][C-00000005] pbx.c: [Nov 14 11:39:59] > Channel Local/18137892016@default-00000002;1 was answered
[Nov 14 11:39:59] VERBOSE[2536][C-00000005] pbx.c: [Nov 14 11:39:59] -- Executing [h@default:1] AGI("Local/18137892016@default-00000002;2", "agi://127.0.0.1:4577/call_log--HVcauses--PRI-----NODEBUG-----16-----ANSWER-----17-----0") in new stack
[Nov 14 11:39:59] VERBOSE[2566][C-00000005] pbx.c: [Nov 14 11:39:59] -- Executing [8366@default:1] Playback("SIP/stratics3-00000004", "sip-silence") in new stack
[Nov 14 11:39:59] VERBOSE[2566][C-00000005] file.c: [Nov 14 11:39:59] -- <SIP/stratics3-00000004> Playing 'sip-silence.gsm' (language 'en')
[Nov 14 11:39:59] VERBOSE[2566][C-00000005] pbx.c: [Nov 14 11:39:59] -- Executing [8366@default:2] AGI("SIP/stratics3-00000004", "agi://127.0.0.1:4577/call_log") in new stack
[Nov 14 11:39:59] VERBOSE[2566][C-00000005] res_agi.c: [Nov 14 11:39:59] -- AGI Script Executing Application: (EXEC) Options: (Set(_CAMPCUST=Press1g))
[Nov 14 11:39:59] VERBOSE[2566][C-00000005] res_agi.c: [Nov 14 11:39:59] -- <SIP/stratics3-00000004>AGI Script agi://127.0.0.1:4577/call_log completed, returning 0
[Nov 14 11:39:59] VERBOSE[2566][C-00000005] pbx.c: [Nov 14 11:39:59] -- Executing [8366@default:3] AGI("SIP/stratics3-00000004", "agi-VDAD_ALL_outbound.agi,SURVEYCAMP-----LB") in new stack
[Nov 14 11:39:59] VERBOSE[2566][C-00000005] res_agi.c: [Nov 14 11:39:59] -- Launched AGI Script /usr/share/asterisk/agi-bin/agi-VDAD_ALL_outbound.agi
[Nov 14 11:39:59] VERBOSE[2566][C-00000005] res_rtp_asterisk.c: [Nov 14 11:39:59] > 0x7eff94015b10 -- Probation passed - setting RTP source address to 76.10.220.15:38188
[Nov 14 11:39:59] VERBOSE[2566][C-00000005] res_agi.c: [Nov 14 11:39:59] -- <SIP/stratics3-00000004> Playing 'sip-silence.gsm' (escape_digits=) (sample_offset 0) (language 'en')
[Nov 14 11:39:59] DEBUG[2566][C-00000005] format_wav.c: Skipping unknown block 'fact'
[Nov 14 11:39:59] VERBOSE[2566][C-00000005] res_agi.c: [Nov 14 11:39:59] -- <SIP/stratics3-00000004> Playing 'NashvilleLivemessage.slin' (escape_digits=09) (sample_offset 0) (language 'en')
[Nov 14 11:40:00] VERBOSE[2535] manager.c: [Nov 14 11:40:00] == Manager 'sendcron' logged off from 127.0.0.1
[Nov 14 11:40:00] VERBOSE[2536][C-00000005] res_agi.c: [Nov 14 11:40:00] -- <Local/18137892016@default-00000002;2>AGI Script agi://127.0.0.1:4577/call_log--HVcauses ... --17-----0 completed, returning 0
[Nov 14 11:40:00] VERBOSE[2536][C-00000005] pbx.c: [Nov 14 11:40:00] == Spawn extension (default, 18137892016, 2) exited non-zero on 'Local/18137892016@default-00000002;2'
[Nov 14 11:40:01] VERBOSE[2589] manager.c: [Nov 14 11:40:01] == Manager 'sendcron' logged on from 127.0.0.1
[Nov 14 11:40:01] VERBOSE[2589] manager.c: [Nov 14 11:40:01] == Manager 'sendcron' logged off from 127.0.0.1
[Nov 14 11:40:06] DTMF[2566][C-00000005] channel.c: DTMF begin '0' received on SIP/stratics3-00000004
[Nov 14 11:40:06] DTMF[2566][C-00000005] channel.c: DTMF begin ignored '0' on SIP/stratics3-00000004
[Nov 14 11:40:06] VERBOSE[2598] manager.c: [Nov 14 11:40:06] == Manager 'sendcron' logged on from 127.0.0.1
[Nov 14 11:40:06] VERBOSE[2598] manager.c: [Nov 14 11:40:06] == Manager 'sendcron' logged off from 127.0.0.1
[Nov 14 11:40:06] DTMF[2566][C-00000005] channel.c: DTMF end '0' received on SIP/stratics3-00000004, duration 160 ms
[Nov 14 11:40:06] DTMF[2566][C-00000005] channel.c: DTMF end passthrough '0' on SIP/stratics3-00000004
[Nov 14 11:40:06] DEBUG[2566][C-00000005] format_wav.c: Skipping unknown block 'fact'
[Nov 14 11:40:06] VERBOSE[2566][C-00000005] res_agi.c: [Nov 14 11:40:06] -- <SIP/stratics3-00000004> Playing 'Hold_Transfer.slin' (escape_digits=) (sample_offset 0) (language 'en')
[Nov 14 11:40:09] VERBOSE[2566][C-00000005] res_agi.c: [Nov 14 11:40:09] -- <SIP/stratics3-00000004>AGI Script agi-VDAD_ALL_outbound.agi completed, returning 0
[Nov 14 11:40:09] VERBOSE[2566][C-00000005] pbx.c: [Nov 14 11:40:09] -- Executing [s@call3132096055:1] Answer("SIP/stratics3-00000004", "") in new stack
[Nov 14 11:40:09] VERBOSE[2566][C-00000005] pbx.c: [Nov 14 11:40:09] -- Executing [s@call3132096055:2] AGI("SIP/stratics3-00000004", "agi-VDAD_inbound_calltime_check.agi,CALLMENU-----YES-----call3132096055-------------------------NO") in new stack
[Nov 14 11:40:09] VERBOSE[2566][C-00000005] res_agi.c: [Nov 14 11:40:09] -- Launched AGI Script /usr/share/asterisk/agi-bin/agi-VDAD_inbound_calltime_check.agi
[Nov 14 11:40:09] VERBOSE[2566][C-00000005] res_agi.c: [Nov 14 11:40:09] -- <SIP/stratics3-00000004> Playing 'sip-silence.gsm' (escape_digits=) (sample_offset 0) (language 'en')
[Nov 14 11:40:09] VERBOSE[2566][C-00000005] res_agi.c: [Nov 14 11:40:09] -- <SIP/stratics3-00000004> Playing 'sip-silence.gsm' (escape_digits=) (sample_offset 0) (language 'en')
[Nov 14 11:40:09] VERBOSE[2566][C-00000005] res_agi.c: [Nov 14 11:40:09] -- <SIP/stratics3-00000004>AGI Script agi-VDAD_inbound_calltime_check.agi completed, returning 0
[Nov 14 11:40:09] VERBOSE[2566][C-00000005] pbx.c: [Nov 14 11:40:09] -- Executing [s@call3132096055:3] Set("SIP/stratics3-00000004", "INVCOUNT=0") in new stack
[Nov 14 11:40:09] VERBOSE[2566][C-00000005] pbx.c: [Nov 14 11:40:09] -- Executing [s@call3132096055:4] BackGround("SIP/stratics3-00000004", "sip-silence") in new stack
[Nov 14 11:40:09] VERBOSE[2566][C-00000005] file.c: [Nov 14 11:40:09] -- <SIP/stratics3-00000004> Playing 'sip-silence.gsm' (language 'en')
[Nov 14 11:40:09] VERBOSE[2566][C-00000005] pbx.c: [Nov 14 11:40:09] -- Executing [s@call3132096055:5] WaitExten("SIP/stratics3-00000004", "1") in new stack
[Nov 14 11:40:10] VERBOSE[2566][C-00000005] pbx.c: [Nov 14 11:40:10] -- Timeout on SIP/stratics3-00000004, going to 't'
[Nov 14 11:40:10] VERBOSE[2566][C-00000005] pbx.c: [Nov 14 11:40:10] -- Executing [t@call3132096055:1] Goto("SIP/stratics3-00000004", "default,13132096055,1") in new stack
[Nov 14 11:40:10] VERBOSE[2566][C-00000005] pbx.c: [Nov 14 11:40:10] -- Goto (default,13132096055,1)
[Nov 14 11:40:10] VERBOSE[2566][C-00000005] pbx.c: [Nov 14 11:40:10] -- Executing [13132096055@default:1] AGI("SIP/stratics3-00000004", "agi://127.0.0.1:4577/call_log") in new stack
[Nov 14 11:40:10] VERBOSE[2566][C-00000005] res_agi.c: [Nov 14 11:40:10] -- AGI Script Executing Application: (EXEC) Options: (Set(_CAMPCUST=Press1g))
[Nov 14 11:40:10] VERBOSE[2566][C-00000005] res_agi.c: [Nov 14 11:40:10] -- <SIP/stratics3-00000004>AGI Script agi://127.0.0.1:4577/call_log completed, returning 0
[Nov 14 11:40:10] VERBOSE[2566][C-00000005] pbx.c: [Nov 14 11:40:10] -- Executing [13132096055@default:2] Dial("SIP/stratics3-00000004", "SIP/13132096055@stratics3,,To") in new stack
[Nov 14 11:40:10] VERBOSE[2566][C-00000005] netsock2.c: [Nov 14 11:40:10] == Using SIP RTP CoS mark 5
[Nov 14 11:40:10] VERBOSE[2566][C-00000005] app_dial.c: [Nov 14 11:40:10] -- Called SIP/13132096055@stratics3
[Nov 14 11:40:11] VERBOSE[2566][C-00000005] app_dial.c: [Nov 14 11:40:11] -- SIP/stratics3-00000005 is making progress passing it to SIP/stratics3-00000004
[Nov 14 11:40:14] VERBOSE[2566][C-00000005] app_dial.c: [Nov 14 11:40:14] -- SIP/stratics3-00000005 answered SIP/stratics3-00000004
[Nov 14 11:41:01] VERBOSE[2682] manager.c: [Nov 14 11:41:01] == Manager 'sendcron' logged on from 127.0.0.1
[Nov 14 11:41:01] VERBOSE[2682] manager.c: [Nov 14 11:41:01] == Manager 'sendcron' logged off from 127.0.0.1
[Nov 14 11:41:06] VERBOSE[2692] manager.c: [Nov 14 11:41:06] == Manager 'sendcron' logged on from 127.0.0.1
[Nov 14 11:41:06] VERBOSE[2692] manager.c: [Nov 14 11:41:06] == Manager 'sendcron' logged off from 127.0.0.1
[Nov 14 11:41:15] NOTICE[1820] chan_sip.c: Disconnecting call 'SIP/stratics3-00000005' for lack of RTP activity in 61 seconds
[Nov 14 11:41:15] VERBOSE[2566][C-00000005] pbx.c: [Nov 14 11:41:15] -- Executing [h@default:1] AGI("SIP/stratics3-00000004", "agi://127.0.0.1:4577/call_log--HVcauses--PRI-----NODEBUG-----16-----ANSWER-----75-----61") in new stack
[Nov 14 11:41:15] VERBOSE[2566][C-00000005] res_agi.c: [Nov 14 11:41:15] -- <SIP/stratics3-00000004>AGI Script agi://127.0.0.1:4577/call_log--HVcauses ... -75-----61 completed, returning 0
[Nov 14 11:41:15] VERBOSE[2566][C-00000005] pbx.c: [Nov 14 11:41:15] == Spawn extension (default, 13132096055, 2) exited non-zero on 'SIP/stratics3-00000004'