Dropping call when transfer to ingroup.

Hello all, we have a problem when agents transfer calls to ingroups (any), most of the time it drops the call. We have two locations, one where the dialer is and a few agents, the other is remote location with the majority of the agents and is connected through VPN tunnel back to local office/dialer. Most of the time our local agents can transfer to say our Spanish Ingroup. Some times it drops the call. All of the time when our remote agents try to transfer to ingroup, the call drops. All agents are members of the same User Group and Campaign. We have several ingroups for transfers, ( local office, remote office, Spanish skill etc) I logged in with my admin user and it works every time, I copied a user that experiences this problem, logged in as that test user and it works every time. Is this a network/latency issue? Our network is pretty stout.