Internet Connection Keeps on getting Stuck

[kashutu]

Hi,
I have a very weired problem that i have brought here to discuss. First things first as William always reminds us....

Goautodial CE 2.0
VERSION: 2.4-309a
BUILD: 110430-1642

Ok let me first describe my Infrastructure for the PBX.

1. DSL Modem
2. Linksys Router e3000
3. GoAutodial Server

I have a DSL internet connection that goes into Linksys Router E3000, and then i have my Office Windows 2008 server and PBX server connected to the router. For the last 10 days i am facing an issue where suddenly i lose internet connection. I called my ISP provider, and they said there is not issue form their end. So, i unplugged everything, connected the DSL modem directly to the system and everything is working. Then i connect modem to a router and nothing is working keeping in mind my window server and pbx server are still connected to the router. So, i thought my router might be a troublesome. However, then i unplugged the PBX cable from router and kept the Windows Server cable plugged in, and suddenly i have internet back on. Then i put the PBX server cable back into the router, and restarted the PBX server, everything started working. After 30 mins, suddenly my internet connection is down again. I unplugged the PBX server cable from the router, and internet is back on. So my PBX is the culprit one. This started like a week ago and i don't remember changing anything major that will casue this issue. If someone can direct me what could be the issue so i can try to resolve it. I manage to get the log when my PBX was connected to the router and my internet went down. If some expert can look at it and figure out what is going on, i will appreciate it very much.

Here is the log

Nov 17 12:57:51 TheProfessionals kernel: dahdi_transcode: Loaded.
Nov 17 12:57:51 TheProfessionals kernel: INFO-xpp: revision Unknown MAX_XPDS=64 (8*8)
Nov 17 12:57:51 TheProfessionals kernel: INFO-xpp: FEATURE: without BRISTUFF support
Nov 17 12:57:51 TheProfessionals kernel: INFO-xpp: FEATURE: with PROTOCOL_DEBUG
Nov 17 12:57:51 TheProfessionals kernel: INFO-xpp: FEATURE: with sync_tick() from DAHDI
Nov 17 12:57:51 TheProfessionals kernel: INFO-xpp_usb: revision Unknown
Nov 17 12:57:51 TheProfessionals kernel: usbcore: registered new driver xpp_usb
Nov 17 12:57:51 TheProfessionals kernel: dahdi: Registered tone zone 0 (United States / North America)
Nov 17 12:57:53 TheProfessionals kernel: NET: Registered protocol family 10
Nov 17 12:57:53 TheProfessionals kernel: lo: Disabled Privacy Extensions
Nov 17 12:57:53 TheProfessionals kernel: ADDRCONF(NETDEV_UP): eth1: link is not ready
Nov 17 12:57:53 TheProfessionals kernel: IPv6 over IPv4 tunneling driver
Nov 17 12:57:53 TheProfessionals ntpd[2446]: ntpd 4.2.2p1@1.1570-o Tue May 19 13:58:05 UTC 2009 (1)
Nov 17 12:57:54 TheProfessionals ntpd[2457]: precision = 1.000 usec
Nov 17 12:57:54 TheProfessionals ntpd[2457]: Listening on interface wildcard, 0.0.0.0#123 Disabled
Nov 17 12:57:54 TheProfessionals ntpd[2457]: Listening on interface wildcard, ::#123 Disabled
Nov 17 12:57:54 TheProfessionals ntpd[2457]: Listening on interface lo, ::1#123 Enabled
Nov 17 12:57:54 TheProfessionals ntpd[2457]: Listening on interface lo, 127.0.0.1#123 Enabled
Nov 17 12:57:54 TheProfessionals ntpd[2457]: Listening on interface eth1, 192.168.1.9#123 Enabled
Nov 17 12:57:54 TheProfessionals ntpd[2457]: kernel time sync status 0040
Nov 17 12:57:54 TheProfessionals xinetd[2431]: xinetd Version 2.3.14 started with libwrap loadavg labeled-networking options compiled in.
Nov 17 12:57:54 TheProfessionals xinetd[2431]: Started working: 0 available services
Nov 17 13:00:02 TheProfessionals smartd[3035]: smartd version 5.38 [i686-redhat-linux-gnu] Copyright (C) 2002-8 Bruce Allen
Nov 17 13:00:02 TheProfessionals smartd[3035]: Home page is http://smartmontools.sourceforge.net/
Nov 17 13:00:02 TheProfessionals smartd[3035]: Opened configuration file /etc/smartd.conf
Nov 17 13:00:02 TheProfessionals smartd[3035]: Configuration file /etc/smartd.conf was parsed, found DEVICESCAN, scanning devices
Nov 17 13:00:02 TheProfessionals smartd[3035]: Device: /dev/hda, opened
Nov 17 13:00:02 TheProfessionals smartd[3035]: Device: /dev/hda, packet devices [this device CD/DVD] not SMART capable
Nov 17 13:00:02 TheProfessionals smartd[3035]: Device: /dev/sda, opened
Nov 17 13:00:02 TheProfessionals smartd[3035]: Device: /dev/sda, Bad IEC (SMART) mode page, err=5, skip device
Nov 17 13:00:02 TheProfessionals smartd[3035]: Monitoring 0 ATA and 0 SCSI devices
Nov 17 13:00:02 TheProfessionals smartd[3040]: smartd has fork()ed into background mode. New PID=3040.
Nov 17 13:01:54 TheProfessionals ntpd[2457]: frequency initialized 122.076 PPM from /var/lib/ntp/drift
Nov 17 13:05:09 TheProfessionals ntpd[2457]: synchronized to LOCAL(0), stratum 10
Nov 17 13:05:09 TheProfessionals ntpd[2457]: kernel time sync enabled 0001
Nov 17 13:06:58 TheProfessionals /sbin/mingetty[5527]: tty1: invalid character 0x1b in login name
Nov 17 13:11:59 TheProfessionals kernel: e1000: eth1 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX/TX
Nov 17 13:11:59 TheProfessionals kernel: ADDRCONF(NETDEV_CHANGE): eth1: link becomes ready
Nov 17 13:19:12 TheProfessionals ntpd[2457]: synchronized to 216.194.70.2, stratum 2
Nov 17 13:31:43 TheProfessionals ntpd[2457]: synchronized to 207.253.196.218, stratum 2
Nov 17 14:38:14 TheProfessionals kernel: e1000: eth1 NIC Link is Down
Nov 17 14:39:38 TheProfessionals kernel: e1000: eth1 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX/TX
Nov 17 14:46:27 TheProfessionals syslogd 1.4.1: restart.

Please ignore my writing if it is not that professional. Do let me know if i can provide any other information.

Thanks

[shisdew]

hi there
Have you cheked your MRTG . Is there any huge upload suddenly ?
thanks

[kashutu]

No there is no huge upload or download. Again it has happened my internet suddenly stopped working. I unplugged the LAN of PBX server and suddenly internet is back on. I restarted the PBX server and put back the LAN and it is working fine again. Anyone has any guess what might be happening that is causing to happen.

Thanks

[kashutu]

I have checked the logs and here is the new log:

Nov 17 14:49:45 TheProfessionals ntpd[2455]: synchronized to LOCAL(0), stratum 10
Nov 17 14:49:45 TheProfessionals ntpd[2455]: kernel time sync enabled 0001
Nov 17 14:50:50 TheProfessionals ntpd[2455]: synchronized to 216.194.70.2, stratum 2
Nov 17 14:51:17 TheProfessionals kernel: ADDRCONF(NETDEV_UP): eth1: link is not ready
Nov 17 14:51:19 TheProfessionals kernel: e1000: eth1 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX/TX
Nov 17 14:51:19 TheProfessionals kernel: ADDRCONF(NETDEV_CHANGE): eth1: link becomes ready
Nov 17 15:24:06 TheProfessionals ntpd[2455]: synchronized to 209.167.68.100, stratum 2
Nov 17 15:59:18 TheProfessionals ntpd[2455]: synchronized to 216.234.161.11, stratum 2
Nov 17 16:57:40 TheProfessionals ntpd[2455]: synchronized to 209.167.68.100, stratum 2
Nov 17 17:49:47 TheProfessionals ntpd[2455]: synchronized to 216.194.70.2, stratum 2
Nov 17 19:41:30 TheProfessionals ntpd[2455]: synchronized to 216.234.161.11, stratum 2
Nov 17 20:52:21 TheProfessionals ntpd[2455]: synchronized to LOCAL(0), stratum 10
Nov 18 09:47:50 TheProfessionals kernel: e1000: eth1 NIC Link is Down
Nov 18 09:53:03 TheProfessionals /sbin/mingetty[29913]: tty1: invalid character 0x1b in login name
Nov 18 09:54:26 TheProfessionals /sbin/mingetty[30673]: tty1: invalid character 0x1b in login name
Nov 18 09:57:36 TheProfessionals kernel: md: stopping all md devices.
Nov 18 09:57:37 TheProfessionals kernel: usb 3-1: new full speed USB device using uhci_hcd and address 2
Nov 18 09:57:37 TheProfessionals kernel: usb 3-1: not running at top speed; connect to a high speed hub
Nov 18 09:57:37 TheProfessionals kernel: usb 3-1: configuration #1 chosen from 1 choice
Nov 18 09:57:37 TheProfessionals kernel: hub 3-1:1.0: USB hub found
Nov 18 09:57:37 TheProfessionals kernel: hub 3-1:1.0: 2 ports detected
Nov 18 09:57:37 TheProfessionals kernel: ACPI: PCI interrupt for device 0000:08:00.0 disabled
Nov 18 09:57:37 TheProfessionals kernel: ACPI: PCI interrupt for device 0000:07:08.0 disabled
Nov 18 10:01:24 TheProfessionals syslogd 1.4.1: restart.

It seems like the link goes down after the clock tries to get synchronized to the servers mentioned above in the log. I might be wrong but why is it trying to synchronize it from outside rather than from the router. Can someone please shed some light.

Thanks

[williamconley]

1) Change your ntp provider to the windows server (more secure anyway)

2) consider a new network card (just in case)

3) verify that you are not being attacked on the outside of your firewall as a result of your server "touching" something outside.

4) when this happens next, try just rebooting the vicidial server

5) iftop during one of these moments to see if your asterisk server shows massive traffic (or NO traffic)

6) what kind of network connection is this? standard NIC card? or is it built into the mbd?

[shisdew]

I have also experienced the same. My vicidial server uploaded 60 mbps speed continously for 8 hours. This way it can upload the whole content of my hard drive 100 times cause i just newly installed it and few days we are dialing.
I have 1 real ip and 1 local ip on the server. My internet connection got blocked for this ISP complained for that. But i am helpless to find anything. No suspicious log either.

Please address the issue . Requesting Matt, gardo, william, demian and all the other experts.

[DomeDan]

I would use tcpdump to view what kind of packages are being sent.

if you got open ports against the internet then someone might be brutefoce attacking you,
close them and see if the problem goes away

[shisdew]

And how do i do that ?
while the Broadcast storm happens nothing works.

[DomeDan]

the command tcpdump on the vicidial server, run it and watch the data, you should point it to a file and view that instead
tcpdump > tcpdump_data.dump
less tcpdump_data.dump

you didnt mention broadcast storm before, whats up with that?
is your network poorly setup and there is a loop somewhere?