asterisk segfault

[bobbymc]

im using asterisk 1.2.24 zaptel 1.2.20 looks like when allot of calls are being places in the asterisk queue after a while it crashes and i get this error

kernel: asterisk[29143]: segfault at 00002aaa00000000 rip 00002b484cc315a0 rsp 0000000042be3618 error

am i using a bad asterisk version? matt what asterisk version do you prefer and what zaptel version? im really trying to push allot of calls on vicidial but this is the only issue thats stopping me right now..
hardware is dual cpu quad core 2.3 ghz with 8 gigs of ram
on a scsi drive 100 gigs.. i even did a ramdisk for the recrodings to speed that up.. any idea why i get this crash? can you point me out to the sources you use for your setup? or do you have the same issue with over 200 calls being places at once..

[mflorell]

I have dozens of servers running 1.2.24 so I'm pretty sure that's not your problem. Have you run a memtest on your system for over 12 hours?

[bobbymc]

this is a brand new server from dell

[mflorell]

Uh oh, you said the key word right there: "Dell"

I have had many "brand-new" servers from Dell that died right out of the box. One that started spewing smoke into my server room when I plugged it in was especially entertaining. But I am most proud of the new 4 x dual core Xeon Dell server that I ran performance testing on for a client and burned up 4 of the CPU cores in 5 weeks In every instance Dell's response is just to ship out a new one.

I have also run into issues on Dells with the power control chipsets not being able to handle power save modes properly, you might try explicitly enabling or disabling APIC and ACPI at the kernel level or within GRUB. Dell support and I couldn't figure that one out until the big Fonality/Dell/Sangoma deal was signed and all sorts of other people started having the same problem and finally someone tracked it down to the sub-standard power control chipsets that they use.

[bobbymc]

memory clean ... looks like there might be a tcp limit or rtp limit.. i got these errors

May 29 08:56:48 ERROR[27033] rtp.c: Unable to allocate socket: Too many open files
May 29 08:56:48 ERROR[27033] chan_sip.c: Unable to build sip pvt data for '670414076564054@XXX.XXX.XXX.XXX' (Out of memory)
May 29 08:56:48 ERROR[27019] rtp.c: Unable to allocate socket: Too many open files
May 29 08:56:48 ERROR[27019] chan_sip.c: Unable to build sip pvt data for '670418139950645@XXX.XXX.XXX.XXX' (Out of memory)
May 29 08:56:48 ERROR[26963] rtp.c: Unable to allocate socket: Too many open files
May 29 08:56:48 ERROR[27011] rtp.c: Unable to allocate socket: Too many open files
May 29 08:56:48 ERROR[27011] chan_sip.c: Unable to build sip pvt data for '670413523906549@XXX.XXX.XXX.XXX' (Out of memory)
May 29 08:56:48 ERROR[26942] chan_sip.c: Unable to build sip pvt data for '670415617539070@XXX.XXX.XXX.XXX' (Out of memory)
May 29 08:56:48 ERROR[26919] chan_sip.c: Unable to build sip pvt data for '670419549229132@XXX.XXX.XXX.XXX' (Out of memory)
May 29 08:56:48 ERROR[26963] chan_sip.c: Unable to build sip pvt data for '670412393943384@XXX.XXX.XXX.XXX' (Out of memory)



i replaced the ip wth XXX.XXX.XXX.XXX... so at this point if asterisk make more then 100 calls at once.. it freaks out and crashes.. any idea what i am doing wrong?

[mflorell]

I have run into that problem on a couple high-volume systems, what you should try is raising your ulimit settings before starting Asterisk and see if that helps at all.

[Op3r]

or maybe time to have a refund from dell and get from supermicro?

[bobbymc]

matt can you please give me your ulimit settigns and any other system settigsn you set that i can use to tweak this.. thx

[mflorell]

just do a 'ulimit -a' to view your settings. I usually only have to raise the "-n" open file limit for Asterisk not to have problems(it defaults to 1024 on most systems), but there are other settings that I heave heard may need to also be raised.

[bobbymc]

im lost and i have no idea where to look anymore.. current issue is that when i make more then 80 calls simutaniously the hang up calls lag and it takes a while before the channel gets hung up on.. any idea whats causing the lag?

[mflorell]

What is your loadavg when this happens?

[bobbymc]

its like 1.0 this box is heavy duty.. dual cpu each cpu is quad core 2.3 ghz with 8 gigs of ram =)

[mflorell]

Linux distro?

[bobbymc]

Linux asterisknode19 2.6.18-1000hz #3 SMP Thu May 15 02:41:28 PDT 2008 x86_64 GNU/Linux

[mflorell]

Never heard of that one before, and I usually don't use 64-bit for Asterisk servers. I know it's not the best suggestion, but I would recommend trying Slackware or Suse because I haven't run into your exact problem before with any VICIDIAL install.

[bobbymc]

looks like the issue was g729.. it wasnt compiled corrently.. i let u know if i find out anyhting else.. but after i fixed the AST_manager_send issue and took away g729 i was able to push over 500 calls at once without any crash and load avarge was staying at 1.0.. let me know if u need any feedback that might help