Ideal DB Server setup

All installation and configuration problems and questions

Moderators: gerski, enjay, williamconley, Op3r, Staydog, gardo, mflorell, MJCoate, mcargile, Kumba, Michael_N

Ideal DB Server setup

Postby bastece » Tue Nov 12, 2024 1:12 pm

Hi all,

I am looking to install a v11 cluster to initially support ~150 agents, with the intention to increase it to 500+ all potentially dialing on predictive from the same campaign (hence the need of a single system).

My intention is to spec the DB servers the best way possible to support the 500+ agents, so as the system grows I don't have to be doing any migration or anything, just keep adding telephony and web servers.

This is what I was thinking on doing:
2 x 2.8GHz 8-Core 4309Y Xeon Silver
128gb of DDR4 RAM
2x 1TB NVME SSDs on a software raid
2x 480gb SATA SSDs on MegaRAID card (RAID1)
Use the SATA SSDs to install the OS and the NVME RAID to store the database.

The above would be x2, to host the reporting database.

My main questions are:

1.- Has anyone done this setup before? Any advise would be greatly appreciated.
2.- Has anyone gotten to the 600-700 agents mark doing predictive?
3.- Has anyone hit a point where a DB server like this starts being the bottleneck and creates the need to split the system into 2?
4.- Does anyone recommend using AMD CPUs? As they can be found with higher Core Count and Clock Speeds for less money.

P.S.: I have plenty of experience setting up clusters, I am just curious on what new hardware has done to VD's capacity.
bastece
 
Posts: 5
Joined: Tue Oct 31, 2023 3:59 pm

Re: Ideal DB Server setup

Postby mflorell » Tue Nov 12, 2024 8:09 pm

The number of concurrent logged-in agents is just one metric in sizing a system. What dial-ratio are you looking at for these agents? How many maximum SIP trunk lines? Will you be handling any inbound calls? Will you be recording all phone calls? Will you be using any of the API functions? etc...

Yes, we have set up very large clusters with up to 600 agents, but there are several rules you need to follow depending on the details of how you want to operate to get to high density on a single cluster.
mflorell
Site Admin
 
Posts: 18382
Joined: Wed Jun 07, 2006 2:45 pm
Location: Florida

Re: Ideal DB Server setup

Postby williamconley » Tue Nov 12, 2024 11:28 pm

on a software raid


This makes me nervous.

My experience with software raid is that it slows things down and can't be ported to new hardware easily.

That being said: I've never tried software raid with a Server on NVMe
Vicidial Installation and Repair, plus Hosting and Colocation
Newest Product: Vicidial Agent Only Beep - Beta
http://www.PoundTeam.com # 352-269-0000 # +44(203) 769-2294
williamconley
 
Posts: 20239
Joined: Wed Oct 31, 2007 4:17 pm
Location: Davenport, FL (By Disney!)

Re: Ideal DB Server setup

Postby carpenox » Wed Nov 13, 2024 7:00 am

I would definitely suggest breaking it down to 2 clusters, at that size, you will more than likely have bottleneck issues at the DB level
Alma Linux 9.4 | SVN Version: 3884 | DB Schema Version: 1720 | Asterisk 18.21.1 | PHP8
www.dialer.one -:- 1-833-DIALER-1 -:- https://linktr.ee/CyburDial -:- WA: +19549477572
GC: https://join.skype.com/ujkQ7i5lV78O | DC: https://discord.gg/DVktk6smbh
carpenox
 
Posts: 2412
Joined: Wed Apr 08, 2020 2:02 am
Location: St Petersburg, FL

Re: Ideal DB Server setup

Postby bastece » Wed Nov 13, 2024 9:22 am

Thank you all for your responses.

Here are my assumptions:
- What we are predicting for this is potentially dialing in a 6:1, so I am assuming 3000-4000 concurrent calls on the outbound side.
- AMD detection on
- Recording on (potentially with a delayed start)
- Inbounds just callbacks (roughly 5% of the outbound traffic, I'd say)
- The only API usage will be to add leads to the system.

This might seem a little crazy, I am just trying to figure out what type of DB server you'd guys use to build the largest cluster you can possibly build.
bastece
 
Posts: 5
Joined: Tue Oct 31, 2023 3:59 pm

Re: Ideal DB Server setup

Postby mflorell » Wed Nov 13, 2024 11:15 am

I would suggest using the fastest NVMe drives you can get, and use them for BOTH on separate sets of drives for the MySQL data directory and the OS/apps. We have seen issues on very large clusters with the OS/apps drives falling behind in certain circumstances.
mflorell
Site Admin
 
Posts: 18382
Joined: Wed Jun 07, 2006 2:45 pm
Location: Florida

Re: Ideal DB Server setup

Postby bastece » Wed Nov 13, 2024 12:06 pm

Got you, that makes a lot of sense.

Should I still do software raid1 or 10 on both NVMes sets?
As far as the CPU, do you think that will suffice?

I really really appreciate your help, by the way.
bastece
 
Posts: 5
Joined: Tue Oct 31, 2023 3:59 pm

Re: Ideal DB Server setup

Postby okli » Wed Nov 13, 2024 3:46 pm

Take a look at Intel Optane P58xx series, they are simply the fastest NVMEs available with amazingly high IOps and DWPD compared to any other NVME. although Intel have abandoned Optane project, they are still available.
Put them in softraid1, used for database files only and have a couple of spares just in case. No need for raid10 for these.

As for CPU, I would go with Xeon Gold and more cores, like 2 x 16 or AMD with more cores again.

At dial level 6, AMD on and full recording, in my opinion you should either split this in 2 clusters, or seek Vicidial group to do the entire set up, tuning and support once in production.

Just imagine 600 agents sitting unproductive, while you are figuring out why the heck agents get kicked out randomly, or get several calls at once etc. hard amd lengthy to troubleshoot issues. Are you willing to take the risk?
okli
 
Posts: 671
Joined: Mon Oct 01, 2007 5:09 pm


Return to Support

Who is online

Users browsing this forum: Google [Bot], Majestic-12 [Bot] and 58 guests