Bulk list load with custom fields

All installation and configuration problems and questions

Moderators: gerski, enjay, williamconley, Op3r, Staydog, gardo, mflorell, MJCoate, mcargile, Kumba, Michael_N

Bulk list load with custom fields

Postby Acidshock » Tue Nov 11, 2014 10:40 pm

Ok got something new I am trying to do. I have a affiliate system that I am creating. This system is going to be amassing leads from affiliates who upload their own lists. I will then import those leads into VICI. Problem is that there are custom fields(Always the same.) All the list creation I figured I could do via the api or simple DB calls. The only thing I didn't want to touch is loading the leads into the DB myself as the list loaders do their job really well. Problem I have is this... If I get a large list from an affiliate, say 100k records.... I don't want to be making 100k worth of api calls to add each lead one at a time. Has anyone crossed this bridge in the past and have anything to recommend? I looked into the Perl bulk lead loading scripts but they don't handle custom fields :(
VERSION: 2.14-698a | BUILD: 190207-2301 | Asterisk:13.24.1-vici | Vicibox 8.1.2
Acidshock
 
Posts: 430
Joined: Wed Mar 03, 2010 3:19 pm

Re: Bulk list load with custom fields

Postby williamconley » Sun Mar 15, 2015 1:10 pm

Preprocess your accepted list from the affiliate generator ...

1) Verify that all lists involved have the custom tables already created
2) Bulk load all the standard fields (nothing in custom)
3) Manually enter the data directly via mysql into the custom tables.

Note that the bulk loader avoids custom tables, but it does manage everything else nicely. This will get "everything else" handled properly and still gets your data into the custom tables.
Vicidial Installation and Repair, plus Hosting and Colocation
Newest Product: Vicidial Agent Only Beep - Beta
http://www.PoundTeam.com # 352-269-0000 # +44(203) 769-2294
williamconley
 
Posts: 20258
Joined: Wed Oct 31, 2007 4:17 pm
Location: Davenport, FL (By Disney!)


Return to Support

Who is online

Users browsing this forum: No registered users and 86 guests