Page 1 of 1

Bulk list load with custom fields

PostPosted: Tue Nov 11, 2014 10:40 pm
by Acidshock
Ok got something new I am trying to do. I have a affiliate system that I am creating. This system is going to be amassing leads from affiliates who upload their own lists. I will then import those leads into VICI. Problem is that there are custom fields(Always the same.) All the list creation I figured I could do via the api or simple DB calls. The only thing I didn't want to touch is loading the leads into the DB myself as the list loaders do their job really well. Problem I have is this... If I get a large list from an affiliate, say 100k records.... I don't want to be making 100k worth of api calls to add each lead one at a time. Has anyone crossed this bridge in the past and have anything to recommend? I looked into the Perl bulk lead loading scripts but they don't handle custom fields :(

Re: Bulk list load with custom fields

PostPosted: Sun Mar 15, 2015 1:10 pm
by williamconley
Preprocess your accepted list from the affiliate generator ...

1) Verify that all lists involved have the custom tables already created
2) Bulk load all the standard fields (nothing in custom)
3) Manually enter the data directly via mysql into the custom tables.

Note that the bulk loader avoids custom tables, but it does manage everything else nicely. This will get "everything else" handled properly and still gets your data into the custom tables.