InfoUSA CSV lead format, and glue for VTiger CRM

[jwhawkins]

Does anyone here use InfoUSA for their leads? I have a client who uses them almost exclusively, and the leads that they get in CSV have a quadrillion useless fields, and it takes forever for them to load leads a thousand at a time since they must use the Super List Loader (*g*) every time.

Rather than reinventing the wheel, has anyone written anything to massage CSV formats on the fly as a fixed order, rather than one-at-a-time? If not, then I might write something and post it.

Also, has anyone had experience using the recent release of VTiger CRM with VICIDIAL? The same client is wanting a CRM solution that can be integrated with VICIDIAL, and I'm drawn to VTiger knowing that there's at least rudimentary glue written.

Any comments are appreciated - now that they're up and running fine, it's time to break it all! >=)

[mflorell]

Do they get many small files of leads?

Can you post some dummy records so that we can see what the format looks like?

As for a batch loader, you may want to take a look at the VICIDIAL_IN_new_leads_file.pl script since it will load several files at once, although it expects to see them all in the standard VICIDIAL pipe-delimited format.

[jwhawkins]

This is the list of the columns in the CSV files they get from InfoUSA.
Date List Produced
Record Obsolescence
Date
Source
First Name
Last Name
Adult Gender
Street Address
City
State
ZIP Code
Phone Number
County
MSA
Carrier Route
Delivery Point
Income
Home Value
MailOrder-Golf
MailOrder-Pet Owner
MailOrder-Personal Computers
MailOrder-Electronics Products
MailOrder-Health&Excercise
MailOrder-Crafts&Sewing
MailOrder-Books&Music
MailOrder-Investments/Finance
MailOrder-Outdoor Recreation
MailOrder-Entertainment&Travel
MailOrder-Sweepstakes&Gambling
MailOrder-Photographic Equipment
MailOrder-Stamps&Coins
MailOrder-Sport Cards&Collectibles
MailOrder-Magazines MailOrder-Apparel
MailOrder-Children Items
Mail Order Indicator
Cat Owner Dog Owner
High Tech Household
MortgageLoan
Type

[jwhawkins]

Ideas? Someone? =)

[mike]

Clean your leads and reformat them in excel or any other utility on your local pc. Then use Navicat to load them.

[jwhawkins]

Would you care to do that to 120,000 leads at a time?

[Op3r]

select each header? hahahahaha

errr I know someone who made a script to stripped the unnecessary fields on the csv file and he called it leads scrubber.

ill try to social engineer him to showing it to me