issue on csv format leads upload on vicidial 2.7rc

[asterguy]

Hi,

I installed the vicidial 2,7rc in a test environment. I also used the asterisk 1.8 version. However when I upload leads in csv format, i encounter an issue. Please see below.





If I go to the path /tmp, the file that I can see there is in csv format (vicidialtestleads2.csv).

I don't see an error when I upload a text file (tab delimited).


Regards,
Lui

[mflorell]

I can't duplicate on our test environment. Could you explain how you installed Vicidial exactly?

[asterguy]

Hi Matt,

I installed vicidial from scratch. By the way, i can't see any activity in the asterisk 1.8 cli whenever i login as agent.

- installed asterisk 1.8.3.3
- downloaded and installed vicidial 2.7rc
- created the database
- run the sql files to import data
- configured /etc/astguiclient.conf


Asterisk 1.8 CLI:
"
== Manager 'sendcron' logged on from 127.0.0.1
== Manager 'sendcron' logged off from 127.0.0.1
== Manager 'sendcron' logged on from 127.0.0.1
== Manager 'sendcron' logged on from 127.0.0.1
== Manager 'sendcron' logged off from 127.0.0.1
vicidial27rc*CLI>
"


my installation of vicidial:

#download and install vicidial
mkdir /usr/src/astguiclient
cd /usr/src/astguiclient
wget -O astguiclient_2.7rc1.zip http://sourceforge.net/projects/astguic ... p/download
unzip astguiclient_2.7rc1.zip
perl install.pl
#change webroot to /var/www
#choose yes for samples (y)
#change the password of cron
#change asterisk version 1.8

#download and copy the gsm file
cd /var/lib/asterisk/sounds
wget http://astguiclient.sf.net/conf.gsm
cp conf.gsm park.gsm

#create the database of vicidial and import some data
mysql -u root -p
CREATE DATABASE `asterisk` DEFAULT CHARACTER SET utf8 COLLATE utf8_unicode_ci;
GRANT SELECT,INSERT,UPDATE,DELETE,LOCK TABLES on asterisk.* TO cron@'%' IDENTIFIED BY '1234';
GRANT SELECT,INSERT,UPDATE,DELETE,LOCK TABLES on asterisk.* TO cron@localhost IDENTIFIED BY '1234';
GRANT RELOAD ON *.* TO cron@'%';
GRANT RELOAD ON *.* TO cron@localhost;

flush privileges;
SET GLOBAL connect_timeout=60;

use asterisk;

\. /usr/src/astguiclient/extras/MySQL_AST_CREATE_tables.sql
\. /usr/src/astguiclient/extras/sip-iax_phones.sql
\. /usr/src/astguiclient/extras/first_server_install.sql
quit

#import some data in your vicidial
/usr/share/astguiclient/ADMIN_area_code_populate.pl
cp /usr/src/astguiclient/extras/performance_test_leads.txt /usr/share/astguiclient/LEADS_IN/
/usr/share/astguiclient/VICIDIAL_IN_new_leads_file.pl --forcelistid=107 --forcephonecode=1



Regards,
Lui

[boybawang]

check if /tmp is writable and readable

[boybawang]

also make sure you have all perl modules installed, see REQUIRED_APPS.TXT under docs directory

[asterguy]

Hi Matt and Boybawang,

Yes! /tmp is writable.
drwxrwxrwt 4 root root 4096 Jun 4 15:24 tmp

All per modules found in REQUIRED_APPS_INSTALL.txt are installed.


By the way, I'm using Asterisk 1.4 + Vicidial 2.4 before from scratch install. I only installed Asterisk 1.8 + VIcidial 2.7rc1 to see what things changed. I can see alot of features been added which are really good.

Right now I'm facing 2 probs.

#1. csv upload produces an error
#2. any activity from the web doesn't reflect on asterisk 1.8.


Regards,
Lui

[asterguy]

Hi Matt and boybawang,

Thanks for your reply.

The "#2. any activity from the web doesn't reflect on asterisk 1.8." is working now. I didn't know that there is beta version of asterisk 1.8-vici available which can be found here http://downloads.vicidial.com/beta-apps ... eta.tar.gz. I thought that a normal installation of asterisk 1.8 will work.

As of the issue with the CSV upload, it is still not resolved.


Regards,
Lui

[boybawang]

actually the latest svn version of vicidial doesnt have a problem with uploading csv files, I only encountered an issue on their 2.6-36XX versions

[asterguy]

Hi boybawang and Matt,

I used the astguiclient of the SVN and i didnt encounter the csv problem.

To make things clear, the astguiclient source that I got from this link http://sourceforge.net/projects/astguic ... p/download has the errors.
The source that I got from this one "svn checkout svn://svn.eflo.net:3690/agc_2-X/trunk" doesn't have the errors.

Thanks for the replies..

Regards,
Lui

[asterguy]

Hi Again,

The issue is still there when uploading csv file. The only thing that changed is the error message above is gone.

issue:
when uploading csv file, the dropdown is only showing a quote "".

csv file:


vicidial list upload csv issue:



VERSION: 2.8-403a
BUILD: 130510-1350
© 2013 ViciDial Group


Regards,
Lui

[mflorell]

Can you show what your "csv" file looks like in a text editor? That is a screenshot from a spreadsheet, so it's pretty much useless for debugging purposes.

[boybawang]

I suggest you make that csv file downloadable so we can test it on our respective builds

[asterguy]

Hi Gurus,

Here is the file. https://docs.google.com/file/d/0B9WhIYL ... sp=sharing

Regards,
Lui

[adam.greenhalgh1]

Hi Aster,

When we upload leads into vicidial we have a program that we use. It is a 'built to suit' program which may only work for our system.
But the ethics are going to be similar.
I will explain our process to you.
1.Locate lead sheet.
2.Save in 'Ready To Convert into ; ' Folder.
3.Open up with 'OpenOffice'.
4.Whilst in OpenOffice, Hit 'Save as' and save it in .csv format in the 'Ready for preprocess' Folder.
5.Whilst saving the file you will be prompted to save with delimiters. Set the field delimiter to ; and the text delimiter leave it blank.
6.Now open up the preprocess leads app and type in the List_ID, then select your source file, then select where the outputted file will go to.
7. Open up the web interface of Vicidial and go to Lists>Load new Leads. And then just follow steps on the interface.

Try building a 'pre-process leads app' in VB. This way if the app gives you an error message you find out before you do all your formatting Also the app does the formatting for you .

HTH -

Adam.

[rrb555]

i suggest u save the file as text tab delimited never had any problem with that file format,,

[striker]

check the following link for the sample lead i use to upload

http://www.mediafire.com/?631o8xv8mc4pkc5

you can use the same format to upload leads in the vicidial
if you have old vicidal version then you need to save the file in CSV or tab-delimated format
click the save as option from the file and select CSV or Tab - delimated format.

[DomeDan]

Back to the problem.

asterguy:
Nice that you provided us with a file to test with, I did that and found something...

You did not mention the install method, I bet you didn't use a vicibox cd.

I'm pretty sure you are missing some perl modules, like these two:
Spreadsheet::Read
Text::CSV

I tried to load the file on my workstation where I got a vicidial install I can test stuff with, this is a debian OS.
Got the exact problem you had, the reason it looks for a .txt-file is that sheet2tab.pl converts the file and the new file created always gets the .txt extension
but it fails to find that file because sheet2tab.pl fails when there is perl modules missing,
its all in the error_log. Always look in the log folks!

...
Can't locate Spreadsheet/Read.pm in @INC (@INC contains: /etc/perl /usr/local/lib/perl/5.10.1 /usr/local/share/perl/5.10.1 /usr/lib/perl5 /usr/share/perl5 /usr/lib/perl/5.10 /usr/share/perl/5.10 /usr/local/lib/site_perl .) at /var/www/vicidial/sheet2tab.pl line 36.
BEGIN failed--compilation aborted at /var/www/vicidial/sheet2tab.pl line 36
...
#installed Spreadsheet::Read
...
CSV parser not installed at /var/www/vicidial/sheet2tab.pl line 253
...
#installed Text::CSV

[asterguy]

i suggest u save the file as text tab delimited never had any problem with that file format,,

Hi rrb555,

It works fine with text tab delimited file (.txt). I mentioned it above.


Regards,
Lui

[asterguy]

Back to the problem.

asterguy:
Nice that you provided us with a file to test with, I did that and found something...

You did not mention the install method, I bet you didn't use a vicibox cd.

I'm pretty sure you are missing some perl modules, like these two:
Spreadsheet::Read
Text::CSV

I tried to load the file on my workstation where I got a vicidial install I can test stuff with, this is a debian OS.
Got the exact problem you had, the reason it looks for a .txt-file is that sheet2tab.pl converts the file and the new file created always gets the .txt extension
but it fails to find that file because sheet2tab.pl fails when there is perl modules missing,
its all in the error_log. Always look in the log folks!

...
Can't locate Spreadsheet/Read.pm in @INC (@INC contains: /etc/perl /usr/local/lib/perl/5.10.1 /usr/local/share/perl/5.10.1 /usr/lib/perl5 /usr/share/perl5 /usr/lib/perl/5.10 /usr/share/perl/5.10 /usr/local/lib/site_perl .) at /var/www/vicidial/sheet2tab.pl line 36.
BEGIN failed--compilation aborted at /var/www/vicidial/sheet2tab.pl line 36
...
#installed Spreadsheet::Read
...
CSV parser not installed at /var/www/vicidial/sheet2tab.pl line 253
...
#installed Text::CSV

hi DomeDan,

You are right! I missed the 2 perl modules. The perl modules that I installed are for the older version of the vicidial. I got a mistake on checking my docs.

Everything is working fine now.

I'm using the scratch install. My OS is debian and i'm running the test in Vmware.


Thanks,
Lui

[cbsys]

I have exactly the same problem!

VERSION: 2.7-401a
BUILD: 130508-2256

I have installed these perl modules
Spreadsheet::Read
Text::CSV

However I cannot upload a csv file, the field mapping just shows "" on the drop down list
I CAN upload a tab delimited txt file though, that works ok!
also, if I change my csv file to a txt file and use pipe delimiters rather than commas, it DOES work!

[williamconley]

I have exactly the same problem!

VERSION: 2.7-401a
BUILD: 130508-2256

I have installed these perl modules
Spreadsheet::Read
Text::CSV

However I cannot upload a csv file, the field mapping just shows "" on the drop down list
I CAN upload a tab delimited txt file though, that works ok!
also, if I change my csv file to a txt file and use pipe delimiters rather than commas, it DOES work!

did you try this same file on an earlier version of vicidial? it's entirely possible there is merely an irregularity with the file that is removed when you save in a different format.

[cbsys]

The same file works perfectly on version 2.4-309a build 110430-1642
I never have any issues uploading as csv on that version!

[williamconley]

please verify that it's the exact same file (not a re-saved version ... or one xls and one csv ... not even a 'copy') and then check the versions of the CPAN module that are used and see if there is a difference. Perhaps a downgrade of a cpan module will repair the problem. And let us know if you find it! (OK, Let Kumba know! That's the important bit ...).

[necival]

VERSION: 2.8-408a
BUILD: 130711-2208

I'm having the same problem with loading any file besides Tab Delimited Txt ... but can you point me in the right direction on how to install those missing Perl modules?

Spreadsheet::Read
Text::CSV

I'm not that familiar with Perl management.

Thank you!

Code: Select all

Attempt to reload Spreadsheet/XLSX.pm aborted.
Compilation failed in require at /srv/www/htdocs/vicidial/sheet2tab.pl line 38.
BEGIN failed--compilation aborted at /srv/www/htdocs/vicidial/sheet2tab.pl line 38.
[Wed Aug 14 12:27:32 2013] [error] [client 23.24.163.220] PHP Warning:  fopen(/tmp/testlist.txt): failed to open stream: No such file or directory in /srv/www/htdocs/vicidial/admin_listloader_fourth_gen.php on line 2088, referer: http://IPADDRESS/vicidial/admin_listloader_fourth_gen.php
[Wed Aug 14 12:27:32 2013] [error] [client 23.24.163.220] PHP Warning:  fgets() expects parameter 1 to be resource, boolean given in /srv/www/htdocs/vicidial/admin_listloader_fourth_gen.php on line 2092, referer: http://IPADDRESS/vicidial/admin_listloader_fourth_gen.php
[Wed Aug 14 12:27:32 2013] [error] [client 23.24.163.220] PHP Warning:  fopen(/tmp/testlist.txt): failed to open stream: No such file or directory in /srv/www/htdocs/vicidial/admin_listloader_fourth_gen.php on line 2110, referer: http://IPADDRESS/vicidial/admin_listloader_fourth_gen.php
[Wed Aug 14 12:27:32 2013] [error] [client 23.24.163.220] PHP Warning:  fgets() expects parameter 1 to be resource, boolean given in /srv/www/htdocs/vicidial/admin_listloader_fourth_gen.php on line 2121, referer: http://IPADDRESS/vicidial/admin_listloader_fourth_gen.php


[necival]

It looks like I have the modules, but some reason they aren't being loaded. I think I'll be able to take it from here... google is my friend.

Code: Select all

/usr/lib/perl5/vendor_perl/5.12.1/Spreadsheet
/usr/lib/perl5/vendor_perl/5.12.1/Spreadsheet/ParseExcel
/usr/lib/perl5/vendor_perl/5.12.1/Spreadsheet/ParseExcel.pm
/usr/lib/perl5/vendor_perl/5.12.1/Spreadsheet/ParseExcel/Cell.pm
/usr/lib/perl5/vendor_perl/5.12.1/Spreadsheet/ParseExcel/Dump.pm
/usr/lib/perl5/vendor_perl/5.12.1/Spreadsheet/ParseExcel/FmtDefault.pm
/usr/lib/perl5/vendor_perl/5.12.1/Spreadsheet/ParseExcel/FmtJapan.pm
/usr/lib/perl5/vendor_perl/5.12.1/Spreadsheet/ParseExcel/FmtJapan2.pm
/usr/lib/perl5/vendor_perl/5.12.1/Spreadsheet/ParseExcel/FmtUnicode.pm
/usr/lib/perl5/vendor_perl/5.12.1/Spreadsheet/ParseExcel/Font.pm
/usr/lib/perl5/vendor_perl/5.12.1/Spreadsheet/ParseExcel/Format.pm
/usr/lib/perl5/vendor_perl/5.12.1/Spreadsheet/ParseExcel/SaveParser
/usr/lib/perl5/vendor_perl/5.12.1/Spreadsheet/ParseExcel/SaveParser.pm
/usr/lib/perl5/vendor_perl/5.12.1/Spreadsheet/ParseExcel/SaveParser/Workbook.pm
/usr/lib/perl5/vendor_perl/5.12.1/Spreadsheet/ParseExcel/SaveParser/Worksheet.pm
/usr/lib/perl5/vendor_perl/5.12.1/Spreadsheet/ParseExcel/Utility.pm
/usr/lib/perl5/vendor_perl/5.12.1/Spreadsheet/ParseExcel/Workbook.pm
/usr/lib/perl5/vendor_perl/5.12.1/Spreadsheet/ParseExcel/Worksheet.pm
/usr/lib/perl5/vendor_perl/5.12.1/Spreadsheet/Read.pm
/usr/lib/perl5/vendor_perl/5.12.1/Spreadsheet/ReadSXC.pm
/usr/lib/perl5/vendor_perl/5.12.1/Spreadsheet/WriteExcel
/usr/lib/perl5/vendor_perl/5.12.1/Spreadsheet/WriteExcel.pm
/usr/lib/perl5/vendor_perl/5.12.1/Spreadsheet/WriteExcel/BIFFwriter.pm
/usr/lib/perl5/vendor_perl/5.12.1/Spreadsheet/WriteExcel/Big.pm
/usr/lib/perl5/vendor_perl/5.12.1/Spreadsheet/WriteExcel/Chart
/usr/lib/perl5/vendor_perl/5.12.1/Spreadsheet/WriteExcel/Chart.pm
/usr/lib/perl5/vendor_perl/5.12.1/Spreadsheet/WriteExcel/Chart/Area.pm
/usr/lib/perl5/vendor_perl/5.12.1/Spreadsheet/WriteExcel/Chart/Bar.pm
/usr/lib/perl5/vendor_perl/5.12.1/Spreadsheet/WriteExcel/Chart/Column.pm
/usr/lib/perl5/vendor_perl/5.12.1/Spreadsheet/WriteExcel/Chart/External.pm
/usr/lib/perl5/vendor_perl/5.12.1/Spreadsheet/WriteExcel/Chart/Line.pm
/usr/lib/perl5/vendor_perl/5.12.1/Spreadsheet/WriteExcel/Chart/Pie.pm
/usr/lib/perl5/vendor_perl/5.12.1/Spreadsheet/WriteExcel/Chart/Scatter.pm
/usr/lib/perl5/vendor_perl/5.12.1/Spreadsheet/WriteExcel/Chart/Stock.pm
/usr/lib/perl5/vendor_perl/5.12.1/Spreadsheet/WriteExcel/Examples.pm
/usr/lib/perl5/vendor_perl/5.12.1/Spreadsheet/WriteExcel/Format.pm
/usr/lib/perl5/vendor_perl/5.12.1/Spreadsheet/WriteExcel/Formula.pm
/usr/lib/perl5/vendor_perl/5.12.1/Spreadsheet/WriteExcel/OLEwriter.pm
/usr/lib/perl5/vendor_perl/5.12.1/Spreadsheet/WriteExcel/Properties.pm
/usr/lib/perl5/vendor_perl/5.12.1/Spreadsheet/WriteExcel/Simple.pm
/usr/lib/perl5/vendor_perl/5.12.1/Spreadsheet/WriteExcel/Utility.pm
/usr/lib/perl5/vendor_perl/5.12.1/Spreadsheet/WriteExcel/Workbook.pm
/usr/lib/perl5/vendor_perl/5.12.1/Spreadsheet/WriteExcel/Worksheet.pm
/usr/lib/perl5/vendor_perl/5.12.1/Spreadsheet/XLSX
/usr/lib/perl5/vendor_perl/5.12.1/Spreadsheet/XLSX.pm


[necival]

Resolved the issue by reinstalling the zypper packages:

Code: Select all

zypper -n install perl-Jcode.noarch perl-Spreadsheet-ReadSXC.noarch perl-Spreadsheet-XLSX.noarch perl-Switch.noarch perl-Unicode-MapUTF8.noarch php5-eaccelerator.noarch

zypper -n install perl-Jcode-2.07-7.1.x86_64 perl-Spreadsheet-ReadSXC-0.20-7.1.noarch perl-Spreadsheet-XLSX-0.13-7.1.noarch perl-Unicode-MapUTF8-1.11-8.1.x86_64 php5-eaccelerator-0.9.6.1-10.1.x86_64

/etc/init.d/apache2 restart


[DomeDan]

Well done and good postback!

[jjohnson78]

Hello,

I found what I think is the problem here, if anyone's interested at this point.

For some reason, when you install the Spreadsheet::XLSX module, a folder that comes with the install only has read privileges (plus write for the owner only). This folder contains two scripts that the module is trying to execute, so when the sheet2tab.pl runs as "nobody" (which it does, coming from the web page), it can't execute the scripts and spits out the fail message. If you switch the privileges on that folder to include executable privileges, it should work.

On our server the folder was:

/usr/lib/perl5/vendor_perl/5.12.1/Spreadsheet/XLSX

So a chmod to 755 on that folder fixed the issue.

[williamconley]

Are you saying this is a bug in the Vicibox installer ... or in a manual installation instruction set that no one has actually listed? LOL

Moving to support, since it's not a General Question.

If it's a bug in the installer, we can move it to the Vicibox board so Kumba can make a note to modify that folder at the next release.

[jjohnson78]

CPAN seems to have installed it that way, which is kind of odd.

[williamconley]

CPAN seems to have installed it that way, which is kind of odd.

Right. I got that. But CPAN during a scratch install, or during a Vicibox install?

[jjohnson78]

Honestly not sure - this was on a Vicidial development server, so I assume that it was put on as part of developing Vicidial and therefore outside of a Vicibox install.

[williamconley]

how about this ... when you log on to it with ssh, is there a vicibox version notice as the splash welcome in ssh?

[mav2287]

I know this is an old thread but I was dealing with this tonight on a scratch install. Thee issue was the scratch install sheet was rather old. The fix for me was to just install the following in the order I have them listed below.

Spreadsheet::Read
Text::CSV
Spreadsheet::XLSX

[williamconley]

I know this is an old thread but I was dealing with this tonight on a scratch install. Thee issue was the scratch install sheet was rather old. The fix for me was to just install the following in the order I have them listed below.

Spreadsheet::Read
Text::CSV
Spreadsheet::XLSX

Good post back. You should post a link to "the scratch install sheet" in question (which may bring others to this solution ...).