List Export Limits

All installation and configuration problems and questions

Moderators: gerski, enjay, williamconley, Op3r, Staydog, gardo, mflorell, MJCoate, mcargile, Kumba, Michael_N

List Export Limits

Postby slider » Fri Apr 15, 2011 10:34 am

Hello.

Issue: I'm unable to export a list.

Steps:

Click on Lists -> Show Lists -> Click on List ID -> Scroll to Bottom -> Click on 'Click here to download this list'

Observations:

Smaller lists work. They download as a txt file and I can view them just fine. Larger list (this one has 229,441 records) do not. It saves a 0KB text file.

Question:

I'm curious to know if you know what this maximum list size is for download and if there is a work around in the web interface.

Assumption:

I'm assuming as a temporary fix I'll just get it from the database but my goal is to have something in the web interface so our managers can download data. Thanks everyone.

-----VERSION INFO-----

VERSION: 2.4-296
BUILD: 110111-1305
LoadAvg: 0.08
Agents: 10-20

Single Server (Database/Web/Vici)
Dell R710, 8 Cores, 8GB Memory
Sagoma USB Voice Timer / g711 to carrier

Linux vicibox-2 2.6.34.7-0.7-default #1 SMP 2010-12-13 11:13:53 +0100 x86_64 x86_64 x86_64 GNU/Linux

Asterisk 1.4.27.1-vici built by root @ vicibox-2 on a x86_64 running Linux on 2011-01-25 16:09:16 UTC

*No Extra Software After Install, No VTiger. :shock: :shock:
slider
 
Posts: 42
Joined: Sun Jan 31, 2010 4:48 pm

Postby williamconley » Fri Apr 15, 2011 10:39 am

you are likely experiencing a timeout issue with your web server. increase your timeout settings or use phpmyadmin (which has the option of zipping during download, drastically reducing file size)
Vicidial Installation and Repair, plus Hosting and Colocation
Newest Product: Vicidial Agent Only Beep - Beta
http://www.PoundTeam.com # 352-269-0000 # +44(203) 769-2294
williamconley
 
Posts: 20256
Joined: Wed Oct 31, 2007 4:17 pm
Location: Davenport, FL (By Disney!)

Postby slider » Fri Apr 15, 2011 10:50 am

thanks william. you mind letting me know which file has the web server settings?
slider
 
Posts: 42
Joined: Sun Jan 31, 2010 4:48 pm

Postby mflorell » Fri Apr 15, 2011 12:25 pm

php.ini
mflorell
Site Admin
 
Posts: 18384
Joined: Wed Jun 07, 2006 2:45 pm
Location: Florida

Postby boybawang » Fri Apr 15, 2011 12:35 pm

php.ini look for file_uploads something, the value is in MB
Vicidial Installation + Configuration + Support + Custom Development
Download my ebook on installing vicidial for free http://download.vicidial.com/ubuntu/VIC ... 100331.pdf
skype: deodax.cordova@gmail.com
m: +639172063730
boybawang
 
Posts: 989
Joined: Sat Nov 14, 2009 1:18 pm
Location: Dumaguete City, Negros Oriental, Philippines

Postby slider » Sat Apr 16, 2011 10:46 pm

I see this,

; Maximum amount of memory a script may consume (128MB)

But not much else, any thoughts?
avail for consulting on [asterisk|freeswitch|vicidial|datacenter|AS/BGP/ARIN|CCIE|marketing|legal]
slider
 
Posts: 42
Joined: Sun Jan 31, 2010 4:48 pm

Postby boybawang » Sun Apr 17, 2011 5:45 am

just leave it that to stock , its the file uploads that you want to change
Vicidial Installation + Configuration + Support + Custom Development
Download my ebook on installing vicidial for free http://download.vicidial.com/ubuntu/VIC ... 100331.pdf
skype: deodax.cordova@gmail.com
m: +639172063730
boybawang
 
Posts: 989
Joined: Sat Nov 14, 2009 1:18 pm
Location: Dumaguete City, Negros Oriental, Philippines

Postby mflorell » Sun Apr 17, 2011 7:56 am

You probably want to raise all of these:


max_execution_time = 30 ; Maximum execution time of each script, in seconds
max_input_time = 60 ; Maximum amount of time each script may spend parsing request data
memory_limit = 128M ; Maximum amount of memory a script may consume (128MB)
default_socket_timeout = 60
mflorell
Site Admin
 
Posts: 18384
Joined: Wed Jun 07, 2006 2:45 pm
Location: Florida

Postby slider » Mon Apr 18, 2011 2:26 pm

I decided not to modify anything to keep our config stock in case we need other support. Instead I'm simply starting with a new list. Thank you for your help. I'll assume the list export limit is around 200,000+ records.
avail for consulting on [asterisk|freeswitch|vicidial|datacenter|AS/BGP/ARIN|CCIE|marketing|legal]
slider
 
Posts: 42
Joined: Sun Jan 31, 2010 4:48 pm

Postby williamconley » Mon Apr 18, 2011 9:33 pm

When Matt says you can/should change it ... you should.

These changes will not make your system "non-stock" per se, they merely allow php to take more time with each page (handy for large uploads).

Also: many installs (such as Vicibox Web Only Install, if I recall) will change these during installation on a Stock box. So ...
Vicidial Installation and Repair, plus Hosting and Colocation
Newest Product: Vicidial Agent Only Beep - Beta
http://www.PoundTeam.com # 352-269-0000 # +44(203) 769-2294
williamconley
 
Posts: 20256
Joined: Wed Oct 31, 2007 4:17 pm
Location: Davenport, FL (By Disney!)

Re: List Export Limits

Postby infinitegary » Mon Sep 15, 2014 7:48 am

I too am having this same issue i have 1 list that i kept adding to over the last year and the size of the list has grown to just under 900k records.
I first tried to export via phpmy admin but got timeout error as well.
I then tried what matt suggested with the following............

max_execution_time = 30 ; Maximum execution time of each script, in seconds
max_input_time = 60 ; Maximum amount of time each script may spend parsing request data
memory_limit = 128M ; Maximum amount of memory a script may consume (128MB)
default_socket_timeout = 60

Heres what i changed my settings to.......

max_execution_time =3000 Maximum execution time of each script, in seconds
max_input_time = 30000 ; Maximum amount of time each script may spend parsing request data
memory_limit = 2000M ; Maximum amount of memory a script may consume (2000MB)
default_socket_timeout = 3000


After making these changes i do not see any results the download dont even act like its trying to think about taking longer to perform this task. The same reult happens i open the file it says it downloaded and its blank.

Any ideas what i may need to do?
infinitegary
 
Posts: 21
Joined: Tue Sep 09, 2014 9:41 am

Re: List Export Limits

Postby sdixit311 » Tue Oct 27, 2020 10:19 am

Hello Team , Hope you all are good

I have vicibox-express server 16GB RAM/1TB HDD / and Intel Xeon 12 Core processor

everything seems to be fine but I am facing an issue that I can't export a larger size file (like 100,000 records or more than this )

I have tried to change PhP.ini
max execution time and all

but still not happening

any suggestion will be really helpful
thanks in advance
sdixit311
 
Posts: 5
Joined: Tue Oct 27, 2020 5:31 am

Re: List Export Limits

Postby williamconley » Fri Oct 30, 2020 6:27 pm

1) Welcome to the Party! 8-)

2) As you are obviously new here, I have some suggestions to help us all help you:

When you post, please post your entire configuration including (but not limited to) your installation method (7.X.X?) and vicidial version with build (VERSION: 2.X-XXXx ... BUILD: #####-####).

This IS a requirement for posting along with reading the stickies (at the top of each forum) and the manager's manual (available on EFLO.net, both free and paid versions)

You should also post: Asterisk version, telephony hardware (model number is helpful here), cluster information if you have one, and whether any other software is installed in the box. If your installation method is "manual/from scratch" you must post your operating system with version (and the .iso version from which you installed your original operating system) plus a link to the installation instructions you used. If your installation is "Hosted" list the site name of the host.

If this is a "Cloud" or "Virtual" server, please note the technology involved along with the version of that techology (ie: VMware Server Version 2.0.2). If it is not, merely stating the Motherboard model # and CPU would be helpful.

Similar to This:

Vicibox X.X from .iso | Vicidial X.X.X-XXX Build XXXXXX-XXXX | Asterisk X.X.X | Single Server | No Digium/Sangoma Hardware | No Extra Software After Installation | Intel DG35EC | Core2Quad Q6600

3) The export utility scripts have 100k hard-coded limits. In addition to modifying php.ini to allow extra time and size, you must also modify that max results directly in the file. Look for "100000" in the file and you'll likely find it.
Vicidial Installation and Repair, plus Hosting and Colocation
Newest Product: Vicidial Agent Only Beep - Beta
http://www.PoundTeam.com # 352-269-0000 # +44(203) 769-2294
williamconley
 
Posts: 20256
Joined: Wed Oct 31, 2007 4:17 pm
Location: Davenport, FL (By Disney!)


Return to Support

Who is online

Users browsing this forum: Google [Bot] and 101 guests

cron