blog documentation FAQ followers forum marketplace services youtube

Admins Need to upload files of up to 250mb

The Jamroom Network » Forum » Installation and Configuration » Page » Admins Need to upload files of up to 250mb
MAD
MAD
@madc
10 years ago
600 posts
Jamroom doesn't allow this?
I have set up a php.ini file in my webroot and added
memory_limit = 1300M
post_max_size = 1300M
upload_max_filesize = 1300M
Just in case as i read in the docs it has to be at least a quarter of the size.
Our main php.ini file is set to 600mb. But we cant upload anything bigger than 32mb
How do I fix this in JR?



--
~ https://punkbandpromotions.com ~
Check us out for all your Punk/Alternative Music!
Check us out on Facebook:- https://facebook.com/PunkBandPromotion
updated by @madc: 05/23/14 05:42:20AM
MAD
MAD
@madc
10 years ago
600 posts
Is there any reason why an Admin can't do what he wants? Like upload anything...After all it is his server?
We only need admins to be able to add larger files...But in the quota config it says 64MB - Max Allowed.
Thats not ok for an admin...he should have full reign.
How do we fix.

ps. Looked at this and our php.ini file is set to min 500mb and it still won't work
https://www.jamroom.net/brian/documentation/guides/1206/configuring-and-optimizing-php-5


--
~ https://punkbandpromotions.com ~
Check us out for all your Punk/Alternative Music!
Check us out on Facebook:- https://facebook.com/PunkBandPromotion
updated by @madc: 03/30/14 06:53:59AM
brian
@brian
10 years ago
10,148 posts
uploads are always limited by the PHP settings - Jamroom does not know "it's your server" ;)

If you are set to 500mb, and you are still seeing a max upload size of 64mb, then something is not right. Make sure you:

- verify the 3 options in your php.ini file: upload_max_filesize, post_max_size and memory_limit - ALL OF THEM must be set to 512M (or 500M). Make sure you are modifying the correct php.ini as well - if you are on Ubuntu it will be /etc/php5/apache2/php.ini

- After you have made the changes, you need to restart the web server for the changes to take effect

- After that, you need to run an integrity check so JR will "see" the new max size available

- After the integrity check, you need to go Core -> Quota Settings and select the NEW max allowed file size you want.

I've done this many, many times and it works - so make sure you've done it like I've outlined.

Hope this helps!


--
Brian Johnson
Founder and Lead Developer - Jamroom
https://www.jamroom.net
MAD
MAD
@madc
10 years ago
600 posts
Thanks @brian!

That worked after 3 tries.
The edits weren't sticking for some reason. ( stoopid webmin )
Seems the memory limit was stuck at 256mb. I did an upload of the php.ini file and it stuck.

I read the util.php and saw all the different conversions and was wondering why ours was still showing 64 max.
Anyway all good now.

I had some concern as we host two large sites on two different accounts/ip's on our dedicated server .
I was making sure the other site had control over the uploads in it's code.
It does so it was safe to do it server wide.
Thanks again mate. I will get onto that email you sent me shortly.
Trying to tie up loose ends here. After that I will submit all the info you need :)


--
~ https://punkbandpromotions.com ~
Check us out for all your Punk/Alternative Music!
Check us out on Facebook:- https://facebook.com/PunkBandPromotion
brian
@brian
10 years ago
10,148 posts
Right on - glad to hear that worked!

And feel free to email me if you have any questions about my email.

Thanks!


--
Brian Johnson
Founder and Lead Developer - Jamroom
https://www.jamroom.net
MAD
MAD
@madc
10 years ago
600 posts
Just a heads up @brian,
We set ours to allow 320mb ( set at 1280 in php.ini ) but still couldn't upload anything over 180mb ( all three settings were set to 1280mb ) even changed input time to 7200.

We have some podcasts that wouldn't go up as they were 230mb+ so we reconverted them to a lower bitrate ( under 180mb in size ) then they went. There is one which only came down to 236mb which we still can't get up. I have set the upload size to 2560 now with a setting of 640 max in quota.

Still no good. Any ideas?


--
~ https://punkbandpromotions.com ~
Check us out for all your Punk/Alternative Music!
Check us out on Facebook:- https://facebook.com/PunkBandPromotion
brian
@brian
10 years ago
10,148 posts
Are you seeing any errors in your php error log?

Thanks!


--
Brian Johnson
Founder and Lead Developer - Jamroom
https://www.jamroom.net
MAD
MAD
@madc
10 years ago
600 posts
No none. Thats why it's strange.
Anything over 180mb upload just comes back with Upload Failed after upload


--
~ https://punkbandpromotions.com ~
Check us out for all your Punk/Alternative Music!
Check us out on Facebook:- https://facebook.com/PunkBandPromotion
michael
@michael
10 years ago
7,715 posts
Guesses:
* does the machine have as much memory available as the limits you are setting php.ini to?
* is there enough drive space to write the files.
* are there any timeout limits enforced by the server as to how long things are allowed to take
* does the same thing happen when uploading from other locations? (thinking internet connection flaking out)
* same from all browsers?
MAD
MAD
@madc
10 years ago
600 posts
4gb real mem available - used 684.32mb
4gb Virtual available 239.75 used
home partition drive 676.43gb total , used 239.78 gb
Resource Limits max_execution_time 600
Resource Limits max_input_time 7200
Uploader ( BA9801 ) has a 20/20 line. Ping and tracert all fine
Browser is google chrome on Mac Maverick
Testing other browsers now
Seems we can upload files up to 181mb no problem.
Anything larger the upload fails. Tried with a few larger files


--
~ https://punkbandpromotions.com ~
Check us out for all your Punk/Alternative Music!
Check us out on Facebook:- https://facebook.com/PunkBandPromotion
MAD
MAD
@madc
10 years ago
600 posts
Browsers same


--
~ https://punkbandpromotions.com ~
Check us out for all your Punk/Alternative Music!
Check us out on Facebook:- https://facebook.com/PunkBandPromotion
brian
@brian
10 years ago
10,148 posts
Can you contact me at brian [at] jamroom [dot] net with a link to your largest file you are trying to upload so I can download it? I can try setting up here and see if I can replicate it (the largest MP3 file I have here for testing is ~90mb)

Thanks!


--
Brian Johnson
Founder and Lead Developer - Jamroom
https://www.jamroom.net
brian
@brian
10 years ago
10,148 posts
I just tested a 238mb MP3 file here and had no problems - uploaded and converted correctly (conversion took 612 seconds). This is with all PHP settings set to 2048M resulting in a 512M upload size.


--
Brian Johnson
Founder and Lead Developer - Jamroom
https://www.jamroom.net
MAD
MAD
@madc
10 years ago
600 posts
we are adding three we had problems with
your logins are still all valid btw @brian ( ftp, site and cPanel etc ) if you need to look further.
We can't work out what the problem is.
http://www.punkbandpromotions.com/223.mp3
http://www.punkbandpromotions.com/263.mp3
http://www.punkbandpromotions.com/264.mp3
263 and 264 added as soon as we reconverted to a smaller size at 128kbps of less then 181mb but these are all the originals above.


--
~ https://punkbandpromotions.com ~
Check us out for all your Punk/Alternative Music!
Check us out on Facebook:- https://facebook.com/PunkBandPromotion
michael
@michael
10 years ago
7,715 posts
These are the errors I see when trying to upload to your server:
Quote: "NetworkError: 500 Internal Server Error - https://www.punkbandpromotions.com/core/upload_file/?upload_name=audio_file&field_name=pm_audio_file&token=fa1349028035ec51a727970ed6159d00&upload_token=01949f7b79228fbf8d226a122568b1cb&extensions=aac%2Cflac%2Cm4a%2Cmp3%2Cogg%2Cwav%2Cwma&multiple=false&pm_audio_file=223.mp3"

and as an ajax response:
Quote: "Could not save uploaded file - upload was cancelled or server error encountered"

Looking into why that happens, it seams to happen when the file is trying to be saved.
Tried to replicate the malfunction on my server, but it doesn't fail. I cant try bigger because my server doesn't have that much resources.

Best guess is a permissions problem, but that doesnt really fit because smaller files can be uploaded. Next best guess is out of diskspace, but that doesnt really fit because other files can be uploaded.
MAD
MAD
@madc
10 years ago
600 posts
not sure if this helps
[16-Apr-2014 23:37:26 America/New_York] PHP Fatal error:  Uncaught exception 'Exception' with message 'Getting content length is not supported.' in /home/punkbp/public_html/modules/jrCore-release-5.1.37/contrib/meter/server.php:39
Stack trace:
#0 /home/punkbp/public_html/modules/jrCore-release-5.1.37/contrib/meter/server.php(131): qqUploadedFileXhr->getSize()
#1 /home/punkbp/public_html/modules/jrCore-release-5.1.37/index.php(5201): qqFileUploader->handleUpload('/home/punkbp/pu...')
#2 /home/punkbp/public_html/modules/jrCore-release-5.1.37/lib/module.php(110): view_jrCore_upload_file(Array, Array, Array)
#3 /home/punkbp/public_html/modules/jrCore-release-5.1.37/router.php(168): jrCore_run_module_view_function('view_jrCore_upl...')
#4 {main}
  thrown in /home/punkbp/public_html/modules/jrCore-release-5.1.37/contrib/meter/server.php on line 39



--
~ https://punkbandpromotions.com ~
Check us out for all your Punk/Alternative Music!
Check us out on Facebook:- https://facebook.com/PunkBandPromotion
brian
@brian
10 years ago
10,148 posts
This points to a web server issue:

PHP Fatal error: Uncaught exception 'Exception' with message 'Getting content length is not supported.'

I assume you're running Apache? What this error means is the CONTENT_LENGTH server variable is not present, which causes an error.


--
Brian Johnson
Founder and Lead Developer - Jamroom
https://www.jamroom.net
brian
@brian
10 years ago
10,148 posts
Are you running any Apache rlimits on your server?


--
Brian Johnson
Founder and Lead Developer - Jamroom
https://www.jamroom.net
MAD
MAD
@madc
10 years ago
600 posts
No Everything is set way higher than anything Jamroom could throw at it as we have been using the same dedi for years with much more demand.
I will look tomorrow if anything is out of place but I doubt it.


--
~ https://punkbandpromotions.com ~
Check us out for all your Punk/Alternative Music!
Check us out on Facebook:- https://facebook.com/PunkBandPromotion
updated by @madc: 04/17/14 10:04:12AM
brian
@brian
10 years ago
10,148 posts
MAD©:
No Everything is set way higher than anything Jamroom could throw at it as we have been using the same dedi for years with much more demand.
I will look tomorrow if anything is out of place but I doubt it.

Then it really should work - the Fatal error that came through is actually an Apache issue - it did not add the CONTENT_LENGTH variable as would be needed for the upload to work. This makes me thing the Apache process is bombing out for some reason (ulimits, apache rlimits, lack of tmp disk space, etc.) - if you can, check your Apache error_log and see if you see any issues around the upload.

Hope this helps!


--
Brian Johnson
Founder and Lead Developer - Jamroom
https://www.jamroom.net
MAD
MAD
@madc
10 years ago
600 posts
Yeah we cleared the log today after 2 years (279mb) to test.
Brandon tried again and it threw no error.
That error was only in the jr logs.
Thats what is confusing?
You'd think it would come up as a server error.
@michael tried today but no server error showed in any logs
EDIT: It is obviously something on our end as we have full control.
Just wondering what is set that is causing the issue.
we can and always have been able to upload podcasts before. Only difference is your conversion.
They are already converted as we need them the smallest file size as we have a lot of them.
just wondering why anything under 181mb ( mac maverick stats ) goes up but anything larger is screwed
We have set everything right .
@michael tested today and he confirmed the 640mb limit in acp and the profile


--
~ https://punkbandpromotions.com ~
Check us out for all your Punk/Alternative Music!
Check us out on Facebook:- https://facebook.com/PunkBandPromotion
updated by @madc: 04/17/14 10:27:09AM
brian
@brian
10 years ago
10,148 posts
As long as the uploaded file is equal (or less) in bitrate to what is set in the Audio conversion config, the file is not converted - i.e. if your conversion settings are set for 128K, and the MP3 is 128K or less, it is not converted.

Unfortunately I really don't know what the issue might be beyond some type of limit being placed on the web server. One thing it could be is max input time - how long does it take for your file to upload before it fails?

Thanks!


--
Brian Johnson
Founder and Lead Developer - Jamroom
https://www.jamroom.net
michael
@michael
10 years ago
7,715 posts
brian:
One thing it could be is max input time - how long does it take for your file to upload before it fails?

I uploaded from here, so it was quick. about 15 sec to get up. It got to 100% and I expected it to work.

Pretty sure the issue is happening when the temp file is trying to be copied to its new location. Know of any limits placed on copying files?

The response is coming from server.php in the handleUpload() function right after not being able to go into:
if ($this->file->save($fname)) {
//didnt get into here....
}
//so this fires
return array('error'=> 'Could not save uploaded file - upload was cancelled or server error encountered');

and the ajax comes back 500 error.
brian
@brian
10 years ago
10,148 posts
Yeah - that's why I mentioned ulimit's on the server, or some other systme in Apache that is preventing the file from making it to where it needs to go.


--
Brian Johnson
Founder and Lead Developer - Jamroom
https://www.jamroom.net
MAD
MAD
@madc
10 years ago
600 posts
So what would be a max-input time that would work?
Still not working.
Although @michael uploaded within 15 secs a 280mb file. So I can't see that being it.
What else should I look for?


--
~ https://punkbandpromotions.com ~
Check us out for all your Punk/Alternative Music!
Check us out on Facebook:- https://facebook.com/PunkBandPromotion
updated by @madc: 04/20/14 07:34:46AM
brian
@brian
10 years ago
10,148 posts
MAD©:
So what would be a max-input time that would work?
Still not working.
Although @michael uploaded within 15 secs a 280mb file. So I can't see that being it.
What else should I look for?

How long does your upload run before it fails?


--
Brian Johnson
Founder and Lead Developer - Jamroom
https://www.jamroom.net
MAD
MAD
@madc
10 years ago
600 posts
As soon as it uploads it shows "UPLOAD FAILED"
Just stops dead
and thats it


--
~ https://punkbandpromotions.com ~
Check us out for all your Punk/Alternative Music!
Check us out on Facebook:- https://facebook.com/PunkBandPromotion
updated by @madc: 04/20/14 08:00:28AM
brian
@brian
10 years ago
10,148 posts
MAD©:
As soon as it uploads it shows "UPLOAD FAILED"
Just stops dead
and thats it
So before the upload actually happens? I.e. as soon as you press the "submit" button you see a failure? Or do you mean you see the upload percentage increase as the file is uploaded, and then it fails at the end?

Thanks!


--
Brian Johnson
Founder and Lead Developer - Jamroom
https://www.jamroom.net
MAD
MAD
@madc
10 years ago
600 posts
Yeah, It uploads the whole lot and as soon as the meter ( UPLOAD PERCENTAGE ) shows the lot is up it shows UPLOAD FAILED in the form designer


--
~ https://punkbandpromotions.com ~
Check us out for all your Punk/Alternative Music!
Check us out on Facebook:- https://facebook.com/PunkBandPromotion
updated by @madc: 04/20/14 08:09:49AM
brian
@brian
10 years ago
10,148 posts
MAD©:
Yeah, It uploads the whole lot and as soon as the meter ( UPLOAD PERCENTAGE ) shows the lot is up it shows UPLOAD FAILED in the form designer

Sorry for so many questions, but you say it shows "UPLOAD FAILED" in the form designer? Do you mean on the upload form?

It it gets all the way to 100% then fails, that tells me there is an issue writing out the file from the tmp upload location (which is managed by PHP). Check your php.ini and check out the value of upload_tmp_dir - make sure it is pointing to the systems /tmp directory, or a directory that will have enough space to hold the file.

Hope this helps!


--
Brian Johnson
Founder and Lead Developer - Jamroom
https://www.jamroom.net
MAD
MAD
@madc
10 years ago
600 posts
Yeah sorry Upload form.
When you add a file it starts uploading
The percentage shows.
Once it hits 100% it returns the error UPLOAD FAILED right beside the upload
Anything over 181mb ( MAC so could be 176mb ) doesn't go
Anything under does

This is a snippet from my php.ini file.
It goes to default so should be good.
We have uploaded files over 30 gb before so I can't see this being the issue

;;;;;;;;;;;;;;;;
; File Uploads ;
;;;;;;;;;;;;;;;;

; Whether to allow HTTP file uploads.
file_uploads = On

; Temporary directory for HTTP uploaded files (will use system default if not
; specified).
;upload_tmp_dir =

; Maximum allowed size for uploaded files.
upload_max_filesize = 2560M



--
~ https://punkbandpromotions.com ~
Check us out for all your Punk/Alternative Music!
Check us out on Facebook:- https://facebook.com/PunkBandPromotion
brian
@brian
10 years ago
10,148 posts
I'm assuming you have not uploaded 30G files over PHP - oherwise I think you would see the same issue you are seeing here (uploads via http work completely different than FTP/SFTP/SCP).

Try specifying the upload_tmp_dir - i.e.

upload_tmp_dir = /tmp

restart the web server and see if that helps at all.

Unfortunately beyond that I really don't know why you're having an issue, nor do I know what to recommend.


--
Brian Johnson
Founder and Lead Developer - Jamroom
https://www.jamroom.net
MAD
MAD
@madc
10 years ago
600 posts
When we had the joomla site everything uploaded fine through php and max was set to 30gb in php.
Although we had uploads etc set to that max then as they didn't need to convert etc.
Since then we dropped the upload down to 600mb but since JR we put it back up to 2560 to cater for the podcasts.
I will try changing the directory and let you know


--
~ https://punkbandpromotions.com ~
Check us out for all your Punk/Alternative Music!
Check us out on Facebook:- https://facebook.com/PunkBandPromotion
brian
@brian
10 years ago
10,148 posts
MAD©:
When we had the joomla site everything uploaded fine through php and max was set to 30gb in php.
Although we had uploads etc set to that max then as they didn't need to convert etc.
Since then we dropped the upload down to 600mb but since JR we put it back up to 2560 to cater for the podcasts.
I will try changing the directory and let you know

There has to be something happening at your server level that is causing this - I'm not seeing any issues uploading up to 238mb here. What OS are you using, and what version of Apache and PHP? And what browser are you testing with?


--
Brian Johnson
Founder and Lead Developer - Jamroom
https://www.jamroom.net
updated by @brian: 04/20/14 09:41:32AM
brian
@brian
10 years ago
10,148 posts
Do you have a dev server you can replicate this on that I can get root access on? Or let me know your OS/Apache/PHP and I can try to replicate it here.

Thanks!


--
Brian Johnson
Founder and Lead Developer - Jamroom
https://www.jamroom.net
MAD
MAD
@madc
10 years ago
600 posts
All browsers have been tested and failed ( mac and pc )
We are using Centos 5.1
Apache 2.2.27
PHP 5.3.28
As I said ...It has to be at our end. Something our system doesn't like or isn't set properly

EDIT : No , no dev server but I could provide you with full access


--
~ https://punkbandpromotions.com ~
Check us out for all your Punk/Alternative Music!
Check us out on Facebook:- https://facebook.com/PunkBandPromotion
updated by @madc: 04/20/14 09:52:54AM
MAD
MAD
@madc
10 years ago
600 posts
Logins sent


--
~ https://punkbandpromotions.com ~
Check us out for all your Punk/Alternative Music!
Check us out on Facebook:- https://facebook.com/PunkBandPromotion

Tags