need specifics of how video uploads are handled to diagnose an issue

soaringeagle
@soaringeagle
9 years ago
3,304 posts
i have everything on the server and on the site set up to allow videos up to 6.3 gigs to upload
1 gig even 246 meg files upload to 100% then say upload failed

im pretty sure i know why but need the specifics to fix it

cloudflare has a 150 meg upload limit max unless your willing to pay a huge pricetag for enterprise level
you can set page rules to bypass cache and access the server directly

i set page rulezs to do that for *.dreadlockssite.com/*/create and *.dreadlockssite.com/*/create/* and even specificly
*.dreadlockssite.com/uploaded_video/create

heres my suspicion and why i need specifics
i think that only buypasses cache for the form page, not the page or script or whatever that handles the upload it says it gets to 100% but then says it failed no server errors recorrded it isnt when i click create its as soon as the upload reaches 100%

1 other possible explanation my medie folders on a seperate drive from the main site content? could it be failing moving it from a temp cache location or ram, to disk





--
soaringeagle
head dreadhead at dreadlocks site
glider pilot student and member/volunteer coordinator with freedoms wings international soaring for people with disabilities

updated by @soaringeagle: 10/17/15 01:26:37PM
michael
@michael
9 years ago
7,715 posts
I don't know anything about cloudflair system sorry.

Once the file is fully uploaded 100% to the temp directory then the file is moved into the /media/ directory and given its correct name.

If its failing at the copy point then look for the issue in the destination directory, maybe limit on diskspace, or permissions. For whatever reason the newly uploaded file cant be moved to where it needs to go.

Take a look at the jrAudio module to see the save flow from a form, maybe check out view_jrAudio_create_save() to see how its done in a form.

During the form submit save process the function jrCore_save_all_media_files() fires. That saves the file to the /data/ directory in a format like:

/core/data/cache/jrCore/12046f3177d5079e5528aa7a34175c73/1_audio_file
/core/data/cache/jrCore/12046f3177d5079e5528aa7a34175c73/1_audio_file.tmp

The that file then retrieved with jrCore_get_uploaded_media_files() function if you want it.

Another function to look at is jrCore_save_media_file() which processes the individual files.

Sounds like what your attempting to do is pretty advanced, it would be easier if you setup a debugger.

http://www.jamroom.net/the-jamroom-network/documentation/development/129/setting-up-a-debugging-environment
soaringeagle
@soaringeagle
9 years ago
3,304 posts
we were able to uload a 35 meg vid
what i was hoping is theres a upload.php file type thing somewhere that handles the uploads and if i disable cache on that it would work but now that i think it through php files arent cached but run on the server

so the moving from cache to media might be the issue but does that happen hen it reaches 100% or when you click create
its not when i click crete but when the upload finishes


--
soaringeagle
head dreadhead at dreadlocks site
glider pilot student and member/volunteer coordinator with freedoms wings international soaring for people with disabilities
michael
@michael
9 years ago
7,715 posts
You're going to need to track down the source of the error to continue further. Start at any javascript errors in the console when it reaches 100%.

That might give a clue as to where to look next.

If its a jamroom problem chances are high there will be something in the activity log/error log/ debug log.

If its a server thing then the server error logs.

--edit--
also look in the:
/core/data/cache/(THE MODULE)
directory to see if there is anything left over ther that looks like temporary stuff. If there is then its the moving phase that has the issue.
updated by @michael: 09/13/15 11:43:53PM
soaringeagle
@soaringeagle
9 years ago
3,304 posts
its not cloudflare i disabled that and still same thing


--
soaringeagle
head dreadhead at dreadlocks site
glider pilot student and member/volunteer coordinator with freedoms wings international soaring for people with disabilities
soaringeagle
@soaringeagle
9 years ago
3,304 posts
found a quota.user file in media im pretty sure thats the cause we are unmounting the drive removing it from fstab and remounting
ill let u know if that fixes it thanks for being awesome


--
soaringeagle
head dreadhead at dreadlocks site
glider pilot student and member/volunteer coordinator with freedoms wings international soaring for people with disabilities
soaringeagle
@soaringeagle
9 years ago
3,304 posts
There are no errors in the error console when it finishes I'm stumped. We did remove that the quota user file but that made no difference


--
soaringeagle
head dreadhead at dreadlocks site
glider pilot student and member/volunteer coordinator with freedoms wings international soaring for people with disabilities
soaringeagle
@soaringeagle
9 years ago
3,304 posts
heres the errors i got in edge wich shows more info then firefox
error.jpg
error.jpg  •  159KB




--
soaringeagle
head dreadhead at dreadlocks site
glider pilot student and member/volunteer coordinator with freedoms wings international soaring for people with disabilities
soaringeagle
@soaringeagle
9 years ago
3,304 posts
cant find that cache data path structure anywhere
while the vids uploading cant find where its uploading to in cache


--
soaringeagle
head dreadhead at dreadlocks site
glider pilot student and member/volunteer coordinator with freedoms wings international soaring for people with disabilities
michael
@michael
9 years ago
7,715 posts
The flow is:
* upload to /data/cache/...
* move to /data/0/1 (or whatever data directory is correct for the user)
* delete from /data/cache/...

so if its not visible in the data/cache then its probably safe to assume that it is being copied.

Try using FTP to see if its in the expected location in the /data/0/2 directory for the user who its supposed to be going to.

those errors in the console dont seam familiar to me, hopefully they are unrelated.

I'm away from my dev machine for a couple of weeks so im not going to be the most helpful for a while sorry.
soaringeagle
@soaringeagle
9 years ago
3,304 posts
ok in data/media i think you mean
0 just has 0 in it

ok finaly found the profile space by7 guesswork my profil e id is 83 there was no 83 folder losest was data/media/1/85
that had my images in it so i assume its the right 1
theres no mp4 files only flv but none come close to its size
and ofcourse the names are all changed so f no help


--
soaringeagle
head dreadhead at dreadlocks site
glider pilot student and member/volunteer coordinator with freedoms wings international soaring for people with disabilities

Tags