media conversion step of import issues

@soaringeagle
11 years ago
3,304 posts

im trying to do the nedia conversion and i keep getting json errors
but heres the real issue
my queue depth is over 3,000
but everytime i get the error and have to start over it doesnt seem to sokip the ones in queue or already converted but starts at the begining
it gets to around the same place every time then stops

im not sure if its the exact same place ornot but around 117 sometimes more sometimes lessi think
so i have a feeling those 3,0000+ in queue are the same hundred and some over and over

is there anyone that can take a look at it besides paul

--
soaringeagle
head dreadhead at dreadlocks site
glider pilot student and member/volunteer coordinator with freedoms wings international soaring for people with disabilities
updated by @soaringeagle: 07/09/16 09:21:02AM

@soaringeagle
11 years ago
3,304 posts

queue depth continues to go up despite the fact the conversion scripts not adding more items and page loads are getting slooow

--
soaringeagle
head dreadhead at dreadlocks site
glider pilot student and member/volunteer coordinator with freedoms wings international soaring for people with disabilities
updated by @soaringeagle: 12/29/14 09:23:54AM

@soaringeagle
11 years ago
3,304 posts

this is worrying me
page loads are fast again now that im not running the conversion script
but the queue length is still going up and up anbd up and will probably hit 4,000 by the time im done writing this

when i ran the script it would generate that json error at adiferent spot every time ..both in the json column (diferent charachter count or whateverr) as well as a diferent song coukld be 117 or 113 or last was 97
but i swear earlier it was getting up to 489 or so

the fact the queues still going up and the number it bombs out on seems to be going down...

i wonder...should i leave it be for several hours and see if it eventualy clears the queue
and if so should i run it till it bombs.. let the queue clear run it till it bombs..etc

but not sure ill ever get anywhere if it keeps restarting at 0

any help? afraid to try anything else

--
soaringeagle
head dreadhead at dreadlocks site
glider pilot student and member/volunteer coordinator with freedoms wings international soaring for people with disabilities
updated by @soaringeagle: 12/29/14 09:23:54AM

@brian
11 years ago
10,149 posts

Looks like you are still tied in to our conversion server, as I see almost 30,000 queue audio items waiting for conversion server.

Are you redoing your import? I'd like to cancel these jobs, but want to see what it is you are actually doing.

Thanks!

--
Brian Johnson
Founder and Lead Developer - Jamroom
https://www.jamroom.net
updated by @brian: 12/29/14 09:23:54AM

@soaringeagle
11 years ago
3,304 posts

im doing nothing but ther queue kereps rising

if its ok with you woukd you like to do this step

--
soaringeagle
head dreadhead at dreadlocks site
glider pilot student and member/volunteer coordinator with freedoms wings international soaring for people with disabilities
updated by @soaringeagle: 12/29/14 09:23:54AM

@soaringeagle
11 years ago
3,304 posts

i posted in the vip too cause i was getting very worried

--
soaringeagle
head dreadhead at dreadlocks site
glider pilot student and member/volunteer coordinator with freedoms wings international soaring for people with disabilities
updated by @soaringeagle: 12/29/14 09:23:54AM

@brian
11 years ago
10,149 posts

soaringeagle:
i posted in the vip too cause i was getting very worried

I already had paused the queues on our conversion service, so for now everything is just sitting there - I'm not seeing the queue count increasing though - are seeing your queue count increasing?

Thanks!

--
Brian Johnson
Founder and Lead Developer - Jamroom
https://www.jamroom.net
updated by @brian: 12/29/14 09:23:54AM

@soaringeagle
11 years ago
3,304 posts

let me giveit a few min and ill see

no seems to be staying at 4255

the highest its gotten

--
soaringeagle
head dreadhead at dreadlocks site
glider pilot student and member/volunteer coordinator with freedoms wings international soaring for people with disabilities
updated by @soaringeagle: 12/29/14 09:23:54AM

@soaringeagle
11 years ago
3,304 posts

so..now what
leave it stuck where its at., do u wsant to clear the queue if so want me to try again or do you wantto try it from your end

--
soaringeagle
head dreadhead at dreadlocks site
glider pilot student and member/volunteer coordinator with freedoms wings international soaring for people with disabilities
updated by @soaringeagle: 12/29/14 09:23:54AM

@brian
11 years ago
10,149 posts

soaringeagle:
so..now what
leave it stuck where its at., do u wsant to clear the queue if so want me to try again or do you wantto try it from your end

Do you need to reconvert all your media? If so I can reset things on this end if you want to reset on your end. I'm showing almost 30,000 queue entries from your system though (a lot more than 4,000) - I'm suspecting that something has gone wrong, or did you just restart the import several times?

Thanks!

--
Brian Johnson
Founder and Lead Developer - Jamroom
https://www.jamroom.net
updated by @brian: 12/29/14 09:23:54AM

@soaringeagle
11 years ago
3,304 posts

the import kept stopping with an error and yes had to restart it
thats why i asked if youd prefer to try it

but if u reset it ill try it1 time if it fails ill stop and let you have a look at it

--
soaringeagle
head dreadhead at dreadlocks site
glider pilot student and member/volunteer coordinator with freedoms wings international soaring for people with disabilities
updated by @soaringeagle: 12/29/14 09:23:54AM

@soaringeagle
11 years ago
3,304 posts

the queue length is finaly slowly going down
does that mean its running right again i assume your not cancling 1 at a time

--
soaringeagle
head dreadhead at dreadlocks site
glider pilot student and member/volunteer coordinator with freedoms wings international soaring for people with disabilities
updated by @soaringeagle: 12/29/14 09:23:54AM

@brian
11 years ago
10,149 posts

soaringeagle:
the queue length is finaly slowly going down
does that mean its running right again i assume your not cancling 1 at a time

They must be running on your server - nothing is running here...

--
Brian Johnson
Founder and Lead Developer - Jamroom
https://www.jamroom.net
updated by @brian: 12/29/14 09:23:54AM

@soaringeagle
11 years ago
3,304 posts

it went down some like 250ish then stopped

how do i reset on my end
im not finding that option..still looking thouhgh

--
soaringeagle
head dreadhead at dreadlocks site
glider pilot student and member/volunteer coordinator with freedoms wings international soaring for people with disabilities
updated by @soaringeagle: 12/29/14 09:23:54AM

@soaringeagle
11 years ago
3,304 posts

found how to pause it but not reset it

but heres what i seee
Conversion Client conversion_download 1 3973 33,703 s

thats a hell of a latency
and couldnt more then 1 worker be working/

--
soaringeagle
head dreadhead at dreadlocks site
glider pilot student and member/volunteer coordinator with freedoms wings international soaring for people with disabilities
updated by @soaringeagle: 12/29/14 09:23:54AM

@brian
11 years ago
10,149 posts

soaringeagle:
found how to pause it but not reset it

but heres what i seee
Conversion Client conversion_download 1 3973 33,703 s

thats a hell of a latency
and couldnt more then 1 worker be working/

Yeah you're seeing that because I've got the Queue Server disabled on this end, so you're Queue Client can't grab the "conversion_download" queue entry. The latency is wrong and I can check that out.

I'm going to go ahead and empty the queues on this end and will let you know.

--
Brian Johnson
Founder and Lead Developer - Jamroom
https://www.jamroom.net
updated by @brian: 12/29/14 09:23:54AM

@soaringeagle
11 years ago
3,304 posts

thnx

--
soaringeagle
head dreadhead at dreadlocks site
glider pilot student and member/volunteer coordinator with freedoms wings international soaring for people with disabilities
updated by @soaringeagle: 12/29/14 09:23:54AM

@soaringeagle
11 years ago
3,304 posts

queues slowly going down and i mean slooooowly
at this rate it will be a few weeeks till its to 0 again

--
soaringeagle
head dreadhead at dreadlocks site
glider pilot student and member/volunteer coordinator with freedoms wings international soaring for people with disabilities
updated by @soaringeagle: 12/29/14 09:23:54AM

@soaringeagle
11 years ago
3,304 posts

ok i found out what the issue is
jrCloudConversionClient_notify_complete: must provide a valid media queue id (2) - See more at: http://greentechnologyforums.com/core/activity_log#sthash.6cPTBH9L.dpuf

theres thousands of these

i increased the workers too
but whats causing these

--
soaringeagle
head dreadhead at dreadlocks site
glider pilot student and member/volunteer coordinator with freedoms wings international soaring for people with disabilities
updated by @soaringeagle: 12/29/14 09:23:54AM

@brian
11 years ago
10,149 posts

soaringeagle:
ok i found out what the issue is
jrCloudConversionClient_notify_complete: must provide a valid media queue id (2) - See more at: http://greentechnologyforums.com/core/activity_log#sthash.6cPTBH9L.dpuf

theres thousands of these

i increased the workers too
but whats causing these

I think you are running old versions of the Cloud modules - the cloud modules (at this time) are "internally used" modules - i.e. Paul uploaded them to your site, so most likely you've got old versions that are no longer working properly (Jamroom's cloud support is in active development right now, so things are changing fairly rapidly).

Disable all the "cloud" modules on your system, and then empty the jr_jrcloudconversionclient_active_queue table (if it has entries in it).

Hope this helps!

--
Brian Johnson
Founder and Lead Developer - Jamroom
https://www.jamroom.net
updated by @brian: 12/29/14 09:23:54AM

@soaringeagle
11 years ago
3,304 posts

thnx your awesome

--
soaringeagle
head dreadhead at dreadlocks site
glider pilot student and member/volunteer coordinator with freedoms wings international soaring for people with disabilities
updated by @soaringeagle: 12/29/14 09:23:54AM

@soaringeagle
11 years ago
3,304 posts

emptied tyhe database queue but tyhe dashboards still showing over 3000

--
soaringeagle
head dreadhead at dreadlocks site
glider pilot student and member/volunteer coordinator with freedoms wings international soaring for people with disabilities
updated by @soaringeagle: 12/29/14 09:23:54AM

@soaringeagle
11 years ago
3,304 posts

in cloud theres 3 modules the 1st and 3rd i was able to disable the middle 1 causes a blank white page
theres an error and wont load

--
soaringeagle
head dreadhead at dreadlocks site
glider pilot student and member/volunteer coordinator with freedoms wings international soaring for people with disabilities
updated by @soaringeagle: 12/29/14 09:23:54AM

@brian
11 years ago
10,149 posts

soaringeagle:
in cloud theres 3 modules the 1st and 3rd i was able to disable the middle 1 causes a blank white page
theres an error and wont load

Make sure you update to the latest Core (5.2.14) - older versions of the Core would not redirect properly if the module had a "locked" module URL.

Let me know if that helps.

Thanks!

--
Brian Johnson
Founder and Lead Developer - Jamroom
https://www.jamroom.net
updated by @brian: 12/29/14 09:23:54AM

@soaringeagle
11 years ago
3,304 posts

ok i figured out why but now got all 3 disabled but still shows the 1 worker with a huge delay and the queues still in the 3,000 range

i set it to 5 workers last night

--
soaringeagle
head dreadhead at dreadlocks site
glider pilot student and member/volunteer coordinator with freedoms wings international soaring for people with disabilities
updated by @soaringeagle: 12/29/14 09:23:54AM

@soaringeagle
11 years ago
3,304 posts

its 5.2.13

--
soaringeagle
head dreadhead at dreadlocks site
glider pilot student and member/volunteer coordinator with freedoms wings international soaring for people with disabilities
updated by @soaringeagle: 12/29/14 09:23:54AM

@brian
11 years ago
10,149 posts

soaringeagle:
ok i figured out why but now got all 3 disabled but still shows the 1 worker with a huge delay and the queues still in the 3,000 range

i set it to 5 workers last night

Empty your jr_jrcore_queue table if it is full...

--
Brian Johnson
Founder and Lead Developer - Jamroom
https://www.jamroom.net
updated by @brian: 12/29/14 09:23:54AM

@soaringeagle
11 years ago
3,304 posts

ok where do i getr the updated core i thought it would pop up an alert if there was an update

--
soaringeagle
head dreadhead at dreadlocks site
glider pilot student and member/volunteer coordinator with freedoms wings international soaring for people with disabilities
updated by @soaringeagle: 12/29/14 09:23:54AM

@soaringeagle
11 years ago
3,304 posts

ok whew that cleared the queue so wherres the core update then ill try again

--
soaringeagle
head dreadhead at dreadlocks site
glider pilot student and member/volunteer coordinator with freedoms wings international soaring for people with disabilities
updated by @soaringeagle: 12/29/14 09:23:54AM

@soaringeagle
11 years ago
3,304 posts

ok tried the media convert and instant error but guess i need the upgraded core?

--
soaringeagle
head dreadhead at dreadlocks site
glider pilot student and member/volunteer coordinator with freedoms wings international soaring for people with disabilities
updated by @soaringeagle: 12/29/14 09:23:54AM

@soaringeagle
11 years ago
3,304 posts

got it and its working

--
soaringeagle
head dreadhead at dreadlocks site
glider pilot student and member/volunteer coordinator with freedoms wings international soaring for people with disabilities
updated by @soaringeagle: 12/29/14 09:23:54AM

media conversion step of import issues

Tags