blog documentation FAQ followers forum marketplace services youtube

queue depth just keeps increasing

The Jamroom Network » Forum » Installation and Configuration » Page » queue depth just keeps increasing
soaringeagle
@soaringeagle
8 years ago
3,304 posts
since the jr 6 update my queue depth just keeps increasing
comments seems to be the biggest culprit on new site and media url scanner on the big site
if i have the dashboard on a 60 sec refresh both sites increase by 1 every 60 seconds

everytime theres an update to a module these go up drasticly like the media url scanner is scanning all urls, like 4 times each because it updated 4 times and hasn't completed the 1st round yet
at least thats what it seems to do to me
q1.jpg
q1.jpg  •  115KB

q2.jpg
q2.jpg  •  32KB




--
soaringeagle
head dreadhead at dreadlocks site
glider pilot student and member/volunteer coordinator with freedoms wings international soaring for people with disabilities
updated by @soaringeagle: 04/22/17 11:18:03PM
brian
@brian
8 years ago
10,148 posts
1) Pause Queues
2) Run an integrity check with "repair modules" checked
3) turn queues back on

That should fix it up.


--
Brian Johnson
Founder and Lead Developer - Jamroom
https://www.jamroom.net
soaringeagle
@soaringeagle
8 years ago
3,304 posts
thnx ill try


--
soaringeagle
head dreadhead at dreadlocks site
glider pilot student and member/volunteer coordinator with freedoms wings international soaring for people with disabilities
soaringeagle
@soaringeagle
8 years ago
3,304 posts
oh yea that sure worked wonder .. solved


--
soaringeagle
head dreadhead at dreadlocks site
glider pilot student and member/volunteer coordinator with freedoms wings international soaring for people with disabilities
soaringeagle
@soaringeagle
8 years ago
3,304 posts
actually only seemed to fix it on small site not big will try again


--
soaringeagle
head dreadhead at dreadlocks site
glider pilot student and member/volunteer coordinator with freedoms wings international soaring for people with disabilities
soaringeagle
@soaringeagle
8 years ago
3,304 posts
to get big site working i had to reset the groups verify module worker it had 24 items queued i think all 24 re-verifying the same module from 24 integrity checks and module updates??????? i dunno but resetting that worker got the rest moving


--
soaringeagle
head dreadhead at dreadlocks site
glider pilot student and member/volunteer coordinator with freedoms wings international soaring for people with disabilities
michael
@michael
8 years ago
7,772 posts
you do come up with some interesting scenarios. Well done on getting it sorted.
soaringeagle
@soaringeagle
8 years ago
3,304 posts
not completely certain it is yet
ps might be getting a free serius server upgrade


--
soaringeagle
head dreadhead at dreadlocks site
glider pilot student and member/volunteer coordinator with freedoms wings international soaring for people with disabilities
soaringeagle
@soaringeagle
8 years ago
3,304 posts
no the counts still going up on dreadlockssite freedomwings is fine


--
soaringeagle
head dreadhead at dreadlocks site
glider pilot student and member/volunteer coordinator with freedoms wings international soaring for people with disabilities
soaringeagle
@soaringeagle
8 years ago
3,304 posts
because my sites huge could it stil be crawling my site scanning for urls?


--
soaringeagle
head dreadhead at dreadlocks site
glider pilot student and member/volunteer coordinator with freedoms wings international soaring for people with disabilities
Strumelia
Strumelia
@strumelia
8 years ago
3,603 posts
After reading this thread and one other, I went to look at my queue viewr on both my sites and didn't realize there was a huge bunch of stuff hanging there.
I've done the above advice and paused/integcheck/resume/refresh view... and though most of them are now gone I still have this for example (see attached). Should I be worried or do anything else? Can i just use the 'delete all' button to clear out the queue viewer, or is that inadvisable?
queueviewer.jpg
queueviewer.jpg  •  91KB




--
...just another satisfied Jamroom customer.
Migrated from Ning to Jamroom June 2015
soaringeagle
@soaringeagle
8 years ago
3,304 posts
yea its the media url scanner that has a ton and is adding more like its still scanning my large site


--
soaringeagle
head dreadhead at dreadlocks site
glider pilot student and member/volunteer coordinator with freedoms wings international soaring for people with disabilities
soaringeagle
@soaringeagle
8 years ago
3,304 posts
repeating the steps seems to restart it then it after awhile stops going down and starts going up... i'll see if this time does the trick


--
soaringeagle
head dreadhead at dreadlocks site
glider pilot student and member/volunteer coordinator with freedoms wings international soaring for people with disabilities
Strumelia
Strumelia
@strumelia
8 years ago
3,603 posts
Now only the Media Url Scanner is still there in my queue.


--
...just another satisfied Jamroom customer.
Migrated from Ning to Jamroom June 2015
brian
@brian
8 years ago
10,148 posts
The Media URL scanner queue entries are background jobs that try to get info from a remote site URL so it can create a "card". Sometimes the remote site might take a long time to respond, in which case the worker can get "hung". You can either manually reset the queue entries, or in the new Core 6.0.6 there is a new hourly maintenance worker that looks for "stuck" queue entries and tries to clean them up and get them moving again automatically.


--
Brian Johnson
Founder and Lead Developer - Jamroom
https://www.jamroom.net
Strumelia
Strumelia
@strumelia
8 years ago
3,603 posts
Ok -my queue viewer has now cleared itself, after doing the integrity check thing and a little time. :)


--
...just another satisfied Jamroom customer.
Migrated from Ning to Jamroom June 2015
brian
@brian
8 years ago
10,148 posts
Core 6.0.6 should do a better job of auto-detecting situations it can clean up from, so ideally you never have to worry about it :)


--
Brian Johnson
Founder and Lead Developer - Jamroom
https://www.jamroom.net
soaringeagle
@soaringeagle
8 years ago
3,304 posts
damn your good


--
soaringeagle
head dreadhead at dreadlocks site
glider pilot student and member/volunteer coordinator with freedoms wings international soaring for people with disabilities
soaringeagle
@soaringeagle
8 years ago
3,304 posts
or,well having he issue with core not wanting to update again,even though i am on php 7.0.14 now


--
soaringeagle
head dreadhead at dreadlocks site
glider pilot student and member/volunteer coordinator with freedoms wings international soaring for people with disabilities
soaringeagle
@soaringeagle
8 years ago
3,304 posts
interesting, when i try install all updates i get
installing module update for: jrCore
installing module update for: jrCore
installing module update for: jrCore
installing module update for: jrCore
installing module update for: jrCore

it keeps resetting

jjst out of curiosity going to paus queues
install core
integrity check all options
then resume queue..i'll let ya know


--
soaringeagle
head dreadhead at dreadlocks site
glider pilot student and member/volunteer coordinator with freedoms wings international soaring for people with disabilities
brian
@brian
8 years ago
10,148 posts
I have about 25 JR sites here that I keep up to date and I never see this. I would suspect a network issue or some other problem that's keeping things from being downloaded, or causing a lot of "retries". Not sure what to recommend unfortunately.


--
Brian Johnson
Founder and Lead Developer - Jamroom
https://www.jamroom.net
soaringeagle
@soaringeagle
8 years ago
3,304 posts
not a network issue from my home pc to server thiugh right i know the routters been acting up and need a new 1
but your talking about server to server
its odd everything updates perfectky fine except the core
the core updated after upgrading to php 7.. from 6.0.4 to 6.0.5 but now wont update to 6.0.6
i'll keep playing and update if i figure it out


--
soaringeagle
head dreadhead at dreadlocks site
glider pilot student and member/volunteer coordinator with freedoms wings international soaring for people with disabilities
soaringeagle
@soaringeagle
8 years ago
3,304 posts
can you upload new core version then run a script to update?


--
soaringeagle
head dreadhead at dreadlocks site
glider pilot student and member/volunteer coordinator with freedoms wings international soaring for people with disabilities
soaringeagle
@soaringeagle
8 years ago
3,304 posts
hmm last time there was no 6.0.5 folder so no files were transferred this time i see the folder and files (cant verify all were transferred) so its putting the files there and just not updating the symlink ,,or resetting b4 it does ..or freezing
it doesn't always reset over and over
someties fter awhile ui get error communicating with server
and if both sites are updating at sme time both seem to fail at sme time (if i get that error)

corection big site has 6.0.6 folder small one does not
so it seems to stall part way through the transfer if it transfers at all


--
soaringeagle
head dreadhead at dreadlocks site
glider pilot student and member/volunteer coordinator with freedoms wings international soaring for people with disabilities
updated by @soaringeagle: 01/19/17 06:59:48PM
michael
@michael
8 years ago
7,772 posts
soaringeagle:
can you upload new core version then run a script to update?

sure. SFTP upload is fine. Then run the integrity check.
soaringeagle
@soaringeagle
8 years ago
3,304 posts
good then thnx
i figured that might do it
it uploaded part to 1 site, none to the other
i don't get why all modules update but the core


--
soaringeagle
head dreadhead at dreadlocks site
glider pilot student and member/volunteer coordinator with freedoms wings international soaring for people with disabilities
soaringeagle
@soaringeagle
8 years ago
3,304 posts
that worked re- marking it solved again


--
soaringeagle
head dreadhead at dreadlocks site
glider pilot student and member/volunteer coordinator with freedoms wings international soaring for people with disabilities
soaringeagle
@soaringeagle
8 years ago
3,304 posts
just when i marked it solved, the upload and integrity check worked fine on dreadlockssite but not freedomswings
cannot figure out why
only thing i can guess at is cause fwi is originally on fwi.dreadlockssite.com then i just pointed the vhosts to the subdomain folder within the dreadlockssite account space
i should be getting a free server upgrade soon (huge upgrade)
so if nothing else hopefully that will fix it


--
soaringeagle
head dreadhead at dreadlocks site
glider pilot student and member/volunteer coordinator with freedoms wings international soaring for people with disabilities
michael
@michael
8 years ago
7,772 posts
soaringeagle:....
i don't get why all modules update but the core....

Guess is that the core is the biggest module and takes the most time, so suspect something relating to timeouts causes the issue.
soaringeagle
@soaringeagle
8 years ago
3,304 posts
even when i upload it?
i am getting real poor db performance in performance test (60.something)
so maybe that's why
i am getting a free superpowered server in a few days (16 cores 48-64 gigs 15 tb raided sas 15000 rpm drives (he says its twice as fast as ssd)
and setting up a db server separately (i think on a vm)
hope that fixes it


--
soaringeagle
head dreadhead at dreadlocks site
glider pilot student and member/volunteer coordinator with freedoms wings international soaring for people with disabilities

Tags