importing large sites issue (i know pauls gone)

i have a high power dedicated server and was running litespeed with litespe4red on it timed out every 3 minutes we fixed that setting the limits at the max but then every hour the importer stopped and needed to be restarted
\
i hsd litespeed shut off and apache keepalive limits set to the max but now the cpu usage is higherthen i ever saw it routter.php using the most anbd the importer fails after onkly seconds with internal server error cannot connectto server
when looking at server loads the routter.php continues to usde excessivly high cpu resources long after the importers stopped
its still high as i type

now its finaly coming down like 4 or 5 minutes after stopping the import script

the importer fails at ;'trying alternative methods" on the json before importing any anything except 1 time it imported maybe 10 comments then failed




--
soaringeagle
head dreadhead at dreadlocks site
glider pilot student and member/volunteer coordinator with freedoms wings international soaring for people with disabilities
updated by @soaringeagle: 07/09/16 09:21:02AM

First up, make sure your keep alive seconds is set to "1" - no higher. router.php is the main JR router, so it's involved in every request - so all that means is that a request was continuing to run. If you want to STOP a JR process you need to bounce Apache:

service apache2 restart

I don't know that the importer is doing, but it sounds like the modal window is getting disconnected because your server isn't allowing enough connections (which could happen if you set your keep alive timeout really high).

I've sysadmined for a very long time, and have setup more Unix/Linux servers than I can remember, and if you setup a server like I do:

https://www.jamroom.net/brian/documentation/guides

even a lowly little 512mb server will work awesome. If you have a dedicated server then you just have it configured wrong, as you should be able to handle thousands of simultaneous users.


--
Brian Johnson
Founder and Lead Developer - Jamroom
https://www.jamroom.net
updated by @brian: 12/29/14 09:23:54AM

ok ill try that


--
soaringeagle
head dreadhead at dreadlocks site
glider pilot student and member/volunteer coordinator with freedoms wings international soaring for people with disabilities
updated by @soaringeagle: 12/29/14 09:23:54AM

defaults 5 set it to that and so far so good
ok so ill let ya all know how it goes but it seems if u use litespeed as a server its great to serve but not for the imports and needs to be disabled during import

crap tried 5 tried 1 still having issues any chance i could let ya poke around in whm and see if u can see the idssues


--
soaringeagle
head dreadhead at dreadlocks site
glider pilot student and member/volunteer coordinator with freedoms wings international soaring for people with disabilities
updated by @soaringeagle: 12/29/14 09:23:54AM

switching back to litespeed ill just retart the import every jhour at least its working


--
soaringeagle
head dreadhead at dreadlocks site
glider pilot student and member/volunteer coordinator with freedoms wings international soaring for people with disabilities
updated by @soaringeagle: 12/29/14 09:23:54AM

Just an FYI that I don't develop on Litespeed, so you're on your own if you want to use that as your web server...

If you want me to check it out, I can definitely do that, but it would be tomorrow in the early morning - if that's OK shoot me an email at support [at] jamroom [dot] net and I can check out your server config.

Hope this helps!


--
Brian Johnson
Founder and Lead Developer - Jamroom
https://www.jamroom.net
updated by @brian: 12/29/14 09:23:54AM

sure


--
soaringeagle
head dreadhead at dreadlocks site
glider pilot student and member/volunteer coordinator with freedoms wings international soaring for people with disabilities
updated by @soaringeagle: 12/29/14 09:23:54AM