possible bugs in beta core?

soaringeagle
@soaringeagle
6 years ago
3,304 posts
in dashboard:
very high cpu use
users online count only counts logged in users (again) (correction it only lists 1 or 2 no matter how many are logged in)
(ps currently NOT using redis..yet)
does not get cpu count

cpu goes through the roof over time. woke up to it above 20.9!
after restarting both apache and mysql it drops to about 3.6 but soon climbs to over 7 and causes service temporarily unavailable

my.cnf
[mysqld]
bind-address = 127.0.0.1
local-infile=0
datadir=/var/lib/mysql
socket=/var/lib/mysql/mysql.sock
user=mysql
key_buffer = 4096
max_allowed_packet = 32M
query_cache_size   = 0
query_cache_type  = 0
join_buffer_size  = 500k
thread_cache_size = 4
#  performance_schema
#  performance_schema_events_waits_history_size=20
#  performance_schema_events_waits_history_long_size=15000
key_buffer_size = 125M
innodb_log_file_size = 512M
innodb_buffer_pool_instances = 4
table_cache          = 1536
# for a 2 Gig RAM droplet
tmp_table_size       = 2096M
max_heap_table_size  = 2096M
innodb_buffer_pool_size = 4096M
innodb_flush_method     = O_DIRECT
max_allowed_packet=32M
# Disabling symbolic-links is recommended to prevent assorted security risks
symbolic-links=0
join_buffer_size               = 4M
max_connections                = 160
thread_cache_size              = 160
open_files_limit               = 65535
table_definition_cache         = 8096
table_open_cache               = 8096

[mysqld_safe]
log-error=/var/log/mysqld.log
pid-file=/var/run/mysqld/mysqld.pid

further notes php_mod does not work on newer php versions aparently.
cant run nginx
(domain profiles)

still using fastcgi since it 'works' but not properly
although cpu was high..ish prior to update its gone off the charts since and the other issues are new since core update

i suspect its fastcgi not mysql (cant be certain)
but have not found a workaround forr php 7

but that doesnt explain the cpu count, the user count
or the fact that prior to update cpou times only showed what that site was using, not total cpu load

noticed in procedsslist large number of updates to cache during times of highest cpu load when things get unstable
MariaDB [(none)]> SHOW PROCESSLIST;
+------+--------------+-----------+--------------+---------+------+------------+------------------------------------------------------------------------------------------------------+----------+
| Id   | User         | Host      | db           | Command | Time | State      | Info                                                                                                 | Progress |
+------+--------------+-----------+--------------+---------+------+------------+------------------------------------------------------------------------------------------------------+----------+
| 4344 | greentec_jam | localhost | greentec_jam | Query   |    0 | statistics | /* greentec_jam:visitor:66.249.69.46:/jess-vlaanderen/gallery/jess-vlaanderen/all */ SELECT UNIX_TIM |    0.000 |
| 4499 | greentec_jam | localhost | greentec_jam | Query   |    0 | statistics | /* greentec_jam:visitor:217.182.132.66:/cassie-sattler/ */ SELECT `_item_id` AS i,`key` AS k,`index` |    0.000 |
| 4694 | greentec_jam | localhost | NULL         | Query   |    0 | init       | SHOW PROCESSLIST                                                                                     |    0.000 |
| 4752 | greentec_jam | localhost | greentec_jam | Query   |    0 | update     | /* greentec_jam:visitor:66.249.69.46:/dready-soren */ INSERT INTO jr_jrcore_cache (cache_key,cache_e |    0.000 |
| 4758 | greentec_jam | localhost | greentec_jam | Query   |    0 | update     | /* greentec_jam:visitor:68.180.229.59:/baby-britt/gallery/106825/picture-7 */ INSERT INTO jr_jrcore_ |    0.000 |
| 4763 | greentec_jam | localhost | greentec_jam | Query   |    0 | statistics | /* greentec_jam:visitor:148.64.56.79:/dreadlocks-forums/forum/dread-maintenance/101057/dry-shampoo * |    0.000 |
| 4770 | greentec_jam | localhost | greentec_jam | Query   |    0 | update     | /* greentec_jam:visitor:51.255.65.49:/valerie2/gallery/30965/jackson */ INSERT INTO jr_jrcore_cache  |    0.000 |
| 4772 | greentec_jam | localhost | greentec_jam | Query   |    0 | statistics | /* greentec_jam:visitor:68.180.229.59:/ashlynbetsoup/forum */ SELECT UNIX_TIMESTAMP() AS db_time, ca |    0.000 |
| 4773 | greentec_jam | localhost | greentec_jam | Query   |    0 | statistics | /* greentec_jam:visitor:51.255.71.132:/lisa-ann-maynard/gallery/78061/i-finished-the-last-tnr-this-e |    0.000 |
| 4774 | greentec_jam | localhost | greentec_jam | Query   |    0 | statistics | /* greentec_jam:visitor:66.31.176.220:/dreadlocks-forums/forum/new_posts/72937/dread-dead-hair-or-wh |    0.000 |
| 4775 | greentec_jam | localhost | greentec_jam | Query   |    0 | query end  | /* greentec_jam:visitor:40.77.167.37:/michell-rodriguez */ INSERT INTO jr_jrprofile_item_key (`_item |    0.000 |
| 4776 | greentec_jam | localhost | greentec_jam | Query   |    0 | statistics | /* greentec_jam:visitor:217.182.132.192:/tomasu/gallery/tomasu/all */ SELECT UNIX_TIMESTAMP() AS db_ |    0.000 |
| 4777 | greentec_jam | localhost | greentec_jam | Query   |    0 | statistics | /* greentec_jam:visitor:66.249.69.35:dreadlocks-forums/forum/52202/shout-out-i-miss-you-guys */ SELE |    0.000 |
+------+--------------+-----------+--------------+---------+------+------------+------------------------------------------------------------------------------------------------------+----------+
13 rows in set (0.00 sec)


edit; discovered the users online issue however these cvounts dont add up see screenshot

cpu count still not showing after reverting to previous cores
im guessing thats no longer from core/
argh.jpg
argh.jpg  •  308KB

yikes.jpg
yikes.jpg  •  160KB

Untitled.jpg
Untitled.jpg  •  23KB




--
soaringeagle
head dreadhead at dreadlocks site
glider pilot student and member/volunteer coordinator with freedoms wings international soaring for people with disabilities

updated by @soaringeagle: 05/09/18 10:48:15PM
brian
@brian
6 years ago
10,148 posts
This is just issues on your server. You want to turn off open_basedir.

I know you inquired some time ago about us running a server for you - if you're ready to move on from banging your head against the wall with your own server, let us know :)


--
Brian Johnson
Founder and Lead Developer - Jamroom
https://www.jamroom.net
soaringeagle
@soaringeagle
6 years ago
3,304 posts
thats already off
and the cpu count just stopperd working suddenly after most recent update
what command or whatever is used to gather the cpu info/
i'll make sure that wasn't disabled or anything
i did ask to have any unnesacary apache modules disabled
maybe something was disabled that was needed/

open base directory was really screwing things up so they wernt working right at all..
after resetting that to default its been working, just high cpu (still needs a lil tuning and fast cgi replaced) after that the server should be just fine
but what is it that gathers the cpu count and speed


--
soaringeagle
head dreadhead at dreadlocks site
glider pilot student and member/volunteer coordinator with freedoms wings international soaring for people with disabilities
soaringeagle
@soaringeagle
6 years ago
3,304 posts
wait can it be set to none instead of default? i'll try that hadn't seen that as an op[tion


--
soaringeagle
head dreadhead at dreadlocks site
glider pilot student and member/volunteer coordinator with freedoms wings international soaring for people with disabilities
soaringeagle
@soaringeagle
6 years ago
3,304 posts
that worked..


--
soaringeagle
head dreadhead at dreadlocks site
glider pilot student and member/volunteer coordinator with freedoms wings international soaring for people with disabilities
soaringeagle
@soaringeagle
6 years ago
3,304 posts
user counts still add up all wonky though
the visitors and users is 1/2 or less then the visitors
maybe its a diference in how sessions are counted or how long till they expire or something
but you can see they don't add up right


--
soaringeagle
head dreadhead at dreadlocks site
glider pilot student and member/volunteer coordinator with freedoms wings international soaring for people with disabilities
brian
@brian
6 years ago
10,148 posts
If you are using Redis, there is going to be a new beta version of the Redis module released. It requires php-redis now and no longer uses the Predis library.

I'll check on the counts - we just recently had to redo how the counts worked.


--
Brian Johnson
Founder and Lead Developer - Jamroom
https://www.jamroom.net
soaringeagle
@soaringeagle
6 years ago
3,304 posts
im not yet using redis (plan to) but its not yet installed

question
fpm is not working without nginx nginx wont work with profile domains

mod_php only works on php 5.3.3 i use 7.2.2

so..what do you suggest/


--
soaringeagle
head dreadhead at dreadlocks site
glider pilot student and member/volunteer coordinator with freedoms wings international soaring for people with disabilities
brian
@brian
6 years ago
10,148 posts
mod_php works fine with PHP 7 - we're running 7.2 here on jamroom.net.


--
Brian Johnson
Founder and Lead Developer - Jamroom
https://www.jamroom.net
soaringeagle
@soaringeagle
6 years ago
3,304 posts
everything i read says it can only be installed onm the vender supplied php version
meanning the version installed with the system

would i have to reinstall lamp with 7 instead of 5/


--
soaringeagle
head dreadhead at dreadlocks site
glider pilot student and member/volunteer coordinator with freedoms wings international soaring for people with disabilities
brian
@brian
6 years ago
10,148 posts
Just remember that I can't set your server up for you. We've gone down this path quite a number of times in the past, and I've recommended that you do not run your own server. I know you've figured out how to do quite a number of things on your own, and I'm not trying to disparage your effort and desire to figure it out - we just can't be your sysadmin source.

You're going to need to install the latest PHP by adding a custom ppa:

https://launchpad.net/~ondrej/+archive/ubuntu/php

This will NOT work if you are not using Debian/Ubuntu. I cannot help you if you're using a RH linux derivative.

Who are you renting your server from? Can they not set this up for you and ensure everything is working? I know you contacted us a while back about setting up a custom server for you - I never heard back from you. I believe we were able to meet the cost you needed, so let me know if you're ready to move on from futzing with server stuff :)


--
Brian Johnson
Founder and Lead Developer - Jamroom
https://www.jamroom.net
soaringeagle
@soaringeagle
6 years ago
3,304 posts
trying to remember what you quoted me but think it was barely doabl;e and abouit double what im paying now
i could have done it but would hurt
still keeping it as an option
i'll pass this along


--
soaringeagle
head dreadhead at dreadlocks site
glider pilot student and member/volunteer coordinator with freedoms wings international soaring for people with disabilities
brian
@brian
6 years ago
10,148 posts
I have the counts issue fixed for the next release - right now the visitor count is including bots when it should not be. How much are you paying for your new server?


--
Brian Johnson
Founder and Lead Developer - Jamroom
https://www.jamroom.net
soaringeagle
@soaringeagle
6 years ago
3,304 posts
125 + 27 for backup space (running jr backup locked tables freezing the site then crashing them when i tried restarting mysql (should have checked processlist but site was unresponsive several minutes already)

its 125 for 8 cores (4 with ht) at 3.3-3.7 (turbo)
900 gig ssd (morte then i needed) 2 tb satsa 36 gig ram

the price was outstanding for what i got
might be 135.. forget it started at 85 then added the sata

its basicly what i had before that io was spending 485 a month on


--
soaringeagle
head dreadhead at dreadlocks site
glider pilot student and member/volunteer coordinator with freedoms wings international soaring for people with disabilities
soaringeagle
@soaringeagle
6 years ago
3,304 posts
oh and i thought it might have been bots despite not being an exact match it was fairly close


--
soaringeagle
head dreadhead at dreadlocks site
glider pilot student and member/volunteer coordinator with freedoms wings international soaring for people with disabilities
SteveX
SteveX
@ultrajam
6 years ago
2,584 posts
soaringeagle:the price was outstanding for what i got
So all working fine with no problems then?


--
¯\_(ツ)_/¯ Education, learning resources, TEL, AR/VR/MR, CC licensed content, panoramas, interactive narrative, sectional modules (like jrDocs), lunch at Uni of Bristol. Get in touch if you share my current interests or can suggest better :)
soaringeagle
@soaringeagle
6 years ago
3,304 posts
99% there
yes.. but not 100% will have to reinstall php the way brian suggested then were golden

had a couple lil issues had to figure out and that 1 last 1 will be done tonight

cpu is a tad high but thats cause still running the fastcgi
got ningx fpm as an option which seems to run smoother but i want profile domains to work

so should be good as gold by tiomorow


--
soaringeagle
head dreadhead at dreadlocks site
glider pilot student and member/volunteer coordinator with freedoms wings international soaring for people with disabilities
SteveX
SteveX
@ultrajam
6 years ago
2,584 posts
It's so great that you are still so consistently 99% there:
https://www.jamroom.net/the-jamroom-network/forum?search_string=soaringeagle

Why not get a working server?


--
¯\_(ツ)_/¯ Education, learning resources, TEL, AR/VR/MR, CC licensed content, panoramas, interactive narrative, sectional modules (like jrDocs), lunch at Uni of Bristol. Get in touch if you share my current interests or can suggest better :)
soaringeagle
@soaringeagle
6 years ago
3,304 posts
you do know its only been on the new server 3 days right
takes a couple days to get it tuned up get everything set up just right

its a great server amnd you know i host more then jamroom sites so why should i pay for 2 servers/

how about ya give me a couple days to finish tuning it up..huh?
i already told ya theres just 1 thing left to do which will be done tonight


--
soaringeagle
head dreadhead at dreadlocks site
glider pilot student and member/volunteer coordinator with freedoms wings international soaring for people with disabilities

Tags