Forum Activity for @claygordon

Clay Gordon
@claygordon
05/01/24 11:59:19AM
733 posts

Suddenly very slow performance – SLOOOOOW database performace


Installation and Configuration

I don’t know how many pages there are in the Activity Log there is no indicator – just the number of posts/page – but there appear to be LOTS of pages in the activity log. 100GB in a week?
Clay Gordon
@claygordon
05/01/24 11:57:29AM
733 posts

Suddenly very slow performance – SLOOOOOW database performace


Installation and Configuration

Many developer: slow query took
core: 404 Page not found: that look to be spiders (favicon.ico e.g.)

The debug log is not that huge but there is this:


ACP
Dashboard
Users Online
Pending
Activity Log
Data Browser
Recycle Bin
Queue Viewer
MailGun
Activity Log
Debug Log
Error Log
Debug Log

(2024-04-29T15:24:03-06:00.0.40908500 : 0.036)-(mem: 4MB)-(pid: 3213661)-(ip: 51.222.253.3)-(sid: vri82g7q5npe7iudedn3djhilj)-(url: https://archive.thechocolatelife.com/angela-pettypiece/timeline/3219)
|core: recursive module trigger detected for jrCore/db_get_item|

and this:
(2024-04-29T15:24:03-06:00.0.40908500 : 0.036)-(mem: 4MB)-(pid: 3213661)-(ip: 51.222.253.3)-(sid: vri82g7q5npe7iudedn3djhilj)-(url: https://archive.thechocolatelife.com/angela-pettypiece/timeline/3219)
Array
(
[event] => db_get_item
[module] => jrCore
[trace] => Array

And this one

(2024-04-30T21:07:54-06:00.0.75795900 : 0.03)-(mem: 2MB)-(pid: 3912950)-(ip: 52.14.8.34)-(sid: g4kpt4f0880q8qu4svmeifhk9q)-(url: https://archive.thechocolatelife.com/jack-meyer/timeline/514)

With hundreds of lines after this – but not a huge file.
Clay Gordon
@claygordon
05/01/24 11:47:23AM
733 posts

Suddenly very slow performance – SLOOOOOW database performace


Installation and Configuration

Oops - forgot this screenshot. The DB is now 149GB. Did I flip a toggle somehow?
WhatsApp Image 2024-05-01 at 11.43.12.jpeg WhatsApp Image 2024-05-01 at 11.43.12.jpeg - 14KB
Clay Gordon
@claygordon
05/01/24 11:45:18AM
733 posts

Suddenly very slow performance – SLOOOOOW database performace


Installation and Configuration

Taking a look at the server, I see that my disk is now 99% full.

I am kind of wondering what might NOW be consuming 182 of 194GB of disk. When I reported this a couple of days ago the disk was showing 62GB in use.

I turned of the INF and DBG logging and put all the logs on a 3-day purge cycle. My developer tells me that most of the uptick in space usage is the DB.
suddenly-very-slow-performance-slooooow-database-performace-forum-file-1.png suddenly-very-slow-performance-slooooow-database-performace-forum-file-1.png - 134KB
Clay Gordon
@claygordon
04/29/24 08:39:50AM
733 posts

Suddenly very slow performance – SLOOOOOW database performace


Installation and Configuration

After making a bunch of changes, system performance feels much more responsive even though running the Performance Check still returns an absurdly big result (greater than 50). Looking at the activity log I see a lot of the following entries – most of them from the same IP addresses:

developer: slow query took 276ms (associated with AWS)
developer: slow query took 450ms (associated with Google)

Slow db query logging is turned off in Global Config

I am also getting the following when trying to take a look at the Error Log from the Dashboard:

Unable to process your request
The system has encountered an unrecoverable error - please try again shortly

AND I found a typo in a help message in Global Config • Developer Settings in the Developer Settings tab, Developer is misspelled:

If this option is enabled, additional tools for rebasing and resetting the system will appear in the Develope Tools -- Tools menu
Default: off
Clay Gordon
@claygordon
04/27/24 09:51:09AM
733 posts

Implementing SSO and authentication


Using Jamroom

Michael –

I am asking my developer how he wants to proceed. I think the first step is to see if there is any overlap in the Jamroom/Ghost universe. There is already a OneAll module.

He is, of course, going to offer this on the Ghost side, and we can explore how many Ghost users are interested in a connection to Jamroom communities. If it’s just me? Probably not.
Clay Gordon
@claygordon
04/27/24 09:45:27AM
733 posts

Suddenly very slow performance – SLOOOOOW database performace


Installation and Configuration

Michael -

Right now, all of the Database Options are set to off. (Global Config-Database Options)

Would it help to turn these on for a couple of days to see what we might find?
Clay Gordon
@claygordon
04/27/24 09:42:10AM
733 posts

Suddenly very slow performance – SLOOOOOW database performace


Installation and Configuration

Michael:

I have a lot of log tables. I just took a look at the Activity Log tab System Core - Global Config.

I have Developer Mode on. Not sure why.
Just before I took this screenshot (attached) PURGE was set to never.

I am going to set the purge to 1 day to force a purge ASAP then reset to 10 days and turn developer mode off.

What else should I consider?
DebugLogs.png DebugLogs.png - 144KB
Clay Gordon
@claygordon
04/26/24 11:19:07AM
733 posts

Suddenly very slow performance – SLOOOOOW database performace


Installation and Configuration

Brian -

The tech guy I work with – who also handles my Ghost development and hosting – is looking into local network/VM issues that may be affecting performance.

I don’t see an obvious system status dashboard so I am going to have to create a support ticket.

While it took a loooooooooooong time., table optimization was completed and I exited properly. One suggested upgrade to all of the checks would be to add an elapsed time in the completion dialog. Could be useful in diagnosing issues. The regular integrity check took about the amount of time I remember it taking.
Clay Gordon
@claygordon
04/26/24 09:48:48AM
733 posts

Suddenly very slow performance – SLOOOOOW database performace


Installation and Configuration

Brian -

db_host is 127.0.0.1 – localhost, not remote. I am on a VPS.
  2