bug (i think) report imzage cache still not clearing correctly

soaringeagle
@soaringeagle
9 years ago
3,304 posts
no matter what time i set to clear image cache it doesn't clear correctly
my home partition was just at 94%!!!!!!
i manualy did clear image cache it went to 84%

i then went into ssh, went to data/cache and used rm -rf *
it went to 38%

when it thinks it is clearing cache it is not deleting the files off the drive, just no longer referencing them (at least that's what i think must be going on)

this is kinda a serius issue as it gobbles up 400 gigs in about a week or 2
and the only way to fix it is to delete them through ssh

i suppose i could also set up a cron job to do it on a schedule
but would be better to fix the underlying problem

the reason most sites might not be experiencing this issue as severely as i do is because i run a sitemap crawler nonstop that always moves all images into cache evrey 4 days

i used to have it set at 30 days before clearing czache so all images were always in cache and still it only added a few percent to the home use (i use a separate drive for media)

it would use about 100 gigs for media cache

but now it says its using 100, but in reality is using over 400
because 300 were "cleared' but not deleted




--
soaringeagle
head dreadhead at dreadlocks site
glider pilot student and member/volunteer coordinator with freedoms wings international soaring for people with disabilities

updated by @soaringeagle: 05/03/16 03:51:52PM
michael
@michael
9 years ago
7,793 posts
Try:
ACP -> CORE -> IMAGE CORE -> TOOLS -> RESET IMAGE CACHE
your-site.com/image/cache_reset

Could be that you're just getting the template files and stuff and missing the images
soaringeagle
@soaringeagle
9 years ago
3,304 posts
i did reset image cache through the system menu
like i said its deleting the image cache that it recognizes as current image cache
but the auto delete images only seems to remove any reference to the files and not the files themselves
after doing delete image cache it said there was nothing in image cache in dashboard (almost nothing a few files that were moved there since deleting)

but it wasn't till i deleted everything in the cache directory that it removed all the excess files (that were in image cache mostly)


if it helps i can give you serer and admin access to see whats going on, i have it now set to 24 hours when i used to always set it to 30 days
it never gobbled up all my drive space like this till the new beta image core
somehow the nightly mainenabce is not properly deleting the files


--
soaringeagle
head dreadhead at dreadlocks site
glider pilot student and member/volunteer coordinator with freedoms wings international soaring for people with disabilities
michael
@michael
9 years ago
7,793 posts
I just tried it here,
ACP -> CORE -> CORE -> TOOLS -> RESET CACHES

Deleted all of the template files, then

ACP -> CORE -> IMAGE CORE -> TOOLS -> RESET IMAGE CACHE

Cleared out all of the images.

A lot of the templates came back instantly because thats how a cache works.
soaringeagle
@soaringeagle
9 years ago
3,304 posts
i don't know whats going on then
cause like i said, it filled my ssd drive to 94%
i cleared cache and only 10% was cleared
i went into the cache folder and deleted everything and then it was down to 38%
hundreds of gigs were not being cleared properly

i was watching what it did to the drive space, and how long the ssh command took to delete it all

last time ..a few weeks back i tried deleting it all through ftp, it was taking hours'
after deleting cache and image cache there was a hell of a lot of fles left behind

you should already have my server and admin access
if you need it again let kme know
give it some time to build up, ill let you know when the drive reaches 75%
you can clear caches then take a look in cache and see whats still there

is there any sort of cron trickery to clear files from cache folder that have not been accesed in so many days'

it really seems like it has to be storing multiple copies of the same exact file


--
soaringeagle
head dreadhead at dreadlocks site
glider pilot student and member/volunteer coordinator with freedoms wings international soaring for people with disabilities
michael
@michael
9 years ago
7,793 posts
Yes there is code in there to clear out files from the cache that haven't been used in a while.

The only reason (I can think of) you should be needing to clear out the cache is because you've changed something and want to see it in action now instead of waiting for the cache to time out.
brian
@brian
9 years ago
10,149 posts
I've got an update in the next version of the Image Core module that should help - I've moved the cache clearing to a queue worker. Most likely what is happening here is that the process is timing out (30 seconds) before it can remove all the needed cache images. Moving this to a queue worker will let it fully remove the entire cache without worrying about it timing out.


--
Brian Johnson
Founder and Lead Developer - Jamroom
https://www.jamroom.net
soaringeagle
@soaringeagle
9 years ago
3,304 posts
awesome that's exactly the cause cause it does take over 30 sec to clear


--
soaringeagle
head dreadhead at dreadlocks site
glider pilot student and member/volunteer coordinator with freedoms wings international soaring for people with disabilities

Tags