duplicate photo merge suggestion

soaringeagle
@soaringeagle
10 years ago
3,304 posts
nings system was stupid everytime u added a photo comment with the same photo it was saved in its own space as a seoperate photo this included all the 'default' profile photos even though they were the same they were all treated as diferent photos , needing to be downloaded and cached seperately

since jr uses the image suport that lets u pick a photo out of datastore and re-use the same photos
it would be a huge space saver if something was writen that would compare all photos with the same names and sizes comparing the checksums if they indeed are identical files keep only 1 single copy and re-write all references to that file to point to that 1 file

this at least inthe members section would reduce the overall size to about 1/10th or so
but i believe profile photos in every section are stored as seperate files
so if thats the case the overall space saved could be dramatic

file this as a future request


--
soaringeagle
head dreadhead at dreadlocks site
glider pilot student and member/volunteer coordinator with freedoms wings international soaring for people with disabilities

updated by @soaringeagle: 03/05/15 03:04:15AM
paul
@paul
10 years ago
4,335 posts
The Delete Media tool will clear out all imported images and media files, so that should reduced the total used disk space by up to a half.


--
Paul Asher - JR Developer and System Import Specialist
soaringeagle
@soaringeagle
10 years ago
3,304 posts
yea but that doesnt help the fact that theres probably about 40,000 of the exact same file over and over and over again and instead of being cached and served as 1 file in 20 locations in a page it has to be served as 20 seperate files

not denying the the delete media tools a huge help just saying ning were idiots and if every duplicate file was reduced to 1 file and all references to it pointed to that 1 file it would drasticly reduce disk usage and download sizes

it is a shame that nings stupidity would add to your workload though
so just consider it a maybe someday way down the line thing and not an imediate need

but would help cut storage costs as well as improve overall performance


--
soaringeagle
head dreadhead at dreadlocks site
glider pilot student and member/volunteer coordinator with freedoms wings international soaring for people with disabilities
paul
@paul
10 years ago
4,335 posts
I'm a bit unclear as to what all these duplicated photos are in the archive?
My understanding is that what should be left after deleting imported media and images is only what if referenced in the text strings, so unless someone was uploading blogs, say, with the same image every time, there should be no duplications.


--
Paul Asher - JR Developer and System Import Specialist
brian
@brian
10 years ago
10,148 posts
soaringeagle:
yea but that doesnt help the fact that theres probably about 40,000 of the exact same file over and over and over again and instead of being cached and served as 1 file in 20 locations in a page it has to be served as 20 seperate files

Why would you have 40,000 copies of the same image? I'm not understanding how that has happened unless you have like a million members and they all decide to post a photo of the SAME grumpy cat image.. ?


--
Brian Johnson
Founder and Lead Developer - Jamroom
https://www.jamroom.net
soaringeagle
@soaringeagle
10 years ago
3,304 posts
because every image even if its the same image over and overs saved in its own extrenmely long url so when you have the default profile photo and 10,000 of the 14,000 never changed it thats 10,000 of the same photo
then i use a welcome image to welcome every member rthat doesnt need imediate help so although ive changed it maybe 4 times thats still abiout 3000 or more copies of that 1 image

then theres when someone posts an image in thier gallery then posts it as a reference in a discussion
etc wetc
its not that theres 40,000 copies of 1 image just 5,000 of 1 6,000 of another
im not even sure but i kinda have a feeling that the diferent profile images on -postsarent the same 1 reused but diferent copies of it
id have to verify
but as im import8ing members discussions ..everything u see the same file names over and over and over and over each being imported as a seperate file

the default profile image alone probably wastes 10 gigs

they just use a really stupid system wich ive complained about for years


--
soaringeagle
head dreadhead at dreadlocks site
glider pilot student and member/volunteer coordinator with freedoms wings international soaring for people with disabilities
paul
@paul
10 years ago
4,335 posts
I'm still not getting this. Even if 10000 members never updated their profile image so that there are 10000 identical default images in the archive, each one would be imported into JR when the member profile was created, so should be deleted when running the Delete Media tool. Is that not happening?


--
Paul Asher - JR Developer and System Import Specialist
brian
@brian
10 years ago
10,148 posts
Jamroom does not work like Ning in regards to images. If a user does not have a user/profile image, there is only 1 copy of the "no image" default image.


--
Brian Johnson
Founder and Lead Developer - Jamroom
https://www.jamroom.net
soaringeagle
@soaringeagle
10 years ago
3,304 posts
yes i realize that but that doesnt affect the 1,000 from ning that were imported as separate files

im saying jamrooms brilliant nings idiotic

and someday..not today b7ut someday in the future it woulkd be a great help to cleanup nings mess


--
soaringeagle
head dreadhead at dreadlocks site
glider pilot student and member/volunteer coordinator with freedoms wings international soaring for people with disabilities
Strumelia
Strumelia
@strumelia
10 years ago
3,603 posts
"Even if 10000 members never updated their profile image so that there are 10000 identical default images in the archive, each one would be imported into JR when the member profile was created, so should be deleted when running the Delete Media tool."
"Jamroom does not work like Ning in regards to images. If a user does not have a user/profile image, there is only 1 copy of the "no image" default image."
................

Soaring, I would think that between the above two scenarios working from both ends of the issue, that it will fix both the previous duplicated profile images, and prevent future duplicates as well. Not so? Doesn't the "delete redundant media tool" get rid of the 1,000s of extra profile image copies when you run it?



--
...just another satisfied Jamroom customer.
Migrated from Ning to Jamroom June 2015

updated by @strumelia: 01/13/15 11:05:12AM
brian
@brian
10 years ago
10,148 posts
Does the image name in the Archive JSON show as being like a "default" image? Some way that we can filter it out on import?


--
Brian Johnson
Founder and Lead Developer - Jamroom
https://www.jamroom.net
soaringeagle
@soaringeagle
10 years ago
3,304 posts
no unfortunately i think it shows as dreadylion01.jpg then theres welcome1.png welcome2.png etc
theres really no way except to compare duplicate names with same file sizes to a checksum to be sure they are really duplicares then re-write the codes to all point to 1 file instead of 10,000
i knowq its a pain in the ass

and i fully understand if u never want to be bothered

just really drawing attention to the way ning did things and how it could save a ton of space as well as load times if all the duplicates were merged into 1 file


i wish it was that easy
but thats why i said file it away for distant future consideration


--
soaringeagle
head dreadhead at dreadlocks site
glider pilot student and member/volunteer coordinator with freedoms wings international soaring for people with disabilities

Tags