solved understanding and debugging the core update process

situation: 2 sites on same server, neither would update the core both update everything else
1 site, the big site did after awhile upload some folders and files
upgrading to php 7 may have helped slightly
the other site no files are ever transfered

solution 1 download source code files upload files within core to the core release 606 folder run integrity check..and fixed (on bigsite)
site that never transfered any files i attempted variations of the same
upload core folder after renaming it to core release 606 (with proper caps etc)
fail
download core release 606 from 1 site upload to other fail
rename core 606 to 606 bak to see if a new folder would ever be created..fail
zipped core from source uploaded via file manager extracted to 606 folder
fail

so to fully understand the step by step rocess of updating and debugging the failures
please explain in detail how it works
my assumption is
1 transfer files
2 make any db alterations needed
3 update symlink

why did 1 transfer some files the other none i get a server disconnect notice sometimes after 10 min or so..inconsistetly
on the 1 site no folders or files are transfered (ah wait, is a compresed file sent then decompresed?)

why would uploading then running integrity check work only on the site that partially transfered files but not the 1 that nothing transfered on?

every other module transfers easily
so what are the 1st steps taken during update..then next and next (it appears to fail right away even though it doesnt generate any errors for a long time)

is there any error debug code i can add to any file that will show exactly whats going on during the update (verbose) and identify whats causing the core to not update

and finaly since 1 of you stated that they had that issue till upgrade to php 7 what php settings aee u using that maybe the cause




--
soaringeagle
head dreadhead at dreadlocks site
glider pilot student and member/volunteer coordinator with freedoms wings international soaring for people with disabilities
updated by @soaringeagle: 04/27/17 11:10:15PM

There's definitely something up with your server - this is not a marketplace or jamroom.net issue.

How it works:

1) Your marketplace module contacts jamroom.net and tells it the versions you are currently running
2) It responds with an UPDATE version, a URL to download the update from and an MD5 checksum of the file
3) the marketplace module on your site downloads the file to a temp location and verifies the checksum
4) it unzips the file and moves it to the versioned directory in the /modules directory
5) It swings the symlink to the new directory
6) It triggers the verify_module event so the updated module can do any work it needs as part of the upgrade process

Let me know if that helps.


--
Brian Johnson
Founder and Lead Developer - Jamroom
https://www.jamroom.net

it potentially does! but need a tiny bit of clarification 9it confirms a suspicion)
you say it transfers then unzips to the proper location wheres the zipped file transfered to? (and file size) im thinking either the zip doesnt fully transfer or fails the checksum
finding the location of the zip might help


--
soaringeagle
head dreadhead at dreadlocks site
glider pilot student and member/volunteer coordinator with freedoms wings international soaring for people with disabilities

Try this - from your server, while logged in as the web user, run this:


And see how fast it downloads.


--
Brian Johnson
Founder and Lead Developer - Jamroom
https://www.jamroom.net

If it fails the checksum it will tell you. Since you've not reported you get a checksum error, then that's no happening.


--
Brian Johnson
Founder and Lead Developer - Jamroom
https://www.jamroom.net

so far its working fine though the transfer rates lower then expected server to server do you have alot of strain on the server now or a throttle limit per request?
100-200 + k a sec isn't very fast i would expect at least few m a sec


--
soaringeagle
head dreadhead at dreadlocks site
glider pilot student and member/volunteer coordinator with freedoms wings international soaring for people with disabilities

watching it low 60k a sec high slightly under 300k a sec (i restarted it)
average seems about 120-130k a sec will let you know when finished


--
soaringeagle
head dreadhead at dreadlocks site
glider pilot student and member/volunteer coordinator with freedoms wings international soaring for people with disabilities

No - there's no strain. I downloaded that file from my system here and get 30mb/s. I'm pretty certain this is the root of your issue - you've got some downstream throttling going on, or your hosting provider is not giving you a good connection to the wider net - i.e. they are are only using a single backbone provider such as Cogent, which is a "cheap" typically oversold provider that many low cost hosting provides go with.


--
Brian Johnson
Founder and Lead Developer - Jamroom
https://www.jamroom.net

2017-01-27 11:31:49 (142 KB/s) - “100MB.zip.1” saved [104857600/104857600]

calling colocation place to run a network test between servers


--
soaringeagle
head dreadhead at dreadlocks site
glider pilot student and member/volunteer coordinator with freedoms wings international soaring for people with disabilities

they have multiple redundant backbone providers and alow you to use any others you choose
they are running a test on it
in a few days i will be getting a free much more powerful server with an awesome connection solikely it will be fixed hen either way

theres no way that its a universal issue as my sitemap crawler alone often hits it at 1.2 m a sec (we have crappy internet here thats about the best we get) so its gotta be in the connection between jr and my server since i can transfer alot faster from my home pc to server.. at the max speed my crappy connecdtion alows

but they are testing it will let ya know later
thanks this has been a big help (i think)


--
soaringeagle
head dreadhead at dreadlocks site
glider pilot student and member/volunteer coordinator with freedoms wings international soaring for people with disabilities