blog documentation FAQ followers forum marketplace services youtube

solved Problem with google sitemaps

The Jamroom Network » Forum » Off Topic » Page » Problem with google sitemaps
Eddy
Eddy
@eddy
10 years ago
479 posts
According to google tools, there was 3 sitemap warnings with my site.

It was trying to access the sitemaps from /data/media/0/0/ but robots.txt didn't allow acess to the data directory, I have fixed the issue, but now I have a bigger problem, instead of waiting for google to crawl my site again with the now fixed robots.txt file, I had a brain cramp and decided to delete my old sitemap.xml on google tools and resubmit a new one, the end result is my site went from having 440 pages indexed to just having 41 now in two days :(, can anyone tell me if this is normal and if it's just part of the process with google?
updated by @eddy: 03/26/14 08:40:48AM
michael
@michael
10 years ago
7,717 posts
who knows with google.
Eddy
Eddy
@eddy
10 years ago
479 posts
Now I'm debating whether to use a sitemap or not :P.
SteveX
SteveX
@ultrajam
10 years ago
2,584 posts
Probably best to use a sitemap if you want to be indexed by google.


--
¯\_(ツ)_/¯ Education, learning resources, TEL, AR/VR/MR, CC licensed content, panoramas, interactive narrative, sectional modules (like jrDocs), lunch at Uni of Bristol. Get in touch if you share my current interests or can suggest better :)
Eddy
Eddy
@eddy
10 years ago
479 posts
Well, google has updated my robots.txt on google tools, it shows correctly now, but I'm submitting 544 pages and only 41 are getting indexed, where before I was submitting 480 and 440 where getting indexed, where have I gone wrong? Am I being penalized? Thats the only thing I can think of.
updated by @eddy: 02/18/14 07:08:02AM
Eddy
Eddy
@eddy
10 years ago
479 posts
Update: I have been reading a bit on this and since the sitemap url was blocked in the old robots.txt file, it can take up to 2 weeks for google to index the now unblocked url, so patience is the key here, just thought I would let everyone know in case you have done the same :).
SteveX
SteveX
@ultrajam
10 years ago
2,584 posts
I've done the same, everyone knows impatience. Especially google - I think they play on that a bit with their secret alg-rhythms and strange black cube ships.

Nobody can tell you if you are being penalised apart from google, and google won't tell you.

Why? Because they want you to make the sitemap, use their stuff, and rely on them. They don't care if you don't, they have plaenty of users. So a marketing strategy, a bit like apple, playing on people being impatient, applying attention to the things they are impatient about, encouraging insecurity as a means of gaining mindshare. Getting onboard with that is optional, but a sitemap is not.

2014 you need a sitemap. Just in case a sitemap becomes essential in 2015.


--
¯\_(ツ)_/¯ Education, learning resources, TEL, AR/VR/MR, CC licensed content, panoramas, interactive narrative, sectional modules (like jrDocs), lunch at Uni of Bristol. Get in touch if you share my current interests or can suggest better :)
brian
@brian
10 years ago
10,148 posts
You know what's funny, is that Google has no need of a sitemap - they're crawler will find all pages on your site as long as there is at least one link to the page.


--
Brian Johnson
Founder and Lead Developer - Jamroom
https://www.jamroom.net
SteveX
SteveX
@ultrajam
10 years ago
2,584 posts
If I had that much money I'd be diversifying as well! (whilst increasing users and brand recognition).

Google don't need much at all at this point.


--
¯\_(ツ)_/¯ Education, learning resources, TEL, AR/VR/MR, CC licensed content, panoramas, interactive narrative, sectional modules (like jrDocs), lunch at Uni of Bristol. Get in touch if you share my current interests or can suggest better :)
michael
@michael
10 years ago
7,717 posts
switch to duckduckgo.com as a search engine. Make google work just that little bit harder to know what your doing.
SteveX
SteveX
@ultrajam
10 years ago
2,584 posts
duckduckgo is my default. But I do switch to chrome for a google search for most things related to code - I find I find my answers quicker (about code things) using google. (could just be a luck thing though)


--
¯\_(ツ)_/¯ Education, learning resources, TEL, AR/VR/MR, CC licensed content, panoramas, interactive narrative, sectional modules (like jrDocs), lunch at Uni of Bristol. Get in touch if you share my current interests or can suggest better :)
Eddy
Eddy
@eddy
10 years ago
479 posts
The good news is 2 days after I fixed my robots.txt file, the 440 pages have been indexed again :), now I have to wait for the new pages to be as well :).
SteveX
SteveX
@ultrajam
10 years ago
2,584 posts
Maybe the jamroom team put in a good word for you. It can take much, much longer than that to be reindexed.


--
¯\_(ツ)_/¯ Education, learning resources, TEL, AR/VR/MR, CC licensed content, panoramas, interactive narrative, sectional modules (like jrDocs), lunch at Uni of Bristol. Get in touch if you share my current interests or can suggest better :)
Eddy
Eddy
@eddy
10 years ago
479 posts
Yeah Steve, from what I have heard it can take from weeks to even a few Months, so I guess got lucky.

Tags