Hi everyone,
I'm having problems with my site getting indexed. I thought a hackernews member might could help me.
My site's holding about 600k player statistics and almost none of them are getting indexed. I'm not exactly sure what the reason is. About a week ago google crawled and indexed 300k pages in about 2-3 days but a few days later they dropped everything again.
We have more content than our competitor and the players statistic page is also liked and shared by visitors a lot.
Our competitor is doing quite well, he got about 4.6m of his player statistics indexed.
Cleaning up the HTML a bit, using meta title and descriptions, properly redirecting old site structures to the right place (301) didn't help, google still doesn't bother about indexing the player statistics.
Although they're still crawling some of them but they choose not show them.
I thought it might be because of duplicate content so I moved the languages from the structure (e.g. /kr/ ) to a sub domain (e.g. kr.riot5.com).
I'm not quite sure if my site's under a penalty or if there's something wrong with my content.
I feel a bit overwhelmed of all the possible reasons that might cause google to stop indexing my page and why they once indexed a lot.
I would be really grateful if someone could help me finding the problem.
The site's at http://www.riot5.com/
Re-inclusion requests here (pretty much your only way to ask Google anything easily, but responses aren't guaranteed) https://www.google.com/webmasters/tools/reconsideration?pli=...
Or try the Webmaster forums, where Google folk apparently post every once in a while, but it's mainly a clusterfuck of people hijacking your problem with their own questions, and solutions being unreliably crowdsourced.
Remember: Google moves in mysterious ways. We cannot understand their arcane techniques for we are not worthy.