Thursday, January 16 2003 @ 06:46 AM EST
Contributed by: tomw
Views: 3,214
Vinny and I have been working on making this site more friendly to Google and the other search engines.
We are both attacking this from different angles.
I created a simple page I call siteindex. It is just a listing of all the stories on the site with direct links to them. I created this because I noticed that Google almost always had a link only to index.php. We all know that on a good site this changes all the time. What I wanted was for google to index the stories using the actual link to the story. It worked. Google picked up the site index and the actual stories themselves have started showing up in googles index. Here is the page siteindex.php that you can place on your site. Somewhere on the front page make a link to it. It can even be in the footer -- its meant for Google not your normal visitors.
Vinny developed a way to use apache rewrite rules and the geeklog url rewrite routine to make a search engine friendly direct link to the stories. The hope here is that search engines that will not follow links like index.php?story=99234234 will follow these links and index the stories. These search engines are not as quick as google to index sites and we anticipate this will take at least a month to see if it works. Stay tuned for the results of this experiment. You can see this in action in with the (Permanant Link) on all the stories here.
If this works as expected, Vinny and I will be releasing a package containing both hacks, that should solve most search engine woes.
Authored by: Creator on
Tuesday, January 21 2003 @ 08:50 AM EST
I have the siteindex.php up on two sites, and I noticed that inktomi (sp?)
search is following that file with no problems, but the googlebot seems
not to be? Maybe add the URL Rewrite function to siteindex.php to make
it more open to such bots?
Authored by: anonymous on
Sunday, March 02 2003 @ 01:39 PM EST
Thanks for this script. Any details on what Vinny is working on? I see that you guys are trying the "Permanent links" on the current installation. Any info on how you went about doing that would be really appreciated.
Another possibility could be using those "permanent links" in your siteindex - this imo would be an excellent intermediate fix.
Authored by: Creator on
Tuesday, March 04 2003 @ 10:13 AM EST
I'm wondering if it would be possible to add indexing of static pages to
this indexing script? Also, adding an index for Geekary photos would be
nice, even more so for Filemgmt files...
Authored by: anonymous on
Sunday, March 07 2004 @ 07:24 PM EST
It seems to be fault! :-( I became a:
The requested URL /gplugs/files/siteindex.tar.gz was not
found on this server.
Please, can anybody send me the right URL?
My adress is as follows:
onno@predo-team.de