{"id":245,"date":"2006-09-13T21:16:42","date_gmt":"2006-09-13T12:16:42","guid":{"rendered":"https:\/\/regex.info\/blog\/2006-09-13\/245"},"modified":"2007-12-26T13:46:21","modified_gmt":"2007-12-26T04:46:21","slug":"better-search-engine-indexing-of-my-blog","status":"publish","type":"post","link":"https:\/\/regex.info\/blog\/2006-09-13\/245","title":{"rendered":"Better Search-Engine Indexing of My Blog"},"content":{"rendered":"\n<p>\n\nEvery so often I look at my server logs to see <a\nhref=\"\/blog\/2006-03-29\/167\">by what means people find\ntheir way<\/a> to pages on my blog. <span class='nobr'>One thing<\/span> that's long bothered me is\nthat people's Yahoo! and Google! searches often bring them to my blog's\nhome page, rather than to the post-specific page containing the text that\nwas matched by the their search.\n\n<\/p>\n   \n<p>\n\nFor example, my <a href=\"\/blog\/2006-09-13\/244\">previous\npost<\/a> contains the text &#8220;There's <span class='nobr'>a camera<\/span> collector in\nMassachusetts....,&#8221; and because my blog home page contains my five\nmost-recent posts, that post and its text will stay on the home page until\nI've written <span class='nobr'>a few<\/span> more posts. <span class='nobr'>If the search<\/span> engines index my blog home\npage, someone searching for, say, &#8220;camera collector&#8221; will be\ndirected to my blog home page. That's all fine and well.... until <span class='nobr'>a few<\/span>\ndays from now and that post has been bumped off the home page, at which\npoint users following <span class='nobr'>a link<\/span> from <span class='nobr'>a search<\/span>-engine search-result page end up\nat the then-current home page and wonder where their content is.\n\n<\/p><p>\n\nThe solution for this is fairly simple: tell the search engines to index\nonly the permalink pages (the individual per-post pages), and not the blog\nhome page, the index continuation pages, category pages, etc.\n\n<\/p><p>\n\nI finally got off my rear and implemented this on my blog, so starting\ntoday, the search engines won't index my non-post pages. What got me going\nwas Fazal Majid's excellent writeup on blogging etiquette, <a\nhref=\"http:\/\/www.majid.info\/mylos\/weblog\/2006\/04\/09-1.html\"><i>How to Show\nRespect for Your Readers<\/i><\/a>, which <span class='nobr'>I found<\/span> today (having only\ndiscovered his <a href=\"http:\/\/www.majid.info\/mylos\/weblog\/\">generally\nexcellent writing<\/a> yesterday). <span class='nobr'>I'd already<\/span> known the general approach on\nhow to implement the &#8220;don't index me!&#8221; directives (one soaks up\nthese things working for Yahoo! for eight years), but I'd been too lazy to\nlook up the actual incantation needed. Fazal kindly included it in his\npost, and so I'd lost my last excuse for not going ahead and getting it\ndone.\n\n<\/p><p>\n\nHaving done this now, <span class='nobr'>I'm sure I<\/span>'ll see my blog's Google PageRank go\n\nto zero (from it's currently dizzying value of <b>5<\/b>), but as the title\nof Fazal's post indicates, it's all about respecting the reader.\n\n<\/p><p>\n\nThere's real satisfaction in seeing that someone did <span class='nobr'>a search<\/span> on\nsuch-and-such, and it brought them to <span class='nobr'>a page<\/span> I've written exactly on that\nsubject. <span class='nobr'>My photo<\/span> pages are particularly common, with people arriving via\nYahoo! and Google! searches for\n\n&#8220;<a href=\"\/blog\/2005-11-29\/105\" class='quiet'>japan temples<\/a>&#8221;,\n&#8220;<a href=\"\/blog\/2005-11-16\/101\" class='quiet'>presidential limousine<\/a>&#8221;,\nand\n&#8220;<a href=\"\/blog\/2006-04-09\/176\" class='quiet'>snowfall<\/a>&#8221;\n\n(to list just <span class='nobr'>a few<\/span> actual examples from the hundreds that arrive every\nday).\n\n<\/p><p>\n\nEven more so than with the photos, it's really gratifying to see searches like:<small>\n<br\/>&nbsp;&nbsp;&nbsp;&nbsp;&#8220;nikon d200 compact flash tested&#8221;\n<br\/>&nbsp;&nbsp;&nbsp;&nbsp;&#8220;transcend compact flash for Nikon d200&#8221;\n<br\/>&nbsp;&nbsp;&nbsp;&nbsp;&#8220;test transcend flash&#8221;\n<br\/>&nbsp;&nbsp;&nbsp;&nbsp;&#8220;transcend 4GB 120x&#8221;\n<br\/>&nbsp;&nbsp;&nbsp;&nbsp;&#8220;transcend 4Gb CF card&#8221;\n<br\/>&nbsp;&nbsp;&nbsp;&nbsp;&#8220;transcend compact flash review&#8221;\n<br\/>&nbsp;&nbsp;&nbsp;&nbsp;&#8220;Transcend 120x Compact Flash Card review&#8221;<\/small>\n<br\/>\nland on my &#8220;<a class='quiet'\nhref=\"\/blog\/2006-01-14\/132\">Timing <span class='nobr'>a Transcend<\/span> 80x 4GB\nCompact Flash card with <span class='nobr'>a Nikon<\/span> D200<\/a>&#8221; and\n\n&#8220;<a class='quiet' href=\"\/blog\/2006-02-08\/145\">Update\non Transcend 4GB 120x compact-flash card<\/a>&#8221; posts, as happened\ntoday. Those having done the search certainly found exactly what they were\nlooking for.\n\n<\/p><p>\n\nMost of my posts are just for keeping overseas family up to date on our\nlives here in Kyoto, but some of my posts have <span class='nobr'>a broad<\/span> appeal, and I'm\nhappy to have them read and (hopefully) be helpful.\n\n<\/p>\n\n\n\n\n\n","protected":false},"excerpt":{"rendered":"<p> Every so often I look at my server logs to see by what means people find their way to pages on my blog. One thing that's long bothered me is that people's Yahoo! and Google! searches often bring them to my blog's home page, rather than to the post-specific page containing the text that was matched by the their search. <\/p> <p> For example, my previous post contains the text \"There's a camera collector in Massachusetts....,\" and because my blog home page contains my five most-recent posts, that post and its text will stay on the home page until [...]","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1,4],"tags":[],"_links":{"self":[{"href":"https:\/\/regex.info\/blog\/wp-json\/wp\/v2\/posts\/245"}],"collection":[{"href":"https:\/\/regex.info\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/regex.info\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/regex.info\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/regex.info\/blog\/wp-json\/wp\/v2\/comments?post=245"}],"version-history":[{"count":0,"href":"https:\/\/regex.info\/blog\/wp-json\/wp\/v2\/posts\/245\/revisions"}],"wp:attachment":[{"href":"https:\/\/regex.info\/blog\/wp-json\/wp\/v2\/media?parent=245"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/regex.info\/blog\/wp-json\/wp\/v2\/categories?post=245"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/regex.info\/blog\/wp-json\/wp\/v2\/tags?post=245"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}