All the news robots pick

TalkBack 1 of 8:

Next »

• Thread View
• Flat View

Just add a tag!

"AFP's complaint charges that Google infringes on its copyright by reusing its story "leads" as well as the headlines and photos."

AFP have a robots.txt that bans search engines from indexing *their* site. They sell stories to newspaper. Newspapers want Google to drive traffic to their site, so they don't ban Google with robots.txt. This annoys AFP enormously, but they apparently aren't important enough to force the Newspapers to add a noindex meta tag to the top of the page.

How about this as a fix. AFP adds a comment tag inside their text and requires the newspapers they sell to to include that tag.

Something like:

[noindex owner="afp"]News...[/noindex]

With angle brackets of course instead of square ones. So that *parts* of the page are not indexed

Let AFP choose if they don't want to be indexed and Google supports the tags and doesn't index that part of their page.

Posted by: Nigel Johnstone   Posted on: 03/25/05 You are currently: a Guest | Members login | Terms of Use

Alert moderator to an offensive message

Subscribe to this discussion via Email or RSS

SponsoredWhite Papers, Webcasts, and Downloads

• Dell Delivers Innovative Mobile at Saint Cecilia's Wandsworth Church of England School Dell Saint Cecilia's was a new school that wanted to place ICT at the core of ... Download Now
• Can your business work smarter? IBM Today, productivity is at a premium and IT budgets are at a minimum. Work ... Download Now
• Simplifying PC Support and Procurement Dell Simon Fraser University wanted to standardize its Microsoft Windows-based ... Download Now