Comments on: Technorati Suffers Major Data Accuracy Loss http://www.daviddalka.com/createvalue/2007/05/31/technorati-suffers-major-data-accuracy-loss/ Digital Strategy Solutions, Change Management Leadership, Business Speaker, Payments Technology Convergence Sat, 11 Feb 2012 00:11:18 +0000 hourly 1 http://wordpress.org/?v=3.3.1 By: The Not-So-Solid Science of Technorati | Skepticumhttp://www.daviddalka.com/createvalue/2007/05/31/technorati-suffers-major-data-accuracy-loss/comment-page-1/#comment-35451 The Not-So-Solid Science of Technorati | Skepticum Sun, 25 Nov 2007 19:09:17 +0000 http://www.daviddalka.com/createvalue/2007/05/31/technorati-suffers-major-data-accuracy-loss/#comment-35451 [...] May David Dalka reports an unusual loss in [...] [...] May David Dalka reports an unusual loss in [...]

]]> By: Technorati: Porn Peddlers and Your Blog Imagehttp://www.daviddalka.com/createvalue/2007/05/31/technorati-suffers-major-data-accuracy-loss/comment-page-1/#comment-33315 Technorati: Porn Peddlers and Your Blog Image Thu, 06 Sep 2007 14:08:27 +0000 http://www.daviddalka.com/createvalue/2007/05/31/technorati-suffers-major-data-accuracy-loss/#comment-33315 [...] Godin Joseph Jaffe Darren Rowse Mitch Joel Robert Scoble Elaine Vigneault B.L. Ochman David Dalka Andy Beal Valeria Maltoni Mack Collier Todd Andrlik Technorati Tags: bloggers, Scoble, Seth Godin, [...] [...] Godin Joseph Jaffe Darren Rowse Mitch Joel Robert Scoble Elaine Vigneault B.L. Ochman David Dalka Andy Beal Valeria Maltoni Mack Collier Todd Andrlik Technorati Tags: bloggers, Scoble, Seth Godin, [...]

]]> By: rod/techfold.comhttp://www.daviddalka.com/createvalue/2007/05/31/technorati-suffers-major-data-accuracy-loss/comment-page-1/#comment-30739 rod/techfold.com Fri, 01 Jun 2007 17:34:05 +0000 http://www.daviddalka.com/createvalue/2007/05/31/technorati-suffers-major-data-accuracy-loss/#comment-30739 I notice my authority number has been jumpy too: http://techfold.com/2007/05/25/technorati-authority-tweaks/ Fortunately, mine spiked up realtively speaking (without a linking event), so I'm less inclined to complain... good luck getting that sorted, and good job on running down the details... I notice my authority number has been jumpy too:

http://techfold.com/2007/05/25/technorati-authority-tweaks/

Fortunately, mine spiked up realtively speaking (without a linking event), so I’m less inclined to complain… good luck getting that sorted, and good job on running down the details…

]]> By: Elaine Vigneaulthttp://www.daviddalka.com/createvalue/2007/05/31/technorati-suffers-major-data-accuracy-loss/comment-page-1/#comment-30730 Elaine Vigneault Fri, 01 Jun 2007 06:11:39 +0000 http://www.daviddalka.com/createvalue/2007/05/31/technorati-suffers-major-data-accuracy-loss/#comment-30730 I'm pretty sure they don't count links from blogs that ask Technorati to stop scraping their content, too. So some link loss is due to blogs boycotting Technorati: http://www.elainevigneault.com/2007/05/27/blog-tools-how-to-boycott-technorati.html I’m pretty sure they don’t count links from blogs that ask Technorati to stop scraping their content, too. So some link loss is due to blogs boycotting Technorati:
http://www.elainevigneault.com/2007/05/27/blog-tools-how-to-boycott-technorati.html

]]> By: Billhttp://www.daviddalka.com/createvalue/2007/05/31/technorati-suffers-major-data-accuracy-loss/comment-page-1/#comment-30726 Bill Fri, 01 Jun 2007 00:54:22 +0000 http://www.daviddalka.com/createvalue/2007/05/31/technorati-suffers-major-data-accuracy-loss/#comment-30726 I seem to recall having reported a similar issue to Technorati support on March 14, 2006, and a followup email to David Sifry on March 27, 2006, after only receiving an automated response. I never got an answer. Hopefully, you've figured it out. Next problem I'll just blog about instead of sending an email to support. I seem to recall having reported a similar issue to Technorati support on March 14, 2006, and a followup email to David Sifry on March 27, 2006, after only receiving an automated response. I never got an answer. Hopefully, you’ve figured it out.

Next problem I’ll just blog about instead of sending an email to support.

]]> By: David Dalkahttp://www.daviddalka.com/createvalue/2007/05/31/technorati-suffers-major-data-accuracy-loss/comment-page-1/#comment-30725 David Dalka Fri, 01 Jun 2007 00:29:39 +0000 http://www.daviddalka.com/createvalue/2007/05/31/technorati-suffers-major-data-accuracy-loss/#comment-30725 Your comments do not correlate well with our conversation. Please call me to continue it. You should start with all the overcounted blogs in the Technorati 100 before you pick on the little guy next time. Start with - gigaom.com?reactions You still owe me at least 10 links over the past three months that have never been counted. I expect action on those. Your comments do not correlate well with our conversation. Please call me to continue it.

You should start with all the overcounted blogs in the Technorati 100 before you pick on the little guy next time. Start with – gigaom.com?reactions

You still owe me at least 10 links over the past three months that have never been counted. I expect action on those.

]]> By: Adam Hertzhttp://www.daviddalka.com/createvalue/2007/05/31/technorati-suffers-major-data-accuracy-loss/comment-page-1/#comment-30724 Adam Hertz Fri, 01 Jun 2007 00:03:02 +0000 http://www.daviddalka.com/createvalue/2007/05/31/technorati-suffers-major-data-accuracy-loss/#comment-30724 Dave, thanks for pointing out the problem, and sorry it hit your authority so hard. And thanks for the phone call this morning -- it was great talking with you about all sorts of issues. For everyone else, here's what happened. This is not really a new feature that we're testing -- rather, we noticed a data quality problem and are addressing it. Recently we noticed that several blogs were pinging us using permalinks, rather than the URL of the blog as the ping protocol intends. Our spider was fooled into interpreting these pages as blogs rather than posts. This created duplicate blogs in our database, as well as duplicate links in our indexes. Thus, any blog linked to from one of these posts had its authority improperly inflated. We have two things to do to address this -- first, stop processing pings like this, and second, cleaning out the duplicate links. We've done the first, and have started to do the second. Our very rough estimate of the impact of this issue is that 1 in 500 of the new blogs we've added is actually a post. That means that, on average, the impact of the cleanup on people's authorities will be modest. Unfortunately for Dave, a disproportionate number of the recent links to his blog fell into this category. So the cleanup wound up lowering his blog's authority more significantly. Again, thanks to Dave for his patience and problem reports. Dave, thanks for pointing out the problem, and sorry it hit your authority so hard. And thanks for the phone call this morning — it was great talking with you about all sorts of issues.

For everyone else, here’s what happened. This is not really a new feature that we’re testing — rather, we noticed a data quality problem and are addressing it.

Recently we noticed that several blogs were pinging us using permalinks, rather than the URL of the blog as the ping protocol intends. Our spider was fooled into interpreting these pages as blogs rather than posts. This created duplicate blogs in our database, as well as duplicate links in our indexes. Thus, any blog linked to from one of these posts had its authority improperly inflated.

We have two things to do to address this — first, stop processing pings like this, and second, cleaning out the duplicate links. We’ve done the first, and have started to do the second.

Our very rough estimate of the impact of this issue is that 1 in 500 of the new blogs we’ve added is actually a post. That means that, on average, the impact of the cleanup on people’s authorities will be modest.

Unfortunately for Dave, a disproportionate number of the recent links to his blog fell into this category. So the cleanup wound up lowering his blog’s authority more significantly.

Again, thanks to Dave for his patience and problem reports.

]]> By: David Dalkahttp://www.daviddalka.com/createvalue/2007/05/31/technorati-suffers-major-data-accuracy-loss/comment-page-1/#comment-30709 David Dalka Thu, 31 May 2007 18:30:05 +0000 http://www.daviddalka.com/createvalue/2007/05/31/technorati-suffers-major-data-accuracy-loss/#comment-30709 Google does this all the time. They shouldn't do it either, but I find it hard for this to be anywhere near the top of the list of things Technorati needs to fix most urgently. Google does this all the time. They shouldn’t do it either, but I find it hard for this to be anywhere near the top of the list of things Technorati needs to fix most urgently.

]]> By: Mike Maddalonihttp://www.daviddalka.com/createvalue/2007/05/31/technorati-suffers-major-data-accuracy-loss/comment-page-1/#comment-30708 Mike Maddaloni Thu, 31 May 2007 17:18:50 +0000 http://www.daviddalka.com/createvalue/2007/05/31/technorati-suffers-major-data-accuracy-loss/#comment-30708 So they're testing features on the live system?! What, in your opinion, should be the volatility percentage for links? mp/m So they’re testing features on the live system?!

What, in your opinion, should be the volatility percentage for links?

mp/m

]]> By: Pete Prestipinohttp://www.daviddalka.com/createvalue/2007/05/31/technorati-suffers-major-data-accuracy-loss/comment-page-1/#comment-30706 Pete Prestipino Thu, 31 May 2007 14:59:56 +0000 http://www.daviddalka.com/createvalue/2007/05/31/technorati-suffers-major-data-accuracy-loss/#comment-30706 I noticed this yesterday morning too Dave. I expected a few bugs with all of T's rollouts, however, this is over the top. I noticed this yesterday morning too Dave. I expected a few bugs with all of T’s rollouts, however, this is over the top.

]]>