Blogdex adds gzip support
Downtime
On Blogdex exploitability
Announcing Tracking Syndication
Domain name change
MySql error
Infrastructure changes
Taking the garbage out
RSS and Uniqueness
May 2004
December 2003
August 2003
July 2003
June 2003
April 2003
March 2003
January 2003
December 2002
November 2002
October 2002
August 2002
June 2002
May 2002
April 2002
March 2002
February 2002
January 2002
December 2001
November 2001
October 2001
September 2001
August 2001
I've been grappling with data issues for the past couple of days, and for some reason was overlooking the source of the problem. The following is a plot of the spread of URLs in the blogosphere. The x-axis refers to the number of times a particular URL has been spotted (i.e. the number of weblogs it has been found on) and hte y-axis is the number of URLs in the database for that spread.
The plot continues exponentially decreasing*. The number of URLs observed on only one site is 2,224,585, while those found on at least two sites number 252,437, and three, 71,022. Without a doubt, a majority of my data (84% to be exact) lies in the form of URLs that never spread. Simply archiving these URLs that are never mentioned should reduce my data set to a tractable range. That's what I'm going to do tonight :) Hopefully then, all of the features people have come to love in blogdex will return, at least until I run up against this problem again 10 years from now**.
* for those with statistical interest, the link counts plotted on a log-log graph show a pretty convincing power-law distribution, as I have mentioned before
** I ran up against scalability issues one year after blogdex's inception, and judging by the distribution of links, this shift should reduce my dataset by an order of magnitude, meaning I should be running into the same constraints 10 years from today. With any luck, I won't still be in graduate school at that point in time.
Comments
What is the predicted number of URLs with zero links from the blogosphere? How does this tally with estimates of the total number of URLs? (Google has indexed 2.5 x 10^9.)
(And what does this mean??)
Once you find the right used cars for sale at the right price, you may contact the seller yourself to work out the details of test driving and purchasing the vehicle. Get expert advice on buying used cars. If you'd like a little more help with your purchase, Kelly Blue Book can give you real time used car prices. You may also need to get car insurance quotes so you can save money. Acura, or Dodge, or Isuzu, or Mercury, or Scion, or Hummer, or Eagle, or Jaguar, or MINI, or Subaru, or Audi, or Ferrari, or Jeep, or Mitsubishi, or Suzuki, or Bentley, or Ford, or Kia, or Nissan, or Toyota, or BMW, or Geo, or Land Rover, or Oldsmobile, or Volkswagen, or Buick, or GMC, or Lexus, or Plymouth, or Volvo, or Cadillac, or Honda, or Lincoln, or Pontiac, or Yugo, or Chevrolet, or Hummer, or Maserati, or Porsche, or Chrysler, or Hyundai, or Mazda, or Saab, or Daewoo, or Infiniti, or Mercedes-Benz, or Saturn, or Used Convertibles, or Used Hatchbacks, or Used Sedans, or Used Trucks, or Used Coupes, or Used Minivans, or Used SUVs, or Used Wagons
Please check some information about poker poker http://www.middlecay.org/ online poker online poker http://www.hasslerenterprises.org/ phentermine phentermine http://www.teambeck.org/ viagra viagra http://www.neweighweb.org/ casino casino http://www.hdic.org/ online casino online casino http://www.hometeaminspection.org/ texas holdem texas holdem http://www.mor-lite.org/ texas hold em texas hold em http://www.reservedining.org/ pacific poker pacific poker http://www.paramountseedfarms.org/ empire poker empire poker http://www.parkviewsoccer.org/ party poker party poker http://www.tclighting.org/ cialis cialis http://www.sportingcolors.org/ diet pills diet pills http://www.psychexams.org/ tramadol tramadol http://www.stories-on-cd.org/ play poker play poker http://www.marshallyachts.org/ turbo tax turbo tax http://www.lvcpa.org/ pacific poker pacific poker http://www.rifp.org/ texas hold em poker texas hold em poker http://www.suttonjames.org/ poker rules poker rules http://www.pagetwo.org/ credit cards credit cards http://www.tecrep-inc.org/ hoodia hoodia http://www.rethyassociates.org/ carisoprodol carisoprodol http://www.ingyensms.org/ payday loans payday loans http://www.krantas.org/ buy phentermine buy phentermine http://www.devilofnights.org/ generic viagra generic viagra http://www.ansar-u-deen.org/ h r block h r block http://www.azian.org/ buy viagra buy viagra http://www.twinky.org/ texas holdem poker texas holdem poker http://www.atlanta2000.org/ weight loss diet pills weight loss diet pills http://www.catchathief.org/ weight loss weight loss http://www.nehrucollege.org/ casino casino http://www.casinoequipmentsalesandrental.com/ ... Thanks!!!
Please check out some information about internet poker internet poker http://internet-poker.fidelityfunding.net/ party poker party poker http://poker-party.fidelityfunding.net/ poker tournament poker tournament http://poker-tournament.fidelityfunding.net/ poker rooms poker rooms http://poker-rooms.fidelityfunding.net/ texas hold em poker texas hold em poker http://texas-hold-em-poker.fidelityfunding.net/ no limit texas hold em no limit texas hold em http://no-limit-texas-hold-em.fidelityfunding.net/ holdem holdem http://holdem.fidelityfunding.net/ play poker play poker http://play-poker.fidelityfunding.net/ absolute poker absolute poker http://absolute-poker.fidelityfunding.net/ holdem poker holdem poker http://holdem-poker.fidelityfunding.net/ poker game poker game http://poker-game.fidelityfunding.net/ three card poker three card poker http://three-card-poker.fidelityfunding.net/ pai gow poker pai gow poker http://pai-gow-poker.fidelityfunding.net/ online poker rooms online poker rooms http://online-poker-rooms.fidelityfunding.net/ paradise poker paradise poker http://paradise-poker.fidelityfunding.net/ online poker games online poker games http://online-poker-games.fidelityfunding.net/ texas poker texas poker http://texas-poker.fidelityfunding.net/ celebrity poker celebrity poker http://celebrity-poker.fidelityfunding.net/ learn to play poker learn to play poker http://learn-to-play-poker.fidelityfunding.net/ online video poker online video poker http://online-video-poker.fidelityfunding.net/ hold em poker hold em poker http://hold-em-poker.fidelityfunding.net/ online poker game online poker game http://online-poker-game.fidelityfunding.net/ on line poker on line poker http://on-line-poker.fidelityfunding.net/ casino poker casino poker http://casino-poker.fidelityfunding.net/ texas hold em online texas hold em online http://texas-hold-em-online.fidelityfunding.net/ free texas hold em free texas hold em http://free-texas-hold-em.fidelityfunding.net/ free online texas hold em free online texas hold em http://free-online-texas-hold-em.fidelityfunding.net/ free texas hold em poker games free texas hold em poker games http://free-texas-hold-em-poker-games.fidelityfunding.net/ free texas hold em online play free texas hold em online play http://free-texas-hold-em-online-play.fidelityfunding.net/ hold em hold em http://hold-em.fidelityfunding.net/ texas hold em poker game texas hold em poker game http://texas-hold-em-poker-game.fidelityfunding.net/ texas holdem online texas holdem online http://texas-holdem-online.fidelityfunding.net/ free online texas holdem free online texas holdem http://free-online-texas-holdem.fidelityfunding.net/ texas holdem poker game texas holdem poker game http://texas-holdem-poker-game.fidelityfunding.net/ play texas holdem play texas holdem http://play-texas-holdem.fidelityfunding.net/ ...
Hello folks nice blog youre running
What is freedom of expression? Without the freedom to offend, it ceases to exist.
I am interested in the scale-free nature of blogs... anyone looking into cascade effects?