rc3.org Strong opinions weakly held

Posts Tagged ‘scalability’

How Twitter uses Hadoop and Pig

In Commentary on 25 November 2009 tagged mapreduce, scalability with no comments

I confess that I have never fully immersed myself into the world of Hadoop and map/reduce, but I am very interested in them. Tony Bain does a good job of explaining how Twitter is using Hadoop (and Pig, a scripting language for Hadoop) for analytics. It’s a great explanation of a practical business application for map/reduce for those of us who are still trying to get it.

Links from March 30th

In Commentary on 30 March 2009 tagged browsers, cars, database, design, food, links, scalability, security, Web development with no comments

• Jason Santa Maria: Reflections on Layer Tennis. Really, really great post on participating in Layer Tennis. I loved this.
• SF Gate: Food, service uneven at Absinthe. A review of Top Chef participant Jamie “Top Scallop” Lauren’s San Francisco restaurant by Michael Bauer. Brutal.
• John Resig: Determining Browser Market Share. Deep thoughts on measuring browser market share.
• New York Times: Vast Spy System Loots Computers in 103 Countries. Uncovered by researchers at the University of Toronto. Also read this followup from James Fallows.
• Goodnight, Raleigh: Memorializing a Magnificent Oak and “The Great Pacificator”. A little local knowledge about Raleigh.
• The Economist: Germany’s racy auto banks.
• Tim Bray: On Rack. A nice, short introduction to Rack, the glue that provides an interface from Ruby applications to Web servers.
• MySQL Performance Blog: PROCEDURE ANALYSE. Very useful for optimizing your MySQL schema.
• Vanessa Fox: Transforming the Relationship Between Citizens and Government: Making Content Findable Online. Advice on making data more searchable, pertinent to anyone publishing online.
• Last.fm: Last.fm Radio Announcement. Users not in the US, UK, or Germany have to pay up to listen. Music licensing sucks.
• LastFM Firefox Extension. Scrobbles Pandora tracks to Last.fm, for people like me who feel weird anytime they listen to a song and the data isn’t transmitted to Last.fm.
• intranation: Development virtual machines on OS X using VMWare and Ubuntu. A clever alternative to MacPorts or Fink.
• Trustico: Buy GeoTrust, VeriSign SSL Certificates At Cheaper Prices – Strategic Partner United States. I hate paying for certificates. These guys are cheap.

Links for April 9

In Commentary on 9 April 2008 tagged Google, human rights, links, politics, Python, scalability, security, sports, Web development with 3 comments

• Stephen O’Grady: Clouds Rolling In: The Google App Engine Q&A. Great rundown.
• Bruce Schneier: The Feeling and Reality of Security. Understanding the differences and how to manage them is the key to successful security policy.
• FP Passport: The Olympic torch’s mysterious companions. The torch escorts are members of a paramilitary group sponsored by the Chinese government. Their comrades are in Tibet suppressing dissent by force right now. I’m glad the Olympics are going to be in China because it has served to remind the world of the brutality of the Chinese regime.
• Continuing Intermittent Incoherency: App Engine: Most Of The Stuff I Want, None Of The Stuff I Don’t. Another take on Google App Engine.

Links for April 8

In Commentary on 8 April 2008 tagged blogs, food, Google, hosting, links, media, politics, Python, scalability, security, spam, sports, TV, Web development, WordPress with no comments

• gourmet.com: Betting the Farm. Great article on agriculture policy and how one family farm in South Dakota is bucking the trend of cashing in on ethanol money and government subsidies.
• Rogers Cadenhead: Washington Post Wins Another Phony Pulitzer. I loved the Washington Post article about the violinist planted in the DC subway, but Rogers argues that it’s more reality TV than news reporting.
• Ian Kallen: The WordPress Security Cancer. Outdated WordPress installations are being exploited to distribute spam. If you run it, be sure to keep your installation up to date.
• Dave Winer: Early notes on GoogleApps (Scripting News). I have my own thoughts on this but I haven’t gotten around to posting them.
• Ars Technica: Gmail being throttled, blocked by some anti-spam vendors. Now that Google’s CAPTCHA has been cracked, spammers are using bots to sign up for accounts and sending spam through Gmail.
• Freedom to Tinker: Phorm’s Harms Extend Beyond Privacy. Smart take on the many ways the Phorm Internet snooping scheme was hostile to users.
• 2008 NFL Mock Draft Database. I’m a sucker for mock drafts, and this site lists them all.
• FP Passport: The Colbert bump is real. Democratic Congressmen who take their lumps in “Better Know a District” are rewarded with a big jump in contributions.