Twitter opens MySQL migration tool

Jul 06, 2010

'Crane' allows MySQL data integration in Hadoop.

At last week's Hadoop Summit, Twitter Analytics Lead Kevin Weil announced that it would open source Crane, its data migration tool used to move MySQL data into Hadoop.

Hadoop is used by Twitter to examine collected analytics as well as data crunching for live tools such as name search. Weil said that Twitter uses Scribe to log data into Hadoop and Crane to manage tabular data.

Crane moves MySQL data to the Hadoop filesystem (HDFS), Hbase, another Hadoop-compatible database, Flock, Google Analytics, or Facebook Insights.

Related content

Comments

  • Twitter opens MySQL migration tool

    'Crane' allows MySQL data integration in Hadoop. Should you think that the title of this post is useful, odds are you are considering about using Linux as your primary or even just an alternative Os when you're just sick of your old system. However many think that Linux is too complicated that it appeals only to geeks, Linux-magazine.com can prove that this great operating system is actually for everyone. It is often fascinating to read about Twitter opens MySQL migration tool.

    Sherry Houck,
    http://dentalinsuranceplanspro.com/la-ent/new-iberia-tne.php
comments powered by Disqus
Subscribe to our Linux Newsletters
Find Linux and Open Source Jobs
Subscribe to our ADMIN Newsletters

Support Our Work

Linux Magazine content is made possible with support from readers like you. Please consider contributing when you’ve found an article to be beneficial.

Learn More

News

Tag Cloud

Administration Community Desktop Events Hardware Linux Mobile Programming Security Software Ubuntu Web Development Windows free software open source