Twitter opens MySQL migration tool

Jul 06, 2010

Trevan McGee

'Crane' allows MySQL data integration in Hadoop.

At last week's Hadoop Summit, Twitter Analytics Lead Kevin Weil announced that it would open source Crane, its data migration tool used to move MySQL data into Hadoop.

Hadoop is used by Twitter to examine collected analytics as well as data crunching for live tools such as name search. Weil said that Twitter uses Scribe to log data into Hadoop and Crane to manage tabular data.

Crane moves MySQL data to the Hadoop filesystem (HDFS), Hbase, another Hadoop-compatible database, Flock, Google Analytics, or Facebook Insights.

Comments

Twitter opens MySQL migration tool

Sherry Houck
'Crane' allows MySQL data integration in Hadoop. Should you think that the title of this post is useful, odds are you are considering about using Linux as your primary or even just an alternative Os when you're just sick of your old system. However many think that Linux is too complicated that it appeals only to geeks, Linux-magazine.com can prove that this great operating system is actually for everyone. It is often fascinating to read about Twitter opens MySQL migration tool.

Sherry Houck,
http://dentalinsuranceplanspro.com/la-ent/new-iberia-tne.php

comments powered by Disqus

Subscribe to our Linux Newsletters
Find Linux and Open Source Jobs
Subscribe to our ADMIN Newsletters

Support Our Work

Linux Magazine content is made possible with support from readers like you. Please consider contributing when you’ve found an article to be beneficial.

News

Keep Android Open

Android , apps , open source

Google has announced that, soon, anyone looking to develop Android apps will have to first register centrally with Google.
Kernel 7.0 Now in Testing

Kernel , Linux

Linus Torvalds has announced the first Release Candidate (RC) for the 7.x kernel is available for those who want to test it.
Introducing matrixOS, an Immutable Gentoo-Based Linux Distro

Gentoo Linux , matrixOS , Operating Systems

It was only a matter of time before a developer decided one of the most challenging Linux distributions needed to be immutable.
Chaos Comes to KDE in KaOS

KDE , Plasma

KaOS devs are making a major change to the distribution, and it all comes down to one system.
New Linux Botnet Discovered

botnet , Security

The SSHStalker botnet uses IRC C2 to control systems via legacy Linux kernel exploits.
The Next Linux Kernel Turns 7.0

Encryption , Kernel

Linus Torvalds has announced that after Linux kernel 6.19, we'll finally reach the 7.0 iteration stage.
Linux From Scratch Drops SysVinit Support

Linux From Scratch , Systemd

LFS will no longer support SysVinit.
LibreOffice 26.2 Now Available

libreoffice , office suite , open source

With new features, improvements, and bug fixes, LibreOffice 26.2 delivers a modern, polished office suite without compromise.
Linux Kernel Project Releases Project Continuity Document

Kernel , Linux , Linux Foundation

What happens to Linux when there's no Linus? It's a question many of us have asked over the years, and it seems it's also on the minds of the Linux kernel project.
Mecha Systems Introduces Linux Handheld

Fedora , Hardware , Linux

Mecha Systems has revealed its Mecha Comet, a new handheld computer powered by – you guessed it – Linux.

Twitter opens MySQL migration tool

Related content

Comments