Twitter opens MySQL migration tool

Jul 06, 2010

Trevan McGee

'Crane' allows MySQL data integration in Hadoop.

At last week's Hadoop Summit, Twitter Analytics Lead Kevin Weil announced that it would open source Crane, its data migration tool used to move MySQL data into Hadoop.

Hadoop is used by Twitter to examine collected analytics as well as data crunching for live tools such as name search. Weil said that Twitter uses Scribe to log data into Hadoop and Crane to manage tabular data.

Crane moves MySQL data to the Hadoop filesystem (HDFS), Hbase, another Hadoop-compatible database, Flock, Google Analytics, or Facebook Insights.

Comments

Twitter opens MySQL migration tool

Sherry Houck
'Crane' allows MySQL data integration in Hadoop. Should you think that the title of this post is useful, odds are you are considering about using Linux as your primary or even just an alternative Os when you're just sick of your old system. However many think that Linux is too complicated that it appeals only to geeks, Linux-magazine.com can prove that this great operating system is actually for everyone. It is often fascinating to read about Twitter opens MySQL migration tool.

Sherry Houck,
http://dentalinsuranceplanspro.com/la-ent/new-iberia-tne.php

comments powered by Disqus

Subscribe to our Linux Newsletters
Find Linux and Open Source Jobs
Subscribe to our ADMIN Newsletters

Support Our Work

Linux Magazine content is made possible with support from readers like you. Please consider contributing when you've found an article to be beneficial.

News

2024 Open Source Professionals Job Survey Now Open

open source

Share your expectations regarding open source jobs.
Arch Linux 2023.12.01 Released with a Much-Improved Installer

Arch Linux , Linux , Operating Systems

If you've ever wanted to install Arch Linux, now is your time. With the latest release, the archinstall script vastly simplifies the process.
Zorin OS 17 Beta Available for Testing

Desktop , Linux

The upcoming version of Zorin OS includes plenty of improvements to take your PC to a whole new level of user-friendliness.
Red Hat Migrates RHEL from Xorg to Wayland

Enterprise Linux , Linux , RHEL , Wayland , Xorg

If you've been wondering when Xorg will finally be a thing of the past, wonder no more, as Red Hat has made it clear.
PipeWire 1.0 Officially Released

audio , Hardware , Linux

PipeWire was created to take the place of the oft-troubled PulseAudio and has finally reached the 1.0 status as a major update with plenty of improvements and the usual bug fixes.
Rocky Linux 9.3 Available for Download

Enterprise Linux , RHEL , Rocky Linux

The latest version of the RHEL alternative is now available and brings back cloud and container images for ppc64le along with plenty of new features and fixes.
Ubuntu Budgie Shifts How to Tackle Wayland

Desktop , Ubuntu , Wayland , Xorg

Ubuntu Budgie has yet to make the switch to Wayland but with a change in approaches, they're finally on track to making it happen.
TUXEDO's New Ultraportable Linux Workstation Released

Hardware , laptop , Linux

The TUXEDO Pulse 14 blends portability with power, thanks to the AMD Ryzen 7 7840HS CPU.
AlmaLinux Will No Longer Be "Just Another RHEL Clone"

AlmaLinux , Enterprise Linux , RHEL

With the release of AlmaLinux 9.3, the distribution will be built entirely from upstream sources.
elementary OS 8 Has a Big Surprise in Store

elementary OS , Linux , Operating Systems , Wayland

When elementary OS 8 finally arrives, it will not only be based on Ubuntu 24.04 but it will also default to Wayland for better performance and security.

Twitter opens MySQL migration tool

Related content

Comments