Login | Register   
LinkedIn
Google+
Twitter
RSS Feed
Download our iPhone app
TODAY'S HEADLINES  |   ARTICLE ARCHIVE  |   FORUMS  |   TIP BANK
Browse DevX
Sign up for e-mail newsletters from DevX


advertisement
 

Facebook Debuts Presto Query Engine

The tool can perform fast analysis on data warehouses with 250 PBs of data or more.


advertisement

At a developer conference, Facebook unveiled its homegrown query engine called Presto. According to Facebook's Martin Traverso, more than 850 Facebook employees use the tool every day to analyze 320 TB of data. It runs in memory and can perform simple queries in milliseconds, complex ones in just a few minutes.

“Historically, our data scientists and analysts have relied on Hive for data analysis,” explained Traverso. “The problem with Hive is it’s designed for batch processing. We have other tools that are faster than Hive, but they’re either too limited in functionality or too simple to operate against our huge data warehouse. Over the past few months, we’ve been working on Presto to basically fill this gap.”

Facebook plans to release Presto as an open source project later this year.



View article



   
Comment and Contribute

 

 

 

 

 


(Maximum characters: 1200). You have 1200 characters left.

 

 

Sitemap