Alluxio Powers Baidu Search

Alluxio, an open source memory-centric distributed storage system that was formerly known as Tachyon, has just released its 1.0 version, and it is already getting attention from some of the biggest firms on the Internet. For example, Chinese search giant Baidu says it is using Alluxio to achieve blazing-fast performance.

Baidu Senior Architect Shaoshan Liu explained that the company had been using SparkSQL for queries but wasn’t achieving the desired performance levels. “With Spark SQL alone, it took 100-150 seconds to finish a query; using Alluxio, where data may hit local or remote Alluxio nodes, it took 10-15 seconds. And if all of the data was stored in Alluxio local nodes, it took about five seconds, flat ? a 30-fold increase in speed,” he explained. “Based on these results, and the system’s reliability, we built a full system around Alluxio and Spark SQL.”

Other companies working with Alluxio include Barclays, Alibaba, Intel and IBM.

View article

Share the Post:
Share on facebook
Share on twitter
Share on linkedin

Overview

The Latest

microsoft careers

Top Careers at Microsoft

Microsoft has gained its position as one of the top companies in the world, and Microsoft careers are flourishing. This multinational company is efficiently developing popular software and computers with other consumer electronics. It is a dream come true for so many people to acquire a high paid, high-prestige job

your company's audio

4 Areas of Your Company Where Your Audio Really Matters

Your company probably relies on audio more than you realize. Whether you’re creating a spoken text message to a colleague or giving a speech, you want your audio to shine. Otherwise, you could cause avoidable friction points and potentially hurt your brand reputation. For example, let’s say you create a

chrome os developer mode

How to Turn on Chrome OS Developer Mode

Google’s Chrome OS is a popular operating system that is widely used on Chromebooks and other devices. While it is designed to be simple and user-friendly, there are times when users may want to access additional features and functionality. One way to do this is by turning on Chrome OS