devxlogo

Alluxio Powers Baidu Search

Alluxio Powers Baidu Search

Alluxio, an open source memory-centric distributed storage system that was formerly known as Tachyon, has just released its 1.0 version, and it is already getting attention from some of the biggest firms on the Internet. For example, Chinese search giant Baidu says it is using Alluxio to achieve blazing-fast performance.

Baidu Senior Architect Shaoshan Liu explained that the company had been using SparkSQL for queries but wasn’t achieving the desired performance levels. “With Spark SQL alone, it took 100-150 seconds to finish a query; using Alluxio, where data may hit local or remote Alluxio nodes, it took 10-15 seconds. And if all of the data was stored in Alluxio local nodes, it took about five seconds, flat ? a 30-fold increase in speed,” he explained. “Based on these results, and the system’s reliability, we built a full system around Alluxio and Spark SQL.”

Other companies working with Alluxio include Barclays, Alibaba, Intel and IBM.

View article

devxblackblue

About Our Editorial Process

At DevX, we’re dedicated to tech entrepreneurship. Our team closely follows industry shifts, new products, AI breakthroughs, technology trends, and funding announcements. Articles undergo thorough editing to ensure accuracy and clarity, reflecting DevX’s style and supporting entrepreneurs in the tech sphere.

See our full editorial policy.

About Our Journalist