LinkedIn Unveils Dr. Elephant Hadoop Tuning Tool

LinkedIn has released Dr. Elephant, an internally developed tool for tuning Hadoop and Spark, under an open source license. “At LinkedIn, we made it compulsory for the developers to use Dr. Elephant as part of their development cycle,” blogged Akshay Rai, a software engineer at LinkedIn. “It is mandatory to get a green signal from Dr. Elephant for a flow to run in production. For any user issues, we first ask for Dr. Elephant’s report. This encourages them to write their jobs optimally and try to make all their jobs appear green in Dr. Elephant. Dr. Elephant has been a part of LinkedIn’s culture for more than a year and has been helping everyone.”

LinkedIn runs approximately 100,000 Hadoop and Spark jobs per day, and it says that Dr. Elephant has made those big data analytics jobs more efficient. Rai added, “Dr. Elephant is very popular at LinkedIn. People love it for its simplicity. Like a family doctor, it is always reachable and solves around 80 percent of the problems through simple diagnosis.”

View article

Share the Post:
Share on facebook
Share on twitter
Share on linkedin

Overview

The Latest

your company's audio

4 Areas of Your Company Where Your Audio Really Matters

Your company probably relies on audio more than you realize. Whether you’re creating a spoken text message to a colleague or giving a speech, you want your audio to shine. Otherwise, you could cause avoidable friction points and potentially hurt your brand reputation. For example, let’s say you create a

chrome os developer mode

How to Turn on Chrome OS Developer Mode

Google’s Chrome OS is a popular operating system that is widely used on Chromebooks and other devices. While it is designed to be simple and user-friendly, there are times when users may want to access additional features and functionality. One way to do this is by turning on Chrome OS

homes in the real estate industry

Exploring the Latest Tech Trends Impacting the Real Estate Industry

The real estate industry is changing thanks to the newest technological advancements. These new developments — from blockchain and AI to virtual reality and 3D printing — are poised to change how we buy and sell homes. Real estate brokers, buyers, sellers, wholesale real estate professionals, fix and flippers, and beyond may