Databricks, the corporate sponsor of the Apache Spark project, has added two key new features to its implementation of the open source big data tool. Spark now has GPU acceleration capabilities and can integrate with several deep learning libraries, including TensorFlow.
In a blog post, the company said, “Users will benefit from 10x speedups in Deep Learning, automated configuration of GPU machines, and smooth integration with Spark clusters. The feature is available by request, and will be generally available within weeks.”
