Cloudera has launched a new One Platform Initiative which aims to improve Spark and turn it into the primary execution engine for Hadoop. Cloudera has long championed Spark, but some enterprise and industry watchers have said that the open source big data technology isn’t really ready for serious production use.
With this new initiative, Cloudera hopes to deepen Spark’s integration with Hadoop, to beef up its security, to make it more scalable and stable, to improve Spark’s Web user interface and to integrate Spark with some of Cloudera’s other big data tools.
Several other enterprise technology vendors, including IBM and SAP, have also recently announced Spark-related projects.
