Apache Spark 2.0 is now generally available on the Databricks data platform. The company touts five to 10x performance increases over Spark 1.6 and new support for continuous applications with ...

Frank Nothaft, technical director of healthcare and life sciences at Databricks, said that Apache Spark's distributed data processing engine is perfect for running complex queries at large scale ...