Hydrolix, the company improving the economics of log data with its streaming data lake platform, has shipped a new Apache Spark connector. This connector enables Databricks users to apply the analytical power of Databricks to the entire scope of their event data rather than data sets limited by sampling, aggregation and shorter retention windows, tactics typically used to control data storage costs.