Collect
FAQs
-
Does Hydrolix support batch processing?
Yes, Hydrolix fully supports batch processing. This collection feature allows you to efficiently load data from a storage bucket into a target table, ensuring you can work with your data at scale.
Hydrolix offers two mechanisms for batch ingestion: the Batch Job API, which handles one-off tasks for loading one or more files based on job configurations, and Batch Auto-Ingest, which continuously ingests new files arriving in a storage bucket.
Supported data formats include CSV and JSON. Please note that Hydrolix requires read permissions to access external storage buckets for batch ingestion.
-
Does Hydrolix support data ingest from AWS Kinesis?
Yes, Hydrolix supports AWS Kinesis. You can ingest data into Hydrolix with AWS Kinesis, making it easy to work with your real-time streaming data.
-
Does Hydrolix support data ingest from Apache Kafka?
Yes, Hydrolix integrates with Apache Kafka. Hydrolix Projects and Tables can continuously ingest data from one or more Kafka-based streaming sources.
-
What data collection processes does Hydrolix support?
Hydrolix supports streaming data ingestion through the Stream API and batch ingestion through the Batch API. There are also special connectors for Apache Kafka and AWS Kinesis.
Check out data collection in the Hydrolix documentation.
Intelligence Report
