AI Tools that integrate with Apache Spark

Tecton

6.8 /10

Automate consistent feature engineering for batch and real-time ML pipelines

Unravel

6.6 /10

Optimize cloud genomics data pipeline costs with actionable real-time insights

Hopsworks

6.8 /10

Manage and share ML features with robust versioning and governance

Apache Airflow

7.3 /10

Orchestrate and monitor data workflows with Apache Airflow

LakeFS

6.8 /10

Implement Git-like version control for your data lake

Dagster

6.9 /10

Orchestrate data pipelines with confidence.

KNIME Analytics Platform

7.1 /10

Design and automate data workflows with a visual drag-and-drop interface

Flyte

6.7 /10

Orchestrate scalable data and ML workflows seamlessly

IBM Watson Machine Learning

6.6 /10

Deploy, manage, and scale machine learning models in the cloud

TransmogrifAI

6.9 /10

Automate feature engineering and ML pipelines on large-scale Spark data

DeepLearning4J

6.7 /10

Build, train, and deploy deep neural networks on the JVM with Java or Scala