Ray

Ray is an open-source framework that distributes Python and AI workloads across clusters, enabling scalable training, serving, and data processing.

Hadoop HDFS

Apache Hadoop is an open-source software framework that stores and processes massive datasets across clusters of computers using a distributed file system and parallel computing model.

Dask

Dask is an open-source library that parallelizes Python code to handle large datasets and complex computations across clusters or single machines.

Cdap

Cdap provides an open-source framework for building and running data applications on Apache Hadoop.