Apache Uniffle (Incubating)
A high performance, general purpose remote shuffle service for distributed computing engines.
Reduces number of connections and random I/O in data shuffle.
Reduces out of memory (or disk space) failures for large jobs.
Enables orchestration and improves resource utilization.
Supports Apache Spark 2.3.x, 2.4.x, 3.0.x, 3.1.x, 3.2.x, 3.3.x.
Supports the MapReduce framework of Apache Hadoop 2.8.x.
Extends the Kubernetes API to create, configure, and manage Uniffle instances.