Skip to main content

Apache Uniffle (Incubating)

A high performance, general purpose remote shuffle service for distributed computing engines.

Fast

Reduces number of connections and random I/O in data shuffle.

Reliable

Reduces out of memory (or disk space) failures for large jobs.

Elastic

Enables orchestration and improves resource utilization.

Spark Support

Supports Apache Spark 2.3.x, 2.4.x, 3.0.x, 3.1.x, 3.2.x, 3.3.x.

MapReduce Support

Supports the MapReduce framework of Apache Hadoop 2.8.x.

Kubernetes Operator

Extends the Kubernetes API to create, configure, and manage Uniffle instances.