snappy-java: A fast compression/decompression library

Spark SQL is Apache Spark's module for working with structured data based on DataFrames.

Apache Hadoop Common

Kafka client library for building producers and consumers that interact with Apache Kafka clusters for high-throughput distributed messaging.

Core libraries for Apache Spark, a unified analytics engine for large-scale data processing.

Non-Blocking Reactive Foundation for the JVM

Avro is a row-oriented remote procedure call and data serialization framework that produces a compact binary format.

ZooKeeper server

The core Apache Kafka server and client libraries for building distributed streaming platforms.

Elasticsearch subproject :server

Apache Hadoop HDFS