Group: Apache Spark
Sort: popular | newest
org.apache.spark » spark-yarn-timeline-ats-pluginApache
This is a minimal pure-Java JAR which needs to be added to the YARN ATS classpath in order for it to successfully process histories published to it via the cluster's filesystem —that is, the ATS1.5 API. It is not intended for incorporation in any assembly JAR, and is only used by the yarn-timeline-history module at test time.
Last Release on Dec 12, 2020
org.apache.spark » spark-async-shuffle-upload-scala-test-utilsApache
Spark Project Async Shuffle Upload Scala Test Utils
Last Release on Jan 19, 2021
Raz requires jersey1, which conflicts with spark's use of jersey2. So we shade jersey1 and repackage the raz clients to reference our shaded jersey1. Finally, as raz is pulled in transitively via hadoop-cloud-storage, the assembly has to exclude the transitive dependency, and instead pull in our shaded version.
Last Release on Oct 25, 2021
Contains support for cloud infrastructures, including the Hadoop JARs and transitive dependencies needed to interact with the infrastructures. When included in the spark-assembly JAR, the hadoop artifacts are included, but not any of the 3rd party libraries needed, such as those from Amazon (for AWS) and Microsoft (Azure). These will need to be explicitly added to the classpath of any application interacting with the services. Any project which explicitly depends upon the ...
Last Release on Feb 1, 2019