Produces the self-contained fat jar that the Python wheel mounts via --jars,
for Spark 4.2.x / Scala 2.13 (WP-20).
WHY THIS BUNDLE RECOMPILES THE VERSION-AGNOSTIC LAYERS
------------------------------------------------------
The 3.5 bundles ship api/dispatch/runtime classes compiled against Spark
3.5.3. Those classes are SOURCE-identical here, but a Spark 4.2 driver
cannot link against classes whose erased Catalyst descriptors were built
for 3.5 when the 4.2 Catalyst ...
Compile Dependencies (0)
| Category/License | Group / Artifact | Version | Updates |
|---|
Provided Dependencies (3)
| Category/License | Group / Artifact | Version | Updates | |
|---|---|---|---|---|
Hadoop Query Engine
Apache 2.0
| org.apache.spark
»
spark-sql_2.13 Spark SQL is Apache Spark's module for working with structured data based on DataFrames. | 4.2.0 | ✔ | |
JVM Languages
Apache 2.0
| org.scala-lang
»
scala-library Standard library for the Scala Programming Language Version 3 | 2.13.18 | 3.10.0 | |
Logging
MIT
| org.slf4j
»
slf4j-api API for SLF4J (The Simple Logging Facade for Java) which serves as a simple facade or abstraction for various logging ... | 2.0.7 | 2.0.20 |