Core libraries for Apache Spark, a unified analytics engine for large-scale data processing.

LicenseApache 2.0
CategoriesDistributed Computing
Tagscomputingclusterdistributedsparkapacheparallel
HomePage https://spark.apache.org/
DateDec 20, 2024
Filespom (42 KB)  jar (14.2 MB)  View All
RepositoriesCentral
Ranking#212 in MvnRepository (See Top Artifacts)
#1 in Distributed Computing
Used By2,622 artifacts
Scala TargetScala 2.13 (View all targets)
VulnerabilitiesVulnerabilities from dependencies:
CVE-2024-47561
CVE-2024-26308
CVE-2024-25710
View 11 more ...

Note: There is a new version for this artifact

New Version4.0.0-preview2


Compile Dependencies (62)

Category/License Group / ArtifactVersionUpdates
Streaming
Apache 2.0
com.clearspring.analytics » stream 2.9.62.9.8
JSON Lib
Apache 2.0
com.fasterxml.jackson.core » jackson-databind 2.15.22.18.2
JSON Lib
Apache 2.0
com.fasterxml.jackson.module » jackson-module-scala_2.13 2.15.22.18.2
Compression
BSD 2-clause
com.github.luben » zstd-jni 1.5.5-41.5.6-10
Defect Detection
LGPL 2.1
com.google.code.findbugs » jsr305 3.0.04.9.1
Compression
Apache 2.0
com.ning » compress-lzf 1.1.2
Serializer
Apache 2.0
com.twitter » chill_2.13 0.10.0
Serializer
Apache 2.0
com.twitter » chill-java 0.10.0
Base64
Apache 2.0
commons-codec » commons-codec 1.16.11.18.0
Collections
Apache 2.0
commons-collections » commons-collections 3.2.24.4
I/O
Apache 2.0
commons-io » commons-io 2.16.12.18.0
Application Metrics
Apache 2.0
io.dropwizard.metrics » metrics-core 4.2.194.2.30

Apache 2.0
io.dropwizard.metrics » metrics-jvm 4.2.194.2.30

Apache 2.0
io.dropwizard.metrics » metrics-json 4.2.194.2.30

Apache 2.0
io.dropwizard.metrics » metrics-graphite 4.2.194.2.30

Apache 2.0
io.dropwizard.metrics » metrics-jmx 4.2.194.2.30
Network Framework
Apache 2.0
io.netty » netty-all 4.1.96.Final4.1.118.Final

Apache 2.0
io.netty » netty-transport-native-epoll 4.1.96.Final4.1.118.Final

Apache 2.0
io.netty » netty-transport-native-epoll 4.1.96.Final4.1.118.Final

Apache 2.0
io.netty » netty-transport-native-kqueue 4.1.96.Final4.1.118.Final

Apache 2.0
io.netty » netty-transport-native-kqueue 4.1.96.Final4.1.118.Final
Java Spec
EPL 2.0GPL
jakarta.servlet » jakarta.servlet-api 4.0.36.1.0
Java Spec
EDL 1.0
javax.activation » activation 1.1.12.1.3
Serializer
MIT
net.razorvine » pickle 1.31.5
Python Integration
BSD
net.sf.py4j » py4j 0.10.9.70.10.9.9
Serializer
Apache 2.0
org.apache.avro » avro2 vulnerabilities 1.11.21.12.0

Apache 2.0
org.apache.avro » avro-mapred 1.11.21.12.0
Compression
Apache 2.0
org.apache.commons » commons-compress3 vulnerabilities 1.23.01.27.1
Core Utils
Apache 2.0
org.apache.commons » commons-lang3 3.12.03.17.0
Math Lib
Apache 2.0
org.apache.commons » commons-math3 3.6.14.0-beta1
String Utils
Apache 2.0
org.apache.commons » commons-text 1.10.01.13.0
Collections
Apache 2.0
org.apache.commons » commons-collections4 4.4
Encryption Lib
Apache 2.0
org.apache.commons » commons-crypto 1.1.01.2.0
Dist Coordination
Apache 2.0
org.apache.curator » curator-recipes 2.13.05.7.1

Apache 2.0
org.apache.hadoop » hadoop-client-api 3.3.43.4.1

Apache 2.0
org.apache.hadoop » hadoop-client-runtime 3.3.43.4.1

Apache 2.0
org.apache.ivy » ivy1 vulnerability 2.5.12.5.3

Apache 2.0
org.apache.spark » spark-launcher_2.13 3.5.4

Apache 2.0
org.apache.spark » spark-kvstore_2.13 3.5.4

Apache 2.0
org.apache.spark » spark-network-common_2.13 3.5.4

Apache 2.0
org.apache.spark » spark-network-shuffle_2.13 3.5.4

Apache 2.0
org.apache.spark » spark-unsafe_2.13 3.5.4

Apache 2.0
org.apache.spark » spark-common-utils_2.13 3.5.4

Apache 2.0
org.apache.spark » spark-tags_2.13 3.5.4
Bytecode
Apache 2.0
org.apache.xbean » xbean-asm9-shaded 4.234.26
Dist Coordination
Apache 2.0
org.apache.zookeeper » zookeeper2 vulnerabilities 3.6.33.9.3

Apache 2.0BSD 2-clauseCC0 1.0EDL 1.0EPL 2.0GPLMITPublicW3C
org.glassfish.jersey.containers » jersey-container-servlet 2.403.1.10

Apache 2.0BSD 2-clauseCC0 1.0EDL 1.0EPL 2.0GPLMITPublicW3C
org.glassfish.jersey.containers » jersey-container-servlet-core 2.403.1.10

Apache 2.0BSD 2-clauseCC0 1.0EDL 1.0EPL 2.0GPLMITPublicW3C
org.glassfish.jersey.core » jersey-client 2.403.1.10

Apache 2.0CC0 1.0EPL 2.0GPL 2.0Public
org.glassfish.jersey.core » jersey-common 2.403.1.10

Apache 2.0BSDEPL 2.0GPL 2.0
org.glassfish.jersey.core » jersey-server 2.403.1.10

Apache 2.0BSD 2-clauseCC0 1.0EDL 1.0EPL 2.0GPLMITPublicW3C
org.glassfish.jersey.inject » jersey-hk2 2.403.1.10
JSON Lib
Apache 2.0
org.json4s » json4s-jackson_2.13 3.7.0-M114.0.7
Compression
Apache 2.0
org.lz4 » lz4-java 1.8.0
Collections
Apache 2.0
org.roaringbitmap » RoaringBitmap 0.9.451.3.0
JVM Languages
Apache 2.0
org.scala-lang » scala-library1 vulnerability 2.13.83.6.3
Scala Compiler
Apache 2.0
org.scala-lang » scala-reflect 2.13.82.13.16
Collections
Apache 2.0
org.scala-lang.modules » scala-parallel-collections_2.13 1.0.41.2.0
XML Processing
Apache 2.0
org.scala-lang.modules » scala-xml_2.13 2.1.02.3.0
Collections
Apache 2.0
org.scala-lang.modules » scala-collection-compat_2.13 2.7.02.13.0
Compression
Apache 2.0
org.xerial.snappy » snappy-java 1.1.10.51.1.10.7
Regexp
Apache
oro » oro 2.0.8

Provided Dependencies (1)

Category/License Group / ArtifactVersionUpdates
Core Utils
Apache 2.0
com.google.guava » guava3 vulnerabilities 14.0.133.4.0-jre

Test Dependencies (25)

Category/License Group / ArtifactVersionUpdates
Native Access
EPL 2.0GPL 2.0LGPL 2.1
com.github.jnr » jnr-posix 3.1.153.1.20
Testing
BSD 3-clause
com.github.sbt » junit-interface 0.13.3
Testing
EPL 2.0
junit » junit 4.13.25.11.4
Browser Automation
Apache 2.0
net.sourceforge.htmlunit » htmlunit1 vulnerability 2.70.04.9.0

Apache 2.0
net.sourceforge.htmlunit » htmlunit-core-js 2.70.04.9.0

Apache 2.0
org.apache.curator » curator-test 2.13.05.7.1
JDBC Driver
Apache 2.0
org.apache.derby » derby1 vulnerability 10.14.2.010.17.1.0

Apache 2.0
org.apache.hadoop » hadoop-minikdc 3.3.43.4.1

Apache 2.0
org.apache.hadoop » hadoop-aws 3.3.43.4.1
HTTP Clients
Apache 2.0
org.apache.httpcomponents » httpclient 4.5.145.4.2
MIME Types Lib
Apache 2.0
org.apache.httpcomponents » httpmime 4.5.145.4.2
HTTP Clients
Apache 2.0
org.apache.httpcomponents » httpcore 4.4.165.3.3

Apache 2.0
org.apache.spark » spark-launcher_2.13 3.5.4

Apache 2.0
org.apache.spark » spark-network-shuffle_2.13 3.5.4

Apache 2.0
org.apache.spark » spark-tags_2.13 3.5.4

Apache 2.0BSD 2-clauseCC0 1.0EDL 1.0EPL 2.0GPLMITPublicW3C
org.glassfish.jersey.test-framework.providers » jersey-test-framework-provider-simple 2.403.1.10
Mocking
MIT
org.mockito » mockito-core 4.11.05.15.2
Testing
BSD 3-clause
org.scalacheck » scalacheck_2.13 1.17.01.18.1
Testing
Apache 2.0
org.scalatest » scalatest_2.13 3.2.163.2.19

Apache 2.0
org.scalatestplus » scalacheck-1-17_2.13 3.2.16.03.2.19.0

Apache 2.0
org.scalatestplus » mockito-4-11_2.13 3.2.16.03.2.17.0

Apache 2.0
org.scalatestplus » selenium-4-9_2.13 3.2.16.03.2.17.0
Web Testing
Apache 2.0
org.seleniumhq.selenium » selenium-java 4.9.14.28.1
Browser Automation
Apache 2.0
org.seleniumhq.selenium » htmlunit-driver 4.9.14.13.0
XML Processing
ApacheW3C
xml-apis » xml-apis 1.4.012.0.2