Core libraries for Apache Spark, a unified analytics engine for large-scale data processing.

LicenseApache 2.0
CategoriesDistributed Computing
Tagscomputingclusterdistributedsparkapacheparallel
HomePage https://spark.apache.org/
DateNov 30, 2023
Filespom (43 KB)  jar (13.4 MB)  View All
RepositoriesCentral
Ranking#208 in MvnRepository (See Top Artifacts)
#1 in Distributed Computing
Used By2,564 artifacts
Scala TargetScala 2.12 (View all targets)
VulnerabilitiesVulnerabilities from dependencies:
CVE-2024-47561
CVE-2024-47554
CVE-2024-26308
View 12 more ...

Note: There is a new version for this artifact

New Version4.0.0-preview2


Compile Dependencies (66)

Category/License Group / ArtifactVersionUpdates
Streaming
Apache 2.0
com.clearspring.analytics » stream 2.9.62.9.8
JSON Lib
Apache 2.0
com.fasterxml.jackson.core » jackson-databind 2.14.22.18.1
JSON Lib
Apache 2.0
com.fasterxml.jackson.module » jackson-module-scala_2.12 2.14.22.18.1
Compression
BSD 2-clause
com.github.luben » zstd-jni 1.5.2-51.5.6-7
Defect Detection
LGPL 2.1
com.google.code.findbugs » jsr305 3.0.04.8.6
Compression
Apache 2.0
com.ning » compress-lzf 1.1.2
Serializer
Apache 2.0
com.twitter » chill_2.12 0.10.0
Serializer
Apache 2.0
com.twitter » chill-java 0.10.0
Base64
Apache 2.0
commons-codec » commons-codec 1.151.17.1
Collections
Apache 2.0
commons-collections » commons-collections 3.2.24.4
I/O
Apache 2.0
commons-io » commons-io1 vulnerability 2.11.02.17.0
Application Metrics
Apache 2.0
io.dropwizard.metrics » metrics-core 4.2.154.2.28

Apache 2.0
io.dropwizard.metrics » metrics-jvm 4.2.154.2.28

Apache 2.0
io.dropwizard.metrics » metrics-json 4.2.154.2.28

Apache 2.0
io.dropwizard.metrics » metrics-graphite 4.2.154.2.28

Apache 2.0
io.dropwizard.metrics » metrics-jmx 4.2.154.2.28
Network Framework
Apache 2.0
io.netty » netty-all 4.1.87.Final4.1.114.Final

Apache 2.0
io.netty » netty-transport-native-epoll 4.1.87.Final4.1.114.Final

Apache 2.0
io.netty » netty-transport-native-epoll 4.1.87.Final4.1.114.Final

Apache 2.0
io.netty » netty-transport-native-kqueue 4.1.87.Final4.1.114.Final

Apache 2.0
io.netty » netty-transport-native-kqueue 4.1.87.Final4.1.114.Final
Java Spec
EPL 2.0GPL
jakarta.servlet » jakarta.servlet-api 4.0.36.1.0
Java Spec
EDL 1.0
javax.activation » activation 1.1.12.1.3
Serializer
MIT
net.razorvine » pickle 1.31.5
Python Integration
BSD
net.sf.py4j » py4j 0.10.9.7
Data Format
Apache 2.0
org.apache.avro » avro2 vulnerabilities 1.11.11.12.0

Apache 2.0
org.apache.avro » avro-mapred 1.11.11.12.0
Compression
Apache 2.0
org.apache.commons » commons-compress3 vulnerabilities 1.221.27.1
Core Utils
Apache 2.0
org.apache.commons » commons-lang3 3.12.03.17.0
Math Lib
Apache 2.0
org.apache.commons » commons-math3 3.6.14.0-beta1
String Utils
Apache 2.0
org.apache.commons » commons-text 1.10.01.12.0
Collections
Apache 2.0
org.apache.commons » commons-collections4 4.4
Encryption Lib
Apache 2.0
org.apache.commons » commons-crypto 1.1.01.2.0
Dist Coordination
Apache 2.0
org.apache.curator » curator-recipes 2.13.05.7.1

Apache 2.0
org.apache.hadoop » hadoop-client-api 3.3.43.4.1

Apache 2.0
org.apache.hadoop » hadoop-client-runtime 3.3.43.4.1

Apache 2.0
org.apache.ivy » ivy1 vulnerability 2.5.12.5.2
Logging Bridge
Apache 2.0
org.apache.logging.log4j » log4j-slf4j2-impl 2.19.02.24.1
Logging
Apache 2.0
org.apache.logging.log4j » log4j-api 2.19.02.24.1
Logging
Apache 2.0
org.apache.logging.log4j » log4j-core 2.19.02.24.1
Logging Bridge
Apache 2.0
org.apache.logging.log4j » log4j-1.2-api 2.19.02.24.1

Apache 2.0
org.apache.spark » spark-launcher_2.12 3.4.23.5.3

Apache 2.0
org.apache.spark » spark-kvstore_2.12 3.4.23.5.3

Apache 2.0
org.apache.spark » spark-network-common_2.12 3.4.23.5.3

Apache 2.0
org.apache.spark » spark-network-shuffle_2.12 3.4.23.5.3

Apache 2.0
org.apache.spark » spark-unsafe_2.12 3.4.23.5.3

Apache 2.0
org.apache.spark » spark-tags_2.12 3.4.23.5.3
Bytecode
Apache 2.0
org.apache.xbean » xbean-asm9-shaded 4.224.26
Dist Coordination
Apache 2.0
org.apache.zookeeper » zookeeper2 vulnerabilities 3.6.33.9.3

Apache 2.0BSD 2-clauseCC0 1.0EDL 1.0EPL 2.0GPLMITPublicW3C
org.glassfish.jersey.containers » jersey-container-servlet 2.363.1.9

Apache 2.0BSD 2-clauseCC0 1.0EDL 1.0EPL 2.0GPLMITPublicW3C
org.glassfish.jersey.containers » jersey-container-servlet-core 2.363.1.9

Apache 2.0BSD 2-clauseCC0 1.0EDL 1.0EPL 2.0GPLMITPublicW3C
org.glassfish.jersey.core » jersey-client 2.363.1.9

Apache 2.0CC0 1.0EPL 2.0GPL 2.0Public
org.glassfish.jersey.core » jersey-common 2.363.1.9

Apache 2.0BSDEPL 2.0GPL 2.0
org.glassfish.jersey.core » jersey-server 2.363.1.9

Apache 2.0BSD 2-clauseCC0 1.0EDL 1.0EPL 2.0GPLMITPublicW3C
org.glassfish.jersey.inject » jersey-hk2 2.363.1.9
JSON Lib
Apache 2.0
org.json4s » json4s-jackson_2.12 3.7.0-M114.0.7
Compression
Apache 2.0
org.lz4 » lz4-java 1.8.0
Collections
Apache 2.0
org.roaringbitmap » RoaringBitmap 0.9.381.3.0
JVM Languages
Apache 2.0
org.scala-lang » scala-library 2.12.173.6.1
Scala Compiler
Apache 2.0
org.scala-lang » scala-reflect 2.12.172.13.15
XML Processing
Apache 2.0
org.scala-lang.modules » scala-xml_2.12 2.1.02.3.0
Logging
MIT
org.slf4j » slf4j-api 2.0.62.0.16
Logging Bridge
MIT
org.slf4j » jul-to-slf4j 2.0.62.0.16
Logging Bridge
Apache 2.0
org.slf4j » jcl-over-slf4j 2.0.62.0.16
Compression
Apache 2.0
org.xerial.snappy » snappy-java1 vulnerability 1.1.10.31.1.10.7
Regexp
Apache
oro » oro 2.0.8

Provided Dependencies (1)

Category/License Group / ArtifactVersionUpdates
Core Utils
Apache 2.0
com.google.guava » guava3 vulnerabilities 14.0.133.3.1-jre

Test Dependencies (25)

Category/License Group / ArtifactVersionUpdates
Native Access
EPL 2.0GPL 2.0LGPL 2.1
com.github.jnr » jnr-posix 3.1.153.1.20
Testing
BSD 3-clause
com.github.sbt » junit-interface 0.13.3
Testing
EPL 2.0
junit » junit 4.13.25.11.3
Web Testing
Apache 2.0
net.sourceforge.htmlunit » htmlunit1 vulnerability 2.67.04.6.0

Apache 2.0
net.sourceforge.htmlunit » htmlunit-core-js 2.67.04.6.0

Apache 2.0
org.apache.curator » curator-test 2.13.05.7.1
JDBC Driver
Apache 2.0
org.apache.derby » derby1 vulnerability 10.14.2.010.17.1.0

Apache 2.0
org.apache.hadoop » hadoop-minikdc 3.3.43.4.1

Apache 2.0
org.apache.hadoop » hadoop-aws 3.3.43.4.1
HTTP Clients
Apache 2.0
org.apache.httpcomponents » httpclient 4.5.145.4.1
HTTP Clients
Apache 2.0
org.apache.httpcomponents » httpmime 4.5.145.4.1
HTTP Clients
Apache 2.0
org.apache.httpcomponents » httpcore 4.4.165.3.1

Apache 2.0
org.apache.spark » spark-launcher_2.12 3.4.23.5.3

Apache 2.0
org.apache.spark » spark-network-shuffle_2.12 3.4.23.5.3

Apache 2.0
org.apache.spark » spark-tags_2.12 3.4.23.5.3

Apache 2.0BSD 2-clauseCC0 1.0EDL 1.0EPL 2.0GPLMITPublicW3C
org.glassfish.jersey.test-framework.providers » jersey-test-framework-provider-simple 2.363.1.9
Mocking
MIT
org.mockito » mockito-core 4.6.15.14.2
Testing
BSD 3-clause
org.scalacheck » scalacheck_2.12 1.17.01.18.1
Testing
Apache 2.0
org.scalatest » scalatest_2.12 3.2.153.2.19

Apache 2.0
org.scalatestplus » scalacheck-1-17_2.12 3.2.15.03.2.19.0

Apache 2.0
org.scalatestplus » mockito-4-6_2.12 3.2.15.03.2.18.0

Apache 2.0
org.scalatestplus » selenium-4-7_2.12 3.2.15.03.2.16.0
Web Testing
Apache 2.0
org.seleniumhq.selenium » selenium-java 4.7.24.26.0
Browser Automation
Apache 2.0
org.seleniumhq.selenium » htmlunit-driver 4.7.24.13.0
XML Processing
ApacheW3C
xml-apis » xml-apis 1.4.012.0.2

Licenses

LicenseURL
Apache 2.0 License http://www.apache.org/licenses/LICENSE-2.0.html