Core libraries for Apache Spark, a unified analytics engine for large-scale data processing.

LicenseApache 2.0
CategoriesDistributed Computing
Tagscomputingclusterdistributedsparkapacheparallel
HomePage http://spark.apache.org/
DateJan 26, 2022
Filespom (32 KB)  jar (10.3 MB)  View All
RepositoriesCentral
Ranking#208 in MvnRepository (See Top Artifacts)
#1 in Distributed Computing
Used By2,563 artifacts
Scala TargetScala 2.12 (View all targets)
VulnerabilitiesDirect vulnerabilities:
CVE-2022-31777

Vulnerabilities from dependencies:
CVE-2024-47561
CVE-2024-47554
CVE-2024-23944
View 25 more ...

Note: There is a new version for this artifact

New Version4.0.0-preview2


Compile Dependencies (59)

Category/License Group / ArtifactVersionUpdates
Streaming
Apache 2.0
com.clearspring.analytics » stream 2.9.62.9.8
JSON Lib
Apache 2.0
com.fasterxml.jackson.core » jackson-databind4 vulnerabilities 2.12.32.18.1
JSON Lib
Apache 2.0
com.fasterxml.jackson.module » jackson-module-scala_2.12 2.12.32.18.1
Compression
BSD 2-clause
com.github.luben » zstd-jni 1.5.0-41.5.6-7
Defect Detection
LGPL 2.1
com.google.code.findbugs » jsr305 3.0.04.8.6
Compression
Apache 2.0
com.ning » compress-lzf 1.0.31.1.2
Serializer
Apache 2.0
com.twitter » chill_2.12 0.10.0
Serializer
Apache 2.0
com.twitter » chill-java 0.10.0
Base64
Apache 2.0
commons-codec » commons-codec 1.151.17.1
Collections
Apache 2.0
commons-collections » commons-collections 3.2.24.4
I/O
Apache 2.0
commons-io » commons-io1 vulnerability 2.8.02.17.0
FTP
Apache 2.0
commons-net » commons-net1 vulnerability 3.13.11.1
Application Metrics
Apache 2.0
io.dropwizard.metrics » metrics-core 4.2.04.2.28

Apache 2.0
io.dropwizard.metrics » metrics-jvm 4.2.04.2.28

Apache 2.0
io.dropwizard.metrics » metrics-json 4.2.04.2.28

Apache 2.0
io.dropwizard.metrics » metrics-graphite 4.2.04.2.28

Apache 2.0
io.dropwizard.metrics » metrics-jmx 4.2.04.2.28
Network Framework
Apache 2.0
io.netty » netty-all 4.1.68.Final4.1.114.Final
Java Spec
EPL 2.0GPL
jakarta.servlet » jakarta.servlet-api 4.0.36.1.0
Java Spec
EDL 1.0
javax.activation » activation 1.1.12.1.3
Logging
Apache 2.0
log4j » log4j5 vulnerabilities 1.2.172.24.1
Python Integration
MIT
net.razorvine » pyrolite 4.305.1
Python Integration
BSD
net.sf.py4j » py4j 0.10.9.30.10.9.7
Data Format
Apache 2.0
org.apache.avro » avro2 vulnerabilities 1.10.21.12.0

Apache 2.0
org.apache.avro » avro-mapred 1.10.21.12.0
Core Utils
Apache 2.0
org.apache.commons » commons-lang3 3.12.03.17.0
Math Lib
Apache 2.0
org.apache.commons » commons-math3 3.4.14.0-beta1
String Utils
Apache 2.0
org.apache.commons » commons-text1 vulnerability 1.61.12.0
Encryption Lib
Apache 2.0
org.apache.commons » commons-crypto 1.1.01.2.0
Dist Coordination
Apache 2.0
org.apache.curator » curator-recipes 2.13.05.7.1

Apache 2.0
org.apache.hadoop » hadoop-client-api 3.3.13.4.1

Apache 2.0
org.apache.hadoop » hadoop-client-runtime 3.3.13.4.1

Apache 2.0
org.apache.ivy » ivy3 vulnerabilities 2.5.02.5.2

Apache 2.0
org.apache.spark » spark-launcher_2.12 3.2.13.5.3

Apache 2.0
org.apache.spark » spark-kvstore_2.12 3.2.13.5.3

Apache 2.0
org.apache.spark » spark-network-common_2.12 3.2.13.5.3

Apache 2.0
org.apache.spark » spark-network-shuffle_2.12 3.2.13.5.3

Apache 2.0
org.apache.spark » spark-unsafe_2.12 3.2.13.5.3

Apache 2.0
org.apache.spark » spark-tags_2.12 3.2.13.5.3
Bytecode
Apache 2.0
org.apache.xbean » xbean-asm9-shaded 4.204.26
Dist Coordination
Apache 2.0
org.apache.zookeeper » zookeeper2 vulnerabilities 3.6.23.9.3

Apache 2.0BSD 2-clauseCC0 1.0EDL 1.0EPL 2.0GPLMITPublicW3C
org.glassfish.jersey.containers » jersey-container-servlet 2.343.1.9

Apache 2.0BSD 2-clauseCC0 1.0EDL 1.0EPL 2.0GPLMITPublicW3C
org.glassfish.jersey.containers » jersey-container-servlet-core 2.343.1.9

Apache 2.0BSD 2-clauseCC0 1.0EDL 1.0EPL 2.0GPLMITPublicW3C
org.glassfish.jersey.core » jersey-client 2.343.1.9

Apache 2.0CC0 1.0EPL 2.0GPL 2.0Public
org.glassfish.jersey.core » jersey-common 2.343.1.9

Apache 2.0BSDEPL 2.0GPL 2.0
org.glassfish.jersey.core » jersey-server 2.343.1.9

Apache 2.0BSD 2-clauseCC0 1.0EDL 1.0EPL 2.0GPLMITPublicW3C
org.glassfish.jersey.inject » jersey-hk2 2.343.1.9
JSON Lib
Apache 2.0
org.json4s » json4s-jackson_2.12 3.7.0-M114.0.7
Compression
Apache 2.0
org.lz4 » lz4-java 1.7.11.8.0
Collections
Apache 2.0
org.roaringbitmap » RoaringBitmap 0.9.01.3.0
JVM Languages
Apache 2.0
org.scala-lang » scala-library 2.12.153.6.1
Scala Compiler
Apache 2.0
org.scala-lang » scala-reflect 2.12.152.13.15
XML Processing
Apache 2.0
org.scala-lang.modules » scala-xml_2.12 1.2.02.3.0
Logging
MIT
org.slf4j » slf4j-api 1.7.302.0.16
Logging Bridge
MIT
org.slf4j » jul-to-slf4j 1.7.302.0.16
Logging Bridge
Apache 2.0
org.slf4j » jcl-over-slf4j 1.7.302.0.16
Logging Bridge
MIT
org.slf4j » slf4j-log4j12 1.7.302.0.16
Compression
Apache 2.0
org.xerial.snappy » snappy-java4 vulnerabilities 1.1.8.41.1.10.7
Regexp
Apache
oro » oro 2.0.8

Provided Dependencies (1)

Category/License Group / ArtifactVersionUpdates
Core Utils
Apache 2.0
com.google.guava » guava3 vulnerabilities 14.0.133.3.1-jre

Test Dependencies (26)

Category/License Group / ArtifactVersionUpdates
Testing
BSD 3-clause
com.novocode » junit-interface 0.110.13.3
Testing
EPL 2.0
junit » junit 4.13.15.11.3
Web Testing
Apache 2.0
net.sourceforge.htmlunit » htmlunit1 vulnerability 2.50.04.5.0

Apache 2.0
net.sourceforge.htmlunit » htmlunit-core-js 2.50.04.5.0

Apache 2.0
org.apache.curator » curator-test 2.13.05.7.1
JDBC Driver
Apache 2.0
org.apache.derby » derby1 vulnerability 10.14.2.010.17.1.0

Apache 2.0
org.apache.hadoop » hadoop-minikdc 3.3.13.4.1

Apache 2.0
org.apache.hadoop » hadoop-aws 3.3.13.4.1
HTTP Clients
Apache 2.0
org.apache.httpcomponents » httpclient 4.5.135.4.1
MIME Types Lib
Apache 2.0
org.apache.httpcomponents » httpmime 4.5.135.4.1
HTTP Clients
Apache 2.0
org.apache.httpcomponents » httpcore 4.4.145.3.1

Apache 2.0
org.apache.spark » spark-launcher_2.12 3.2.13.5.3

Apache 2.0
org.apache.spark » spark-network-shuffle_2.12 3.2.13.5.3

Apache 2.0
org.apache.spark » spark-tags_2.12 3.2.13.5.3

Apache 2.0BSD 2-clauseCC0 1.0EDL 1.0EPL 2.0GPLMITPublicW3C
org.glassfish.jersey.test-framework.providers » jersey-test-framework-provider-simple 2.343.1.9
Testing
BSD 3-clause
org.hamcrest » hamcrest-core 1.33.0
Testing
BSD 3-clause
org.hamcrest » hamcrest-library 1.33.0
Mocking
MIT
org.mockito » mockito-core 3.4.65.14.2
Testing
BSD 3-clause
org.scalacheck » scalacheck_2.12 1.15.41.18.1
Testing
Apache 2.0
org.scalatest » scalatest_2.12 3.2.93.2.19

Apache 2.0
org.scalatestplus » scalacheck-1-15_2.12 3.2.9.03.2.14.0

Apache 2.0
org.scalatestplus » mockito-3-4_2.12 3.2.9.03.2.10.0

Apache 2.0
org.scalatestplus » selenium-3-141_2.12 3.2.9.03.2.12.1
Web Testing
Apache 2.0
org.seleniumhq.selenium » selenium-java 3.141.594.26.0
Browser Automation
Apache 2.0
org.seleniumhq.selenium » htmlunit-driver 2.50.04.13.0
XML Processing
ApacheW3C
xml-apis » xml-apis 1.4.012.0.2

Licenses

LicenseURL
Apache 2.0 License http://www.apache.org/licenses/LICENSE-2.0.html

Developers

NameEmailDev IdRolesOrganization
Matei Zahariamatei.zaharia<at>gmail.commateiApache Software Foundation