Spark SQL is Apache Spark's module for working with structured data based on DataFrames.

Compile Dependencies (159)

Category/LicenseGroup / ArtifactVersionUpdates
Streaming Apache 2.0
com.clearspring.analytics » stream
A library for summarizing data in streams for which it is infeasible to store all events
2.9.8
Serializer BSD 3-clause
com.esotericsoftware » kryo-shaded
Fast, efficient Java serialization. This is the main Kryo artifact.
4.0.35.6.2
Logging BSD 3-clause
com.esotericsoftware » minlog
Minimal overhead Java logging
1.3.01.3.1
JSON Lib Apache 2.0
com.fasterxml.jackson.core » jackson-databind6 vulnerabilities
General data-binding functionality for Jackson: works on core streaming API
2.18.63.2.1
JSON Lib Apache 2.0
com.fasterxml.jackson.core » jackson-annotations
Core annotations used for value types, used by Jackson data binding package.
2.18.62.22
JSON Lib Apache 2.0
com.fasterxml.jackson.core » jackson-core
Core Jackson processing abstractions (aka Streaming API), implementation for JSON
2.18.63.2.1
Date/Time Apache 2.0
com.fasterxml.jackson.datatype » jackson-datatype-jsr310
Add-on module to support JSR-310 (Java 8 Date & Time API) data types.
2.18.63.0.0-rc2
JSON Lib Apache 2.0
com.fasterxml.jackson.module » jackson-module-scala_2.13
jackson-module-scala
2.18.63.2.1
Compression BSD 2-clause
com.github.luben » zstd-jni
JNI bindings for Zstd native library that provides fast and high compression lossless algorithm for Java and all JVM ...
1.5.6-91.5.7-11
Code Analyzer LGPL 2.1
com.google.code.findbugs » jsr305
Annotations the SpotBugs tool supports
3.0.04.10.3
JSON Lib Apache 2.0
com.google.code.gson » gson
Gson is a Java library that can be used to convert Java Objects into their JSON representation. It can also be used to ...
2.11.02.14.0
Encryption Lib Apache 2.0
com.google.crypto.tink » tink
Tink is a small cryptographic library that provides a safe, simple, agile and fast way to accomplish some common ...
1.16.01.23.0
Serializer Apache 2.0
com.google.flatbuffers » flatbuffers-java
Memory Efficient Serialization Library
24.3.2525.2.10
com.google.protobuf » protobuf-java
Core Protocol Buffers library. Protocol Buffers are a way of encoding structured data in an
4.29.34.35.1
com.ibm.icu » icu4j
International Components for Unicode for Java (ICU4J) is a mature, widely used Java library
76.178.3
Compression Apache 2.0
com.ning » compress-lzf
Compression codec for LZF encoding for particularly encoding/decoding, with reasonable compression.
1.1.21.2.1
Reflection BSD 3-clause
com.thoughtworks.paranamer » paranamer
Library to access parameter names of non-private methods and constructors at runtime.
2.82.8.3
Serializer Apache 2.0
com.twitter » chill_2.13
Scala extensions for the Kryo serialization library
0.10.0
Serializer Apache 2.0
com.twitter » chill-java
chill-java
0.10.0
CSV Apache 2.0
com.univocity » univocity-parsers
univocity's open source parsers for processing different text formats using a consistent API
2.9.1
Base64 Apache 2.0
commons-codec » commons-codec
The Apache Commons Codec component contains encoders and decoders for
1.17.21.22.1
Collections Apache 2.0
commons-collections » commons-collections
The Apache Commons Collections package contains types that extend and augment the Java Collections Framework.
3.2.24.5.0
I/O Apache 2.0
commons-io » commons-io
The Apache Commons IO library contains utility classes, stream implementations, file filters,
2.18.02.22.0
Compression Apache 2.0
io.airlift » aircompressor
Compression algorithms
2.0.33.7
io.dropwizard.metrics » metrics-core
Metrics is a Java library which gives you unparalleled insight into what your code does in
4.2.305.0.7
Apache 2.0
io.dropwizard.metrics » metrics-jvm
A set of classes which allow you to monitor critical aspects of your Java Virtual Machine
4.2.305.0.7
Apache 2.0
io.dropwizard.metrics » metrics-json
A set of Jackson modules which provide serializers for most Metrics classes.
4.2.305.0.7
Apache 2.0
io.dropwizard.metrics » metrics-graphite
A reporter for Metrics which announces measurements to a Graphite server.
4.2.305.0.7
Apache 2.0
io.dropwizard.metrics » metrics-jmx
A set of classes which allow you to report metrics via JMX.
4.2.305.0.7
JWT Lib Apache 2.0
io.jsonwebtoken » jjwt-api
The public API for the JJWT library, used to create and consume JSON Web Tokens in Java.
0.12.60.13.0
JWT Lib Apache 2.0
io.jsonwebtoken » jjwt-impl
Internal implementation module for JJWT, a Java library for creating and verifying JSON Web Tokens (JWTs).
0.12.60.13.0
Apache 2.0
io.jsonwebtoken » jjwt-jackson0.12.60.13.0
Apache 2.0
io.netty » netty-tcnative-boringssl-static
A Mavenized fork of Tomcat Native which incorporates various patches. This artifact is statically linked
2.0.70.Final2.0.81.Final
Apache 2.0
io.netty » netty-tcnative-classes
A Mavenized fork of Tomcat Native which incorporates various patches. This artifact is dynamically linked
2.0.70.Final2.0.81.Final
Apache 2.0
io.netty » netty-tcnative-boringssl-static
A Mavenized fork of Tomcat Native which incorporates various patches. This artifact is statically linked
2.0.70.Final2.0.81.Final
Apache 2.0
io.netty » netty-tcnative-boringssl-static
A Mavenized fork of Tomcat Native which incorporates various patches. This artifact is statically linked
2.0.70.Final2.0.81.Final
Apache 2.0
io.netty » netty-tcnative-boringssl-static
A Mavenized fork of Tomcat Native which incorporates various patches. This artifact is statically linked
2.0.70.Final2.0.81.Final
Apache 2.0
io.netty » netty-tcnative-boringssl-static
A Mavenized fork of Tomcat Native which incorporates various patches. This artifact is statically linked
2.0.70.Final2.0.81.Final
Network Framework Apache 2.0
io.netty » netty-all
Netty is a NIO client server framework which enables quick and easy development of network applications such as protocol ...
4.1.118.Final4.2.16.Final
Apache 2.0
io.netty » netty-buffer
Netty's byte buffer implementation offering efficient memory management and I/O operations for network applications.
4.1.118.Final4.2.16.Final
Netty Codec Apache 2.0
io.netty » netty-codec3 vulnerabilities
Netty module for encoding and decoding binary and text-based messages with reusable codec components.
4.1.118.Final4.2.16.Final
DNS Lib Apache 2.0
io.netty » netty-codec-dns1 vulnerability 4.1.118.Final4.2.17.Final
Netty Codec Apache 2.0
io.netty » netty-codec-http17 vulnerabilities
Netty codec module for encoding and decoding HTTP messages and handling HTTP protocol logic.
4.1.118.Final4.2.16.Final
Netty Codec Apache 2.0
io.netty » netty-codec-http28 vulnerabilities 4.1.118.Final4.2.16.Final
Netty Codec Apache 2.0
io.netty » netty-codec-socks4.1.118.Final4.2.16.Final
Apache 2.0
io.netty » netty-common
Core utilities and abstractions shared across Netty modules, including buffers, threading, and platform detection.
4.1.118.Final4.2.16.Final
Apache 2.0
io.netty » netty-handler3 vulnerabilities
A core Netty module that provides high-level channel handlers for protocol implementations and network applications.
4.1.118.Final4.2.16.Final
Apache
io.netty » netty-transport-native-unix-common
Static library which contains common unix utilities.
4.1.118.Final4.2.17.Final
Apache 2.0
io.netty » netty-handler-proxy1 vulnerability 4.1.118.Final4.2.16.Final
Apache 2.0
io.netty » netty-resolver4.1.118.Final4.2.16.Final
DNS Lib Apache 2.0
io.netty » netty-resolver-dns3 vulnerabilities 4.1.118.Final4.2.16.Final
Apache 2.0
io.netty » netty-transport
Netty module responsible for low-level transport abstraction, used for TCP, UDP, and domain sockets.
4.1.118.Final4.2.16.Final
Apache
io.netty » netty-transport-classes-epoll4.1.118.Final4.2.17.Final
Apache 2.0
io.netty » netty-transport-classes-kqueue4.1.118.Final4.2.16.Final
Apache 2.0
io.netty » netty-transport-native-epoll1 vulnerability
Netty transport implementation using Linux epoll for efficient I/O on native platforms.
4.1.118.Final4.2.16.Final
Apache 2.0
io.netty » netty-transport-native-epoll1 vulnerability
Netty transport implementation using Linux epoll for efficient I/O on native platforms.
4.1.118.Final4.2.16.Final
Apache 2.0
io.netty » netty-transport-native-kqueue1 vulnerability 4.1.118.Final4.2.16.Final
Apache 2.0
io.netty » netty-transport-native-kqueue1 vulnerability 4.1.118.Final4.2.16.Final
Annotation Lib EPL 2.0 +1
jakarta.annotation » jakarta.annotation-api
Jakarta Annotations API
2.1.13.0.0
Dep Injection Apache 2.0
jakarta.inject » jakarta.inject-api
Jakarta Dependency Injection
2.0.1
Java Spec EPL 2.0 +1
jakarta.servlet » jakarta.servlet-api
API for Jakarta Servlet, enabling web applications to handle HTTP requests and responses through a standard interface ...
5.0.06.1.0
Validation Apache 2.0
jakarta.validation » jakarta.validation-api
JavaBeans Validation (Bean Validation) is a validation model that can add constraints to the beans with annotations ...
3.0.23.1.1
Java Spec EPL 2.0 +1
jakarta.ws.rs » jakarta.ws.rs-api
Jakarta RESTful Web Services
3.0.04.0.0
Annotation Lib EPL 2.0 +1
javax.annotation » javax.annotation-api
Jakarta Annotations API
1.3.23.0.0
Java Spec EPL 2.0 +1
javax.servlet » javax.servlet-api
API for Jakarta Servlet, enabling web applications to handle HTTP requests and responses through a standard interface ...
4.0.16.1.0
net.razorvine » pickle
A feature complete pickle protocol implementation (Python's builtin serialization mechanism)
1.5
net.sf.py4j » py4j
Py4J enables Python programs running in a Python interpreter to dynamically access Java objects in a Java Virtual ...
0.10.9.9
Parser Generator BSD 3-clause
org.antlr » antlr4-runtime
The ANTLR 4 Runtime
4.13.14.13.2
Data Format Apache 2.0
org.apache.arrow » arrow-vector
An off-heap reference implementation for Arrow columnar data format.
18.1.019.0.0
Apache 2.0
org.apache.arrow » arrow-format
Generated Java files from the IPC Flatbuffer definitions.
18.1.019.0.0
Apache 2.0
org.apache.arrow » arrow-memory-core
Core off-heap memory management libraries for Arrow ValueVectors.
18.1.019.0.0
Apache 2.0
org.apache.arrow » arrow-memory-netty
Netty allocator and utils for allocating memory in Arrow
18.1.019.0.0
Apache 2.0
org.apache.arrow » arrow-memory-netty-buffer-patch
Netty Buffer needed to patch that is consumed by Arrow Memory Netty
18.1.019.0.0
Data Format Apache 2.0
org.apache.avro » avro
Avro is a row-oriented remote procedure call and data serialization framework that produces a compact binary format.
1.12.01.12.1
Apache 2.0
org.apache.avro » avro-mapred
An org.apache.hadoop.mapred compatible API for using Avro Serialization in Hadoop
1.12.01.12.1
Dist Communication Apache 2.0
org.apache.avro » avro-ipc
Avro inter-process communication components
1.12.01.12.1
Compression Apache 2.0
org.apache.commons » commons-compress
Apache Commons Compress defines an API for working with
1.27.11.28.0
Core Utils Apache 2.0
org.apache.commons » commons-lang31 vulnerability
Apache Commons Lang, a package of Java utility classes for the classes that are in java.lang's hierarchy, or are ...
3.17.03.20.0
Math Lib Apache 2.0
org.apache.commons » commons-math3
Alternate implementations of JDK's "Math" functions.
3.6.14.0-beta1
String Utils Apache 2.0
org.apache.commons » commons-text
The Commons Text library provides additions to the standard JDK text handling. It includes algorithms for string ...
1.13.01.15.0
Collections Apache 2.0
org.apache.commons » commons-collections4
The Apache Commons Collections package contains types that extend and augment the Java Collections Framework.
4.44.5.0
Encryption Lib Apache 2.0
org.apache.commons » commons-crypto
Apache Commons Crypto is a cryptographic library optimized with AES-NI (Advanced Encryption
1.1.01.2.0
Dist Coordination Apache 2.0
org.apache.curator » curator-recipes
All of the recipes listed on the ZooKeeper recipes doc (except two phase commit).
5.7.15.9.0
Dist Coordination Apache 2.0
org.apache.curator » curator-framework
High-level API that greatly simplifies using ZooKeeper.
5.7.15.9.0
Apache 2.0
org.apache.curator » curator-client
Low-level API
5.7.15.9.0
Apache 2.0
org.apache.datasketches » datasketches-java
Core sketch algorithms used alone and by other Java repositories in the Apache DataSketches Project.
6.1.19.0.0
Apache 2.0
org.apache.datasketches » datasketches-memory
High-performance native memory access.
3.0.27.0.0
Apache 2.0
org.apache.hadoop » hadoop-client-api
Apache Hadoop Client
3.4.13.5.0
Apache 2.0
org.apache.hadoop » hadoop-client-runtime
Apache Hadoop Client
3.4.13.5.0
Apache 2.0
org.apache.hive » hive-storage-api2.8.14.2.0
Apache 2.0
org.apache.ivy » ivy
Apache Ivy is a popular dependency manager focusing on flexibility and simplicity.
2.5.32.6.0
Logging Bridge Apache 2.0
org.apache.logging.log4j » log4j-slf4j2-impl
The Apache Log4j SLF4J 2.0 API binding to Log4j 2 Core
2.24.32.26.1
Logging Apache 2.0
org.apache.logging.log4j » log4j-api
API for Apache Log4J, a highly configurable logging tool that focuses on performance and low garbage generation. It has ...
2.24.32.26.1
Logging Apache 2.0
org.apache.logging.log4j » log4j-core4 vulnerabilities
Implementation for Apache Log4J, a highly configurable logging tool that focuses on performance and low garbage ...
2.24.32.26.1
Logging Bridge Apache 2.0
org.apache.logging.log4j » log4j-1.2-api1 vulnerability
The Apache Log4j 1.x Compatibility API
2.24.32.26.1
Apache 2.0
org.apache.logging.log4j » log4j-layout-template-json1 vulnerability
JSON Template Layout is a customizable, efficient, and garbage-free JSON generating Apache Log4j layout.
2.24.32.26.1
Data Format Apache 2.0
org.apache.orc » orc-format
ORC is a self-describing type-aware columnar file format designed
1.1.1
Apache 2.0
org.apache.orc » orc-core
The core reader and writer for ORC files. Uses the vectorized column batch
2.1.42.3.1
Apache 2.0
org.apache.orc » orc-shims
A shim layer for supporting various versions of Hadoop dynamically.
2.1.42.3.1
Apache 2.0
org.apache.orc » orc-mapreduce
An implementation of Hadoop's mapred and mapreduce input and output formats
2.1.42.3.1
Data Format Apache 2.0
org.apache.parquet » parquet-column1.15.21.17.1
Apache 2.0
org.apache.parquet » parquet-common1.15.21.17.1
Apache 2.0
org.apache.parquet » parquet-encoding1.15.21.17.1
Apache 2.0
org.apache.parquet » parquet-format-structures
Parquet-mr related java classes to use the parquet-format thrift structures.
1.15.21.17.1
Data Format Apache 2.0
org.apache.parquet » parquet-hadoop1.15.21.17.1
Apache 2.0
org.apache.spark » spark-sketch_2.134.0.44.2.0
Dist Computing Apache 2.0
org.apache.spark » spark-core_2.13
Core libraries for Apache Spark, a unified analytics engine for large-scale data processing.
4.0.44.2.0
Apache 2.0
org.apache.spark » spark-launcher_2.134.0.44.2.0
Apache 2.0
org.apache.spark » spark-kvstore_2.134.0.44.2.0
Apache 2.0
org.apache.spark » spark-network-common_2.134.0.44.2.0
Apache 2.0
org.apache.spark » spark-network-shuffle_2.134.0.44.2.0
Apache 2.0
org.apache.spark » spark-unsafe_2.134.0.44.2.0
Apache 2.0
org.apache.spark » spark-common-utils_2.134.0.44.2.0
Apache 2.0
org.apache.spark » spark-catalyst_2.134.0.44.2.0
Apache 2.0
org.apache.spark » spark-sql-api_2.134.0.44.2.0
Data Format Apache 2.0
org.apache.spark » spark-variant_2.134.0.44.2.0
Apache 2.0
org.apache.spark » spark-tags_2.134.0.44.2.0
Apache 2.0
org.apache.ws.xmlschema » xmlschema-core
Commons XMLSchema is a light weight schema object model that can be used to manipulate or
2.3.12.3.2
Bytecode Apache 2.0
org.apache.xbean » xbean-asm9-shaded
Repackaged and shaded asm jars
4.264.31
Annotation Lib Apache 2.0
org.apache.yetus » audience-annotations
Annotations for defining API boundaries and tools for managing javadocs
0.12.00.15.1
Dist Coordination Apache 2.0
org.apache.zookeeper » zookeeper3 vulnerabilities
ZooKeeper server
3.9.33.9.5
Apache 2.0
org.apache.zookeeper » zookeeper-jute
ZooKeeper jute
3.9.33.9.5
JVM Languages BSD 3-clause
org.codehaus.janino » janino
The "JANINO" implementation of the "commons-compiler" API: Super-small, super-fast, independent from the JDK's ...
3.1.93.1.12
BSD 3-clause
org.codehaus.janino » commons-compiler
The "commons-compiler" API, including the "IExpressionEvaluator", "IScriptEvaluator", "IClassBodyEvaluator" and ...
3.1.93.1.12
LevelDB BSD 3-clause
org.fusesource.leveldbjni » leveldbjni-all
An uber jar which contains all the leveldbjni platform libraries and dependencies
1.8
EPL 2.0 +1
org.glassfish.hk2 » osgi-resource-locator1.0.33.0.0
EPL 2.0 +1
org.glassfish.hk2 » hk2-locator
ServiceLocator Default Implementation
3.0.64.0.1
EPL 2.0 +1
org.glassfish.hk2 » hk2-api
HK2 API module
3.0.64.0.1
EPL 2.0 +1
org.glassfish.hk2 » hk2-utils
HK2 Implementation Utilities
3.0.64.0.1
AOP EPL 2.0 +1
org.glassfish.hk2.external » aopalliance-repackaged3.0.64.0.1
Apache 2.0 +8
org.glassfish.jersey.containers » jersey-container-servlet
Jersey core Servlet 3.x implementation
3.0.184.0.2
Apache 2.0 +8
org.glassfish.jersey.containers » jersey-container-servlet-core
Jersey core Servlet 3.x implementation
3.0.183.1.12
Apache 2.0 +8
org.glassfish.jersey.core » jersey-client
Jersey core client implementation
3.0.184.0.2
Apache 2.0 +4
org.glassfish.jersey.core » jersey-common
Jersey core common packages
3.0.184.0.2
Apache 2.0 +3
org.glassfish.jersey.core » jersey-server
Jersey core server implementation
3.0.184.0.2
Apache 2.0 +8
org.glassfish.jersey.inject » jersey-hk2
HK2 InjectionManager implementation
3.0.184.0.2
Bytecode Apache 2.0 +2
org.javassist » javassist
Javassist (JAVA programming ASSISTant) makes Java bytecode manipulation
3.30.2-GA3.32.0-GA
Annotation Lib Apache 2.0
org.jetbrains » annotations
A set of annotations used for code inspection support and code documentation.
17.0.026.1.0
JSON Lib Apache 2.0
org.json4s » json4s-jackson_2.13
json4s-jackson
4.0.7
Apache 2.0
org.json4s » json4s-core_2.13
json4s-core
4.0.7
Apache 2.0
org.json4s » json4s-ast_2.13
json4s-ast
4.0.7
Apache 2.0
org.json4s » json4s-scalap_2.13
json4s-scalap
4.0.7
Apache 2.0
org.json4s » json4s-jackson-core_2.13
json4s-jackson-core
4.0.7
Compression Apache 2.0
org.lz4 » lz4-java3 vulnerabilities
Java bindings and pure Java implementations of LZ4 and XXHash
1.8.01.11.1
Reflection Apache 2.0
org.objenesis » objenesis
A library for instantiating Java objects
3.33.6
Collections Apache 2.0
org.roaringbitmap » RoaringBitmap
Roaring bitmaps are compressed bitmaps (also called bitsets) which tend to outperform conventional compressed bitmaps ...
1.3.01.6.19
Apache 2.0 +1
org.rocksdb » rocksdbjni
RocksDB Java API and Native Libraries
9.8.410.10.1.1
Lang Runtime Apache 2.0
org.scala-lang » scala-library
Standard library for the Scala Programming Language Version 3
2.13.163.8.4
Scala Compiler Apache 2.0
org.scala-lang » scala-reflect
Reflection Library for the Scala Programming Language
2.13.162.13.18
XML Processing Apache 2.0
org.scala-lang.modules » scala-xml_2.13
The standard Scala XML library that lets you include XML literals anywhere that a scala expression is valid.
2.3.02.4.0
Parser Generator Apache 2.0
org.scala-lang.modules » scala-parser-combinators_2.13
scala-parser-combinators
2.4.0
Collections Apache 2.0
org.scala-lang.modules » scala-parallel-collections_2.13
scala-parallel-collections
1.2.0
org.slf4j » jul-to-slf4j
Jul-to-slf4j includes a java.util.logging (jul) handler, namely SLF4JBridgeHandler, which routes all incoming jul ...
2.0.162.0.18
Logging Bridge Apache 2.0
org.slf4j » jcl-over-slf4j
Jakarta/Apache commons logging 1.2 implemented over SLF4J
2.0.162.0.18
Logging MIT
org.slf4j » slf4j-api
API for SLF4J (The Simple Logging Facade for Java) which serves as a simple facade or abstraction for various logging ...
2.0.162.0.18
BSD 3-clause
org.threeten » threeten-extra
Additional functionality that enhances JSR-310 dates and times in Java SE 8 and later
1.8.01.10.0
org.tukaani » xz
XZ data compression
1.101.12
Compression Apache 2.0
org.xerial.snappy » snappy-java
snappy-java: A fast compression/decompression library
1.1.10.71.1.10.8
Regexp Apache
oro » oro
Library from Apache Jakarta for regular expressions, text processing, and pattern matching in Java.
2.0.8

Runtime Dependencies (2)

Category/LicenseGroup / ArtifactVersionUpdates
Apache 2.0
io.netty » netty-transport-native-epoll1 vulnerability
Netty transport implementation using Linux epoll for efficient I/O on native platforms.
4.1.118.Final4.2.16.Final
Apache 2.0
org.apache.parquet » parquet-jackson1.15.21.17.1