Home » io.github.queukat » oracletohivemigrator_2.12 » 2.0

OracleToHiveMigrator » 2.0

The Spark Universal Migrator is a data migration Spark application that fetches data from an Oracle database and stores it in a Hive database. It utilizes JDBC to connect to Oracle, processes and converts the data into a Hive-compatible schema, and then transfers it to Hive. The migration process employs iterators to generate queries for data retrieval and utilizes a BlockingQueue in conjunction with a ThreadPoolExecutor for parallel processing of data. Additionally, the application incorporates an Oracle ...

LicenseApache 2.0
Tagsgithub
Organization io.github.queukat
HomePage https://github.com/queukat/spark_oracle_hive_streaming 🔍 Inspect URL
DateAug 01, 2023
Filespom (3 KB)  jar (57 KB)  View All
RepositoriesCentral
Ranking#580496 in MvnRepository (See Top Artifacts)
Scala TargetScala 2.12 (View all targets)

Scope:
Scope:
Format:
Scope:
Scope:
Scope:
Scope:
Scope:
Scope:

Compile Dependencies (4)

Category/License Group / ArtifactVersionUpdates
JDBC Driver
com.oracle.database.jdbc » ojdbc8 21.9.0.019.29.0.0
JDBC Pool
com.oracle.database.jdbc » ucp 21.9.0.023.26.0.0.0
Logging
Apache 2.0		com.typesafe.scala-logging » scala-logging_2.12 3.9.5 ✔
JVM Languages
Apache 2.0		org.scala-lang » scala-library 2.12.173.7.4

Provided Dependencies (3)

Category/License Group / ArtifactVersionUpdates
Dist Computing
Apache 2.0		org.apache.spark » spark-core_2.12 3.4.04.0.1
SQL Lib
Apache 2.0		org.apache.spark » spark-sql_2.12 3.4.04.0.1
Hadoop Query Engine
Apache 2.0		org.apache.spark » spark-hive_2.12 3.4.04.0.1

Test Dependencies (1)

Category/License Group / ArtifactVersionUpdates
Testing
Apache 2.0		org.scalatest » scalatest_2.12 3.2.153.2.19

Licenses

LicenseURL
Apache 2 http://www.apache.org/licenses/LICENSE-2.0.txt

Developers

NameEmailDev IdRolesOrganization
yaroslavqueukat<at>gmail.comqueukat