Utils is a library for Application collection of utilities for trigger and track spark Application in Kubernetes, Databricks and EMR with some additinoal functions

inferencer is a Spark library for which curate files through given input parameters and load thenm into target, source can be HDFS,S3,Local filesystem to another distributed/local filesystem with Schema retained formats(preferred parquet/ORC/Avro)

Pipeline is a application framework to orchestrate and stitch multiple apps to run sequentially. Framework provides sequential dependency,configuration sharing, restartability, sequence checking(order of execution) for applications