The project covers the complete data pipeline—from importing data from an RDS source to HDFS using Sqoop, processing data with Spark, to executing analytical queries on an AWS Redshift cluster.
aws spark apache-spark hdfs redshift rds sqoop data-pipeline data-ingestion etl-processes data-engineering-etl-assignment
-
Updated
Mar 10, 2025 - Jupyter Notebook