Job description

Long term contract position with a financial firm. Hybrid 3 days/week in Newark, NJ. 1. Design and development of batch and real-time data pipelines using AWS Data & Analytics Services such as AWS Glue, Athena, Lambda, Redshift etc., 2. Experience in building complex data processing and ETL jobs using Pyspark and SQL 3. Experience in ingesting and processing structured and semi-structured data 4. Exposure to data warehousing, data lake and lake house architectures 5. Good understanding of different data modeling techniques 6. Ability to optimize cost and improve performance of data pipelines 7. Exposure to CI/CD process 8. Knowledge of best practices in securing data pipelines and data assets in AWS. 9. Knowledge of data quality and data governance processes is a plus. payrate - 65 - 80 per hour depending on experience. #LI-AC1

Requirements

Must-haves

Long term contract position with a financial firm.
Hybrid 3 days/week in Newark, NJ.
Design and development of batch and real-time data pipelines using AWS Data & Analytics Services such as AWS Glue, Athena, Lambda, Redshift etc.,
Experience in building complex data processing and ETL jobs using Pyspark and SQL
Experience in ingesting and processing structured and semi-structured data
Exposure to data warehousing, data lake and lake house architectures
Good understanding of different data modeling techniques
Ability to optimize cost and improve performance of data pipelines
Exposure to CI/CD process
Knowledge of best practices in securing data pipelines and data assets in AWS.
payrate - 65 - 80 per hour depending on experience.

Nice-to-haves

Knowledge of data quality and data governance processes is a plus.

Application prep

Use the role’s language and application details while tailoring your materials.

Keywords to mirror

awssqlci/cd

Platform: jobdiva
Effort: medium