Job description

Must Have Technical/Functional Skills • Google Cloud Platform (GCP) • PySpark • Python • Airflow • Hive • Kafka Data Pipeline Development, Enhancement & Maintenance • Design, build, and maintain scalable ETL/ELT pipelines. • Automate data ingestion from multiple data sources. • Ensure reliable, high-performance, and scalable data movement. • Develop and optimize PySpark-based data processing frameworks. • Build and manage Airflow workflows and orchestration pipelines. • Work with Hive and Kafka-based batch and streaming data solutions. • Implement data quality, monitoring, governance, and operational controls. • Support production incidents, performance tuning, and continuous improvement initiatives Roles & Responsibilities • The Data Engineer will be responsible for designing, building, governing, and optimizing data platforms, pipelines, and integrations to ensure secure, reliable, and scalable data availability for analytics, reporting, AI/ML, and business operations. Preferred Experience • Strong Functional Knowledge in Retail (Search & Personalization) Added advantage. • Strong experience with large-scale GCP Data Engineering solutions. • Hands-on experience with Airflow DAG development and support • Experience building and optimizing Spark/PySpark data pipelines. • Exposure to Hive-based data processing and Kafka-driven ingestion frameworks. • Experience supporting analytics, personalization, recommendation, or search platforms is highly desirable TCS Employee Benefits Summary: • Discretionary Annual Incentive. • Comprehensive Medical Coverage: Medical & Health, Dental & Vision, Disability Planning & Insurance, Pet Insurance Plans. • Family Support: Maternal & Parental Leaves. • Insurance Options: Aut& Home Insurance, Identity Theft Protection. • Convenience & Professional Growth: Commuter Benefits & Certification & Training Reimbursement. • Time Off: Vacation, Time Off, Sick Leave & Holidays. • Legal & Financial Assistance: Legal Assistance, 401K Plan, Performance Bonus, College Fund, Student Loan Refinancing. #LI-KR3 Salary Range-$100,000-$120,000 a year

Requirements

Must-haves

Must Have Technical/Functional Skills
Google Cloud Platform (GCP)
Data Pipeline Development, Enhancement & Maintenance
Design, build, and maintain scalable ETL/ELT pipelines.
Automate data ingestion from multiple data sources.
Ensure reliable, high-performance, and scalable data movement.
Develop and optimize PySpark-based data processing frameworks.
Build and manage Airflow workflows and orchestration pipelines.
Work with Hive and Kafka-based batch and streaming data solutions.
Implement data quality, monitoring, governance, and operational controls.
Support production incidents, performance tuning, and continuous improvement initiatives
Roles & Responsibilities
Discretionary Annual Incentive.
Family Support: Maternal & Parental Leaves.
Insurance Options: Aut& Home Insurance, Identity Theft Protection.
Time Off: Vacation, Time Off, Sick Leave & Holidays.

Nice-to-haves

Strong Functional Knowledge in Retail (Search & Personalization) Added advantage.
Strong experience with large-scale GCP Data Engineering solutions.
Hands-on experience with Airflow DAG development and support
Experience building and optimizing Spark/PySpark data pipelines.
Exposure to Hive-based data processing and Kafka-driven ingestion frameworks.
Experience supporting analytics, personalization, recommendation, or search platforms is highly desirable

Application prep

Use the role’s language and application details while tailoring your materials.

Keywords to mirror

gcppythonaiml

Platform: careers-page
Effort: medium

Benefits

Benefits detected in the listing.

Dental

Vision

401k

Parental Leave