Job description

Provides expertise on the design and participates in building of data infrastructure to optimize data processing from a variety of data sources. Independently designs and implements data governance policies and procedures for data handling to manage data consistency, integrity, accuracy, and reliability. Provides expertise on and participates in the design and implementation of rigorous data validation and integrity checks, proactively mitigating data quality issues that could impact data pipeline and model performance. Leverages advanced knowledge of Extract, Transform, and Load (ETL) processes to design, develop, and optimize automated, scalable, and efficient data pipeline architectures to build reusable data products. Works independently and collaboratively in an agile development environment with other engineers to develop, maintain, and debug advanced data solutions that are scalable, efficient, cost effective, and reliable. Key Responsibilities Data Processing & Pipelining – Data Requirements, Collection, and Infrastructure: • Mentors less experienced team members to identify data requirements and business objectives of a project or initiative. • Provides expertise on the design and participates in building of data infrastructure to optimize data processing from a variety of data sources. • Independently analyzes, designs, and troubleshoots data flows based on business needs. • Participates and designs architecture, performance, and security reviews of the technical solution. • Adjusts data collection processes that involve indexing and query optimizations for optimal performance. • Builds Extract, Transform, and Load (ETL) pipelines to support efficient and scalable data collection and extraction. • Engages with and holds the upstream and downstream teams accountable for the predefined service level agreements (SLAs). • Manages relationships with the data providers. Data Processing & Pipelining – Data Governance: • Independently designs and implements data governance policies and procedures for data handling (e.g., data retention) to manage data consistency, integrity, accuracy, and reliability throughout the data lifecycle. • Leads the execution of redaction processes for Personally Identifiable Information (PII) and Protected Health Information (PHI) data, ensuring compliance with data privacy and security standards. • Ensures minimal data collection and usage in accordance with data minimization principles. • Follows data security measures to protect data from unauthorized access, use, disclosure, alteration, or destruction, proactively identifying and escalating potential issues. • Ensures data compliance with relevant laws, regulations, and industry standards. Data Processing & Pipelining – Data Validation & Quality Assurance: • Provides expertise on and participates in the design and implementation of rigorous data validation and integrity checks, proactively mitigating data quality issues that could impact data pipeline and model performance. • Mentors less experienced team members to define data annotation and labeling processes to ensure data quality. • Identifies opportunities for automation of data validation and governance, and implements them. • Independently corrects deviations and non-conformance when identified. Data Pipeline and Solutions Engineering – Pipeline Design: • Leverages advanced knowledge of ETL processes to design, develop, and optimize automated, scalable, and efficient data pipeline architectures to build reusable data products. • Implements advanced data storage solutions to store the processed data to be used in a scalable, optimized, and efficient way for access and analysis. • Mentors less experienced team members to manage the flow of data pipeline and storage day-to-day operations. Data Pipeline and Solutions Engineering – Data Solutions Engineering: • Works independently and collaboratively in an agile development environment with other engineers to develop, maintain, and debug advanced data solutions that are scalable, efficient, cost effective, and reliable. • Reviews runnable code and works on testing and debugging of data solutions with less experienced team members. • Evaluates new technologies to create more robust data solutions. • Enforces and documents code standards and guidance within the team. • Creates documentation for design decisions, and obtains feedback from the broader architecture team before implementing. • Gathers data and evidence to secure necessary approvals. Core Responsibilities Planning & Execution: • Manages and coordinates moderately complex tasks, monitoring timelines and deliverables to ensure timely completion and adherence to requirements for a moderately sized project or initiative. • Efficiently delegates, monitors, and prioritizes work across multiple projects, providing technical oversight and adjusting plans to address shifts in resources or timelines. Collaboration & Partnership: • Collaborates across the organization to align on expectations and achieve shared objectives. • Leverages understanding of business leaders, stakeholders, and/or customers to ensure proposed solutions meet their needs. • Supports inclusivity by actively seeking and listening to diverse perspectives, ensuring others feel heard and respected. Problem Solving: • Identifies and addresses moderately complex issues by analyzing a wide range of data and/or information to identify solutions in accordance with standard practices. • Proactively escalates unresolved or critical issues with a thorough assessment and suggests potential solutions. • Reviews, contributes to, and documents problem solving strategies. Continuous Learning: • Pursues learning opportunities to expand knowledge and skills and/or tools in new areas and stays abreast of the latest industry trends and best practices. • Proactively seeks and leverages ongoing feedback and training to improve skills. • Coaches and mentors junior team members, fostering continuous learning and knowledge sharing within and across teams. Continuous Improvement: • Develops ideas, recommends updates, and/or collaborates on the implementation of process improvements to increase the efficiency and effectiveness of processes, protocols, and workflows across teams, and evaluates the impact on key stakeholders. • Solicits feedback from others on ideas for alternative approaches and methods for continued improvement. Performance and Development: • Contributes to the talent development pipeline by participating in candidate interviews, assessing candidates, and providing hiring recommendations. #LI-AJP Disclaimer: Certain U.S. based or U.S. customer or client-facing roles may be required to comply with applicable requirements, such as immunization/occupational health mandates, and/or drug testing requirements. Range and benefit information provided in this posting are specific to the stated locations only US: Hiring Range in USD from: $114,600 to $234,600 per annum. May be eligible for bonus, equity, and compensation deferral. Oracle maintains broad salary ranges for its roles in order to account for variations in knowledge, skills, experience, market conditions and locations, as well as reflect Oracle's differing products, industries and lines of business. Candidates are typically placed into the range based on the preceding factors as well as internal peer equity. Oracle US offers a comprehensive benefits package which includes the following: 1. Medical, dental, and vision insurance, including expert medical opinion 2. Short term disability and long term disability 3. Life insurance and AD&D 4. Supplemental life insurance (Employee/Spouse/Child) 5. Health care and dependent care Flexible Spending Accounts 6. Pre-tax commuter and parking benefits 7. 401(k) Savings and Investment Plan with company match 8. Paid time off: Flexible Vacation is provided to all eligible employees assigned to a salaried (non-overtime eligible) position. Accrued Vacation is provided to all other employees eligible for vacation benefits. For employees working at least 35 hours per week, the vacation accrual rate is 13 days annually for the first three years of employment and 18 days annually for subsequent years of employment. Vacation accrual is prorated for employees working between 20 and 34 hours per week. Employees working fewer than 20 hours per week are not eligible for vacation. 9. 11 paid holidays 10. Paid sick leave: 72 hours of paid sick leave upon date of hire. Refreshes each calendar year. Unused balance will carry over each year up to a maximum cap of 112 hours. 11. Paid parental leave 12. Adoption assistance 13. Employee Stock Purchase Plan 14. Financial planning and group legal 15. Voluntary benefits including auto, homeowner and pet insurance The role will generally accept applications for at least three calendar days from the posting date or as long as the job remains posted. Career Level - IC4 As a Principal Data Engineer, you will be at the forefront of Oracle’s Cloud Infrastructure Marketplace data initiatives, playing a pivotal role in transforming raw data into actionable insights. Collaborating with OCI engineering leadership, product managers, data scientists and business stakeholders, you will design scalable data pipelines, optimize data infrastructure, and ensure the availability of high-quality datasets for strategic analysis. This role goes beyond data engineering, requiring hands-on involvement in statistical analysis and predictive modeling. You will use techniques such as regression analysis, trend forecasting, and time-series modeling to extract meaningful insights from data, directly supporting business decision-making.

Requirements

Must-haves

Data Processing & Pipelining – Data Requirements, Collection, and Infrastructure:
Mentors less experienced team members to identify data requirements and business objectives of a project or initiative.
Provides expertise on the design and participates in building of data infrastructure to optimize data processing from a variety of data sources.
Independently analyzes, designs, and troubleshoots data flows based on business needs.
Participates and designs architecture, performance, and security reviews of the technical solution.
Adjusts data collection processes that involve indexing and query optimizations for optimal performance.
Builds Extract, Transform, and Load (ETL) pipelines to support efficient and scalable data collection and extraction.
Engages with and holds the upstream and downstream teams accountable for the predefined service level agreements (SLAs).
Manages relationships with the data providers.
Independently designs and implements data governance policies and procedures for data handling (e.g., data retention) to manage data consistency, integrity, accuracy, and reliability throughout the data lifecycle.
Leads the execution of redaction processes for Personally Identifiable Information (PII) and Protected Health Information (PHI) data, ensuring compliance with data privacy and security standards.
Ensures minimal data collection and usage in accordance with data minimization principles.
Follows data security measures to protect data from unauthorized access, use, disclosure, alteration, or destruction, proactively identifying and escalating potential issues.
Ensures data compliance with relevant laws, regulations, and industry standards.
Data Processing & Pipelining – Data Validation & Quality Assurance:
Provides expertise on and participates in the design and implementation of rigorous data validation and integrity checks, proactively mitigating data quality issues that could impact data pipeline and model performance.
Mentors less experienced team members to define data annotation and labeling processes to ensure data quality.
Identifies opportunities for automation of data validation and governance, and implements them.
Independently corrects deviations and non-conformance when identified.
Data Pipeline and Solutions Engineering – Pipeline Design:
Leverages advanced knowledge of ETL processes to design, develop, and optimize automated, scalable, and efficient data pipeline architectures to build reusable data products.
Implements advanced data storage solutions to store the processed data to be used in a scalable, optimized, and efficient way for access and analysis.
Mentors less experienced team members to manage the flow of data pipeline and storage day-to-day operations.
Data Pipeline and Solutions Engineering – Data Solutions Engineering:

Nice-to-haves

None flagged.

Application prep

Use the role’s language and application details while tailoring your materials.

Keywords to mirror

agile

Platform: oracle-cloud
Effort: medium

Benefits

Benefits detected in the listing.

Dental

Vision

401(K)

Paid Time Off

Parental Leave