Job description

ComResource is looking for a Staff Data Engineer. Responsibilities: Software Development • Design and implement high-quality software features and components for complex software solutions, including the responsible use of agentic coding tools to enhance productivity, maintainability, and software quality. • Select appropriate design patterns and follow industry best practices to create maintainable, long-lived code. • Lead sizing and complexity evaluation discussions for initiatives. • Troubleshoot complex software, application, and performance issues through analysis, testing, benchmarking, and root-cause investigation. • Facilitate effective team collaboration, guiding and mentoring peers in engineering best practices. Testing & Quality Assurance • Define and implement test practices and QA processes covering all layers of the application including unit, system, end-to-end, security, performance, regression, and automation testing. • Coach teams on testing techniques including TDD, BDD, and testing for positive and negative scenarios. Data Management • Devise data storage and access strategies that meet the needs of high-complexity features. • Design and implement scalable data ingestion and processing solutions supporting analytical and operational workloads. • Apply data modeling, schema design, query optimization, and database performance tuning techniques for relational database systems. • Design solutions that address data quality, idempotency, late-arriving data, scalability, and maintainability requirements. Infrastructure & Integrations • Advise on and pilot specialized cloud services for analytics and AI/ML. • Design and support cloud-native solutions leveraging AWS technologies including MWAA (Apache Airflow), Glue, Lambda, SQS, S3, EKS (Kubernetes), Aurora PostgreSQL, and Redshift. • Provide expert-level management of relational and non-relational database servers. • Manage infrastructure using IaC including Terraform. • Build and maintain CI/CD pipelines using tools such as GitHub Actions or Concourse. • Design systems for high availability, load balancing, and disaster recovery. Operations • Support production systems through deployment activities, monitoring, incident response, troubleshooting, and operational improvements. • Improve operations culture by defining best practices, metric radiation, and identification of operational patterns. • Utilize techniques like blue/green deployments to minimize user impact. • Participate in on-call support processes as needed. Security & Compliance • Lead the team in development of software with a security-first mindset covering standard security protocols, common security risks, secure coding techniques, and appropriate protection of sensitive information including PHI. • Proactively design secure code employing best practices and threat modeling. • Implement secure integration methods and data-transfer protocols including TLS, SFTP, PGP, and equivalent technologies. • Complete regulatory compliance documentation and design security safeguards. Requirements & Design • Collaborate with technical and business stakeholders to design appropriate systems based on business needs and technical constraints. • Write detailed technical stories and technical epics. • Define and manage tech debt and employ industry-recognized architectural patterns to create large-scale, highly reliable system designs. • Translate business needs into practical technical solutions that balance functionality, maintainability, scalability, and delivery timelines. Team Leadership & Collaboration • Assist with planning, estimating, and coordinating delivery of work across multiple concurrent initiatives. • Provide technical mentorship and constructive feedback to engineers on the team. • Support adoption of engineering standards and development, testing, and documentation practices. • Build strong working relationships with technical and non-technical stakeholders. Essentials: • Bachelor's degree or equivalent work experience in Computer Science, Computer Engineering, Electrical Engineering, Information Systems, or IT. • 10+ years of software engineering experience. • High level of experience with Python and strong experience with at least one other programming language; TypeScript and/or Java preferred. • Experience with cloud computing platforms and infrastructure as code with heavy use of MWAA (Apache Airflow), Glue, Lambda, SQS, S3, and EKS (Kubernetes). • High level of experience with SQL relational database management systems including database design, data modeling, and query optimization; PostgreSQL preferred. • Experience with non-relational databases and messaging systems. • Experience with standard service and software deployment patterns and CI/CD systems such as GitHub Actions or Concourse. • High level of experience developing, deploying, and supporting REST services and microservices. • Excellent written and verbal communication skills. Req ID: CG525115910

Requirements

Must-haves

ComResource is looking for a Staff Data Engineer.
Software Development
Design and implement high-quality software features and components for complex software solutions, including the responsible use of agentic coding tools to enhance productivity, maintainability, and software quality.
Select appropriate design patterns and follow industry best practices to create maintainable, long-lived code.
Lead sizing and complexity evaluation discussions for initiatives.
Troubleshoot complex software, application, and performance issues through analysis, testing, benchmarking, and root-cause investigation.
Facilitate effective team collaboration, guiding and mentoring peers in engineering best practices.
Testing & Quality Assurance
Define and implement test practices and QA processes covering all layers of the application including unit, system, end-to-end, security, performance, regression, and automation testing.
Coach teams on testing techniques including TDD, BDD, and testing for positive and negative scenarios.
Data Management
Devise data storage and access strategies that meet the needs of high-complexity features.
Design and implement scalable data ingestion and processing solutions supporting analytical and operational workloads.
Apply data modeling, schema design, query optimization, and database performance tuning techniques for relational database systems.
Design solutions that address data quality, idempotency, late-arriving data, scalability, and maintainability requirements.
Infrastructure & Integrations
Advise on and pilot specialized cloud services for analytics and AI/ML.
Design and support cloud-native solutions leveraging AWS technologies including MWAA (Apache Airflow), Glue, Lambda, SQS, S3, EKS (Kubernetes), Aurora PostgreSQL, and Redshift.
Provide expert-level management of relational and non-relational database servers.
Manage infrastructure using IaC including Terraform.
Build and maintain CI/CD pipelines using tools such as GitHub Actions or Concourse.
Design systems for high availability, load balancing, and disaster recovery.

Nice-to-haves

High level of experience with Python and strong experience with at least one other programming language; TypeScript and/or Java preferred.
High level of experience with SQL relational database management systems including database design, data modeling, and query optimization; PostgreSQL preferred.

Application prep

Use the role’s language and application details while tailoring your materials.

Keywords to mirror

aimlawskubernetesci/cddesign systemspythontypescriptjavasqlrest

Platform: avionte
Effort: medium