Job description

What to expect of your role: We are looking for a Data Engineer to help us develop and maintain our data platform. Our infrastructure is primarily AWS-based, with Airflow, S3 and Redshift at its core, alongside a legacy stack based on MS SQL Server, SSIS and custom Python scripts. You will work on building reliable data pipelines, improving our data infrastructure, and gradually modernising legacy processes. What you need to succeed in this role: 2+ years of professional experience in data engineering; Strong SQL and Python skills; Hands-on experience with AWS, including S3, Redshift, Glue and Lambda; Hands-on experience with Apache Airflow; Strong understanding of data warehousing concepts and data modelling; Hands-on experience designing, developing and maintaining production data pipelines, with a focus on reliability, monitoring and data quality; Solid understanding of relational and non-relational databases; Familiarity with Git and CI/CD practices, preferably GitLab; Experience developing APIs and data integrations; Kafka and real-time data processing experience is a plus; MS SQL Server and SSIS experience is a plus; Good written and verbal communication skills; Upper-intermediate English or higher. You will be expected to: Design, develop and maintain scalable and reliable data pipelines and ETL/ELT processes; Develop and optimise data warehouse solutions; Develop and maintain data infrastructure, primarily on AWS, while also supporting parts of our legacy infrastructure; Develop APIs and data integrations; Contribute to the development and maintenance of real-time data pipelines using Kafka; Automate and optimise data processes and workflows; Monitor, troubleshoot and improve the reliability, performance, security and data quality of pipelines and infrastructure; Work closely with the analytics team and other stakeholders to understand their data needs and deliver effective solutions; Maintain clear and up-to-date documentation for data pipelines, infrastructure and workflows; Contribute to the improvement and modernisation of existing data processes and architecture. About our corporate culture: As an international team, we are motivated by the freedom to do our best work. Our employees are autonomous and responsible for their projects, taking the initiative when necessary, not giving up on their opinions, and speaking freely. We invest in the potential of each person, confident that together, our skills will shape the company’s future success. Reasons to join us: Our positive workplace atmosphere creates a culture of collaboration and support, making it a place you'll love working in; We offer competitive compensation and regular career development reviews to motivate you to reach your full potential and love the work you do; With flexible working hours and remote options, you'll love the freedom to work on your terms; We offer a generous vacation and sick leave policy, allowing you to take time off and enjoy a work-life balance; You'll love working here because we provide financial assistance for professional development, helping you stay ahead of the curve and love your career path; Our Educational Allowances give you the opportunity to expand your knowledge and experience, not only in your work but also in other areas; You'll love the monthly allowance for personal activities, giving you the opportunity to pursue your interests and hobbies outside of work; At our company, we prioritise the health and well-being of our employees, which is why we offer comprehensive health insurance plans; Our referral program rewards you for bringing top talent to the company, making it a place you enjoy sharing with others; With engaging team-building activities and corporate parties, you'll love being part of our community and team spirit. Ready to join us? Apply for this position! What’s next? Our recruiters will review your CV and reach out to you if you are suitable for the role. What your process will look like: HR Interview with the Recruiter; Final interview with the team; Final decision. Our recruitment team is very willing to help out, so contact us with any questions you may have!

Requirements

Must-haves

What you need to succeed in this role:
2+ years of professional experience in data engineering;
Strong SQL and Python skills;
Hands-on experience with AWS, including S3, Redshift, Glue and Lambda;
Hands-on experience with Apache Airflow;
Strong understanding of data warehousing concepts and data modelling;
Hands-on experience designing, developing and maintaining production data pipelines, with a focus on reliability, monitoring and data quality;
Solid understanding of relational and non-relational databases;
Familiarity with Git and CI/CD practices, preferably GitLab;
Experience developing APIs and data integrations;
Good written and verbal communication skills;
Upper-intermediate English or higher.
Design, develop and maintain scalable and reliable data pipelines and ETL/ELT processes;
Develop and optimise data warehouse solutions;
Develop and maintain data infrastructure, primarily on AWS, while also supporting parts of our legacy infrastructure;
Develop APIs and data integrations;
Contribute to the development and maintenance of real-time data pipelines using Kafka;
Automate and optimise data processes and workflows;
Monitor, troubleshoot and improve the reliability, performance, security and data quality of pipelines and infrastructure;
Work closely with the analytics team and other stakeholders to understand their data needs and deliver effective solutions;
Maintain clear and up-to-date documentation for data pipelines, infrastructure and workflows;
Contribute to the improvement and modernisation of existing data processes and architecture.

Nice-to-haves

Kafka and real-time data processing experience is a plus;
MS SQL Server and SSIS experience is a plus;

Application prep

Use the role’s language and application details while tailoring your materials.

Keywords to mirror

awssqlpythonci/cd

Platform: bamboohr
Effort: medium

Benefits

Benefits detected in the listing.

Health Insurance

Professional Development