Europe, Ukraine
Work type:
Office/Remote
Technical Level:
Senior
Job Category:
Software Development
Project:
Global stock photography provider
N-iX is looking for a Senior Data Engineer to support our client's Data Licensing team, which develops training datasets for frontier AI labs. You will own the onboarding and enrichment of new multimedia content. Extend scalable event-driven and batch-processing systems that produce reliable metadata for curation and customer-facing applications.
Our customer is a leading global provider of high-quality licensed images, videos, and music. Our customer helps inspire graphic designers, creative directors, video editors, filmmakers, web developers, and other creative professionals by providing diverse content to businesses, marketing agencies and media organizations around the world. Content creators contribute their work to our client, where end users buy and use it in a diverse array of creative personal and business projects. It's a two-sided marketplace that empowers the world's storytellers.
Responsibilities:
• Partner with the Principal Engineer, senior technical leaders and platform teams to implement and evolve the architectural direction for metadata-processing systems; independently own the design and delivery of assigned components.
• Evaluate and evolve orchestration for enrichment and backfill workloads, either by extending existing ingestion capabilities or integrating with new cloud-native services, while maintaining consistent contracts and lifecycle handling.
• Evolve shared frameworks so data scientists can package, test, validate and run production enrichment workloads with minimal data engineering support.
• Define and maintain metadata contracts, lineage, validation and quality controls.
• Contribute to and apply shared engineering standards, and provide technical guidance through design reviews, documentation and collaboration with data engineering and data science teams.
• Estimate and refine the cost, capacity and completion time of enrichment and backfill workloads.
• Partner with platform teams responsible for operating the underlying cloud infrastructure.
• Own time-sensitive customer and partner deliverables through production release.
Requirements:
• 6+ years of experience in data engineering, backend software engineering or distributed systems, including hands-on ownership of large-scale production data workloads.
• Demonstrated experience designing and operating large-scale ingestion or distributed data-processing systems.
• Strong Python software engineering and distributed processing experience.
• Practical knowledge of high-volume batch and event-driven architectures, including idempotency, replay, backpressure, retries and failure recovery.
• Experience enabling data science or ML workloads to move from prototype to production through reusable frameworks and engineering guardrails.
• Production experience with AWS and GCP, with the ability to design workflows spanning multiple cloud environments.
• Experience managing evolving data contracts, schemas, lineage and data-quality expectations.
• Ability to benchmark distributed workloads and translate results into credible capacity, execution-time and cloud-cost projections.
• Experience setting engineering standards, reviewing system designs and mentoring engineers or data scientists.
• Track record of delivering critical, time-sensitive systems into production.
• English level - upper-intermediate
Nice to have:
• Containerized CPU/GPU batch and ML workloads using managed compute services such as SageMaker, AWS Batch, ECS, Cloud Batch or GKE/EKS.
• Event-driven orchestration and messaging using services such as Step Functions, Lambda, EventBridge, Kinesis, Workflows or Pub/Sub.
• Snowflake, ClickHouse or Apache Iceberg.
• Production-scale image, video or audio processing
We offer*:
• Flexible working format - remote, office-based or flexible
• A competitive salary and good compensation package
• Personalized career growth
• Professional development tools (mentorship program, tech talks and trainings, centers of excellence, and more)
• Active tech communities with regular knowledge sharing
• Education reimbursement
• Memorable anniversary presents
• Corporate events and team buildings
• Other location-specific benefits
*not applicable for freelancers
You may also be interested in:
Senior Data Quality Analyst (#5806)
Type:
Office/Remote
Category: Software Development
Project: Global biopharmaceutical company
Ukraine
Senior BI Engineer (#5829)
Type:
Office/Remote
Category: Software Development
Project: American multinational satellite services provider
Ukraine
Senior MLOps Engineer (#5860)
Type:
Office/Remote
Category: Software Development
Azerbaijan, Europe, Georgia, Turkey, Ukraine
×
Easy apply
Easy Apply
or
Refer a friend
Share
Save
×
Subscribe to your search result
We’ll drop you a note when there are new jobs that match your search.
We value your privacy
We use cookies on our website to give you the most relevant experience by remembering your preferences and repeat visits. By clicking “Accept”, you consent to the use of ALL the cookies. However you may visit Cookie Settings to provide a controlled consent.
Please review our Cookie Policy and Privacy Notice
(updated 12.03.2025)
Customize Reject All Accept All
Consent Preferences
Close
Privacy Overview
This website uses cookies to improve your experience while you navigate through the website. Out of these cookies, the cookies that are categorized as necessary are stored on your browser as they are essential for the working of basic functionalities of the website. We also use third-party cookies that help us analyze and understand how you use this website. These cookies will be stored in your browser only with your consent. You also have the option to opt-out of these cookies. But opting out of some of these cookies may have an effect on your browsing experience.
Necessary
Necessary
Always Enabled
Necessary cookies are absolutely essential for the website to function properly. These cookies ensure basic functionalities and security features of the website, anonymously.
Cookie Duration Description
cookielawinfo-checkbox-analytics 11 months This cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Analytics".
cookielawinfo-checkbox-functional 11 months The cookie is set by GDPR cookie consent to record the user consent for the cookies in the category "Functional".
cookielawinfo-checkbox-necessary 11 months This cookie is set by GDPR Cookie Consent plugin. The cookies is used to store the user consent for the cookies in the category "Necessary".
cookielawinfo-checkbox-others 11 months This cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Other.
cookielawinfo-checkbox-performance 11 months This cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Performance".
viewed_cookie_policy 11 months The cookie is set by the GDPR Cookie Consent plugin and is used to store whether or not user has consented to the use of cookies. It does not store any personal data.
Functional
functional
Functional cookies help to perform certain functionalities like sharing the content of the website on social media platforms, collect feedbacks, and other third-party features.
Performance
performance
Performance cookies are used to understand and analyze the key performance indexes of the website which helps in delivering a better user experience for the visitors.
Analytics
analytics
Analytical cookies are used to understand how visitors interact with the website. These cookies help provide information on metrics the number of visitors, bounce rate, traffic source, etc.
Advertisement
advertisement
Advertisement cookies are used to provide visitors with relevant ads and marketing campaigns. These cookies track visitors across websites and collect information to provide customized ads.
Others
others
Other uncategorized cookies are those that are being analyzed and have not been classified into a category as yet.
Reject All Save My Preferences Accept All