Lead Data Engineer
Ex Parte· Computer Software· May 11, 2022 · 54mo agoPosted 1,630 days ago
Bethesda, MD, United States
Remote
Full-time
Lead/Staff
$180K–$225K est.
3+ years exp
Before you apply
Ghost Signal:
Open since May 11, 2022 — 1,630 days, and still accepting applications.
Job description
You’ll lead a team that owns the AI self-service portal and the related set of microservices. You’ll work with a cross-functional team of engineers to contribute to our data platform. The role also offers the opportunity to grow into either more back-end or ML/AI work depending on your interests and experience.
In this role, you can expect to:
· Work directly with product owners and data experts to build products that solve to solve complex client problems
· Build and support a distributed platform supporting all ExParte data
· Work across our product, primarily on the data pipelines
· Interface directly with internal teams
· Evaluate software and implementation options and document them for technical teams
· Work with data analysts to collect insight on possible data collection efficiencies and identify automation potential for manual workflows
· Integrate best qualitative practices in program design and development.
· Be a part of a distributed team (we’re in North America and Europe)
· Work with Azure cloud and Databricks
· Develop technical architectures and specific implementations to meet business needs.
· Guide the team’s software engineering best practices by documenting standards and completing code reviews.
· Troubleshoot new and existing code and provide feedback and solutions to structural issues in the codebase as they arise.
· Advise on the feasibility of nonfunctional requirements and ensure the successful implementation of features while meeting those requirements.
Requirements :
· 3+ years experience with RDBMS and T-SQL.
· 3+ years experience with NoSQL and DataLakes.
· 3+ Knowledge of Spark, Python, or Scala
· Strong familiarity with map/reduce programming models
· Proficiency in writing production-quality code
· Deep expertise in database schema design, optimization, and scalability
· Experience with Azure or AWS cloud-based service-oriented architecture
· Solid understanding of testing pyramid (unit, integration, black box, service)
· Experience working in an Agile/Scrum environment
· Strong analytical and problem-solving skills
· Good time management and organizational skills
· Ability to work on challenging issues independently or in a team environment
· Ability to learn and adapt quickly to new technologies and environments
· Strong communication skills
Nice-to-have's:
· Experience with Databricks or Azure ML
· Experience applying machine learning algorithms to solve complex data mining problems
· Experience with BI tools
· Understanding of cloud platforms and providers and DevOps
· Bachelor's Degree in Computer Science, Engineering, Mathematics or related field
All your information will be kept confidential according to EEO guidelines.
Application prep
Use the role’s language and application details while tailoring your materials.
Keywords to mirror
aimlazuresqlpythonawsagilescrummachine learning
- Platform
- smartrecruiters
- Effort
- medium