We are looking for an applied scientist with deep skills in ML and generative modeling to architect, train, and deploy multimodal scene understanding technology that can understand scene from visual and audio data. You will quickly build and demonstrate new user experiences using large foundation models, developing innovative capabilities while partnering with cross-functional teams and iterating rapidly in a dynamic environment.
Your work will advance human interaction and scene understanding modeling across the stack, from system-level architecture to core ML algorithms. Among the many challenges you will address are modeling user behaviors and preferences through device and environmental interactions, retrieving nuanced insights from historical context, handling deeply interleaved streaming data, reasoning across diverse temporal horizons, designing memory systems for long-term adaptation, and learning semantically rich representations for open-ended downstream applications.
You will also be responsible for delivering ML models and solutions that can be readily integrated into production pipelines, such as APIs for production-ready models and algorithms built directly into our training infrastructure.
PhD or MS Computer Science, Engineering, or a related field with a focus on machine learning
Strong research skills with first author publications in top tier ML conferences
Expert-level knowledge of SOTA in large auto-regressive transformer models, multi-modal encoders, and representation learning.
Experience with multimodal large language models (LLMs)
Strong programming skills in Python, maintaining ML code bases grounded in software engineering principles.
PhD in Machine Learning
Proven track record of deploying innovative ML technologies in production.
Familiarity with developing ML for resource-constrained devices.
Experience working with large cross-functional and diverse teams.