Job description

Build the most powerful content understanding engine on the world's leading short-video platform! Retrieve and rerank billions of videos, redefine the intelligent connection between advertising and content with multimodal large language model. TikTok Brand Ads team is hiring multiple MLE/SWE roles, focusing on the in-depth application of multimodal large language models in brand advertising. Join us to build the most powerful content understanding engine on the world's leading short-video platform, retrieve and rerank billions of videos and redefine the intelligent connection between advertising and content with multimodal large language model! The team is responsible for the complete technical chain from data construction, model training, offline evaluation, online deployment, inference optimization to new model exploration, covering key tasks such as multimodal semantic understanding, content matching and ranking, and cross-modal alignment. Key technical directions: - Multimodal-LLM model development - Generative retrieval & ranking technology - Ads ranking - LLM inference optimization We are looking for passionate engineers that have strong problem solving skills and algorithm understanding to build and manage systems with high performance, scalability, and availability. You will have the opportunity to partner closely with a globalized engineering and product teams in a high-impact and fast-paced environment. What you'll do: - Use large video models to model the semantic meaning of video content and construct structured vector representations. - Build multimodal representations of brand ads (video/picture + title/script + brand semantics, etc.) to achieve cross-modal alignment. - Implement an efficient large-scale video content indexing and retrieval system to support vector-level matching and filtering between ad semantics and millions of native videos. - Set up content understanding pipelines for various business scenarios, processing tens of millions of videos daily. - Apply technologies such as Embedding Distillation and Hard Negative Mining to optimize the training process. Minimum Qualifications: - BS degree in Computer Science, Computer Engineering or other relevant majors, with related work experience - Excellent programming, debugging, and optimization skills in one or more general purpose programming languages including but not limited to: Go, C/C++, Python. - Ability to think critically and to formulate solutions to problems in a clear and concise way. - Relevant professional experience with machine learning, data mining, data analysis, distribution system. - Experience with one or more of the following: Machine Learning, Deep Learning, NLP, ranking systems, recommendation systems, backend, large-scale systems, data science, full-stack. - Good product sense and experience designing and implementing product features. Preferred Qualifications: - Possess strong technical background/experience in NLP, LLM, search/advertising/recommendation systems, etc. - Good understanding in one of the following domains: brand ads, content ads, auction, bidding, ranking, and ads forecasting. - Have a strong passion for large language models. - Publications in top-tier conferences and experience in video understanding-related projects.

Requirements

Must-haves

Multimodal-LLM model development
Generative retrieval & ranking technology
LLM inference optimization
Use large video models to model the semantic meaning of video content and construct structured vector representations.
Build multimodal representations of brand ads (video/picture + title/script + brand semantics, etc.) to achieve cross-modal alignment.
Implement an efficient large-scale video content indexing and retrieval system to support vector-level matching and filtering between ad semantics and millions of native videos.
Set up content understanding pipelines for various business scenarios, processing tens of millions of videos daily.
Apply technologies such as Embedding Distillation and Hard Negative Mining to optimize the training process.
BS degree in Computer Science, Computer Engineering or other relevant majors, with related work experience
Excellent programming, debugging, and optimization skills in one or more general purpose programming languages including but not limited to: Go, C/C++, Python.
Ability to think critically and to formulate solutions to problems in a clear and concise way.
Relevant professional experience with machine learning, data mining, data analysis, distribution system.
Experience with one or more of the following: Machine Learning, Deep Learning, NLP, ranking systems, recommendation systems, backend, large-scale systems, data science, full-stack.
Good product sense and experience designing and implementing product features.

Nice-to-haves

Possess strong technical background/experience in NLP, LLM, search/advertising/recommendation systems, etc.
Good understanding in one of the following domains: brand ads, content ads, auction, bidding, ranking, and ads forecasting.
Have a strong passion for large language models.
Publications in top-tier conferences and experience in video understanding-related projects.

Application prep

Use the role’s language and application details while tailoring your materials.

Keywords to mirror

llmgopythonmachine learning

Platform: tiktok
Effort: medium