Job description

Employment Type: Full-Time Work Setting: In-office/Remote Work Location: United States, New York, Mexico, San Francisco, Canada Work Hours: Office hours Find out more here: semianalysis.com About SemiAnalysis SemiAnalysis is an independent research and analysis firm specializing in the Semiconductor and AI industries. Our in-depth coverage spans the entire supply chain, from semiconductor fabrication processes to state-of-the-art AI Models, CUDA kernels, and GPU cloud infrastructure. We are recognized as the leading authority on AI infrastructure, with the highest concentration of industry experts within one team, and a deep-rooted passion for delving into the intricacies. We’re a global team of over 20 analysts & engineers, each with extensive networks across the semiconductor supply chain and AI ecosystem, publishing industry‑shaping articles while participating in 40+ conferences annually. Our newsletter reaches more than 200 000 subscribers worldwide, including senior management and C‑suite leaders at the leading semiconductor and AI companies. Some of industry-shaping articles are: • InferenceMAX: The world first open inference benchmark that continuous benchmarks performance of popular frontier models • MI300X vs H100 vs H200 Training : Extensive Benchmarking & Deep Dive into CUDA & ROCm training developer experience & performance • Trainium2 Architecture & Networking : Deep Dive into Amazon’s new Trainium2 rack scale system & 3D torus scale up topology Find out more here: semianalysis.com Position Overview • We are seeking a highly motivated & skilled Member of Technical Staff to join our growing engineering team. • Member of Technical Staff will play a crucial role in developing inference benchmarks & system modelling • You will also play a role in writing and preparing our newsletter articles for publishing, with the opportunity for direct authorship recognition. • We are hiring individual contributors at all experience levels. Compensation will be competitive • As part of the interview process, you'll complete a paid coding challenge designed to reflect typical daily tasks at SemiAnalysis • Competitive Compensation depending on experience, skillset, location & business needs Key Responsibilities • Conduct training & inference performance benchmarks across various AI hardware (e.g. NVIDIA H100, AMD Mi300X, Google TPUs, AWS Trainium2) using frameworks such as PyTorch, JAX, vLLM, SGLang, etc. • Author detailed technical research reports analyzing benchmark results, hardware performance, scalability, & efficiency. • Develop comprehensive system modelling using Python & NCCL for existing & future AI compute clusters, scaling from single-GPU setups to O(100k) GPU clusters. • Establish and maintain strategic partnerships & collaborations with over 50 leading neocloud providers & AI chip manufacturers, including AMD, NVIDIA, and other industry stakeholders. • Stay current on emerging trends & technologies by attending major industry & academic conferences such as NeurIPS, MLSys, NVIDIA GTC, AMD’s Advancing AI, etc. Qualifications • Proactive, self-motivated, and capable of working independently in a global team. • Demonstrated experience in ML frameworks such as PyTorch or JAX through professional experience, personal projects, or personal Substack blogs • Solid understanding of at least 1 of the following: transformer architecture, LLM parallelism strategies, and/or CUDA parallel programming • Strong research skills and the ability to synthesize information from various sources to draw insights. • English language proficiency required, Chinese language proficiency preferred Why SemiAnalysis? At SemiAnalysis, you’re placed directly inside the most important conversations shaping the future of AI and semiconductors. You’ll develop a first-principles understanding of the technical and economic dynamics behind the world’s most consequential technology, with rare end-to-end visibility across the entire stack—from silicon and systems to models, software, and real-world deployment. Our work is read and relied upon by the people allocating capital, building infrastructure, and setting strategy across the industry, giving your research and analysis real, measurable impact. The environment is built for learning and autonomy. You’ll have the freedom to chase interesting ideas, dig into emerging trends early, and continuously expand your technical and economic toolkit, supported by generous PTO, office stipends, competitive healthcare (medical, dental, vision), and support for conferences and ongoing learning. SemiAnalysis LLC participates in the E-Verify program to confirm the employment eligibility of all newly hired employees. For more information, visit e-verify.gov . • E-Verify Poster: everify.gov • Right to Work Poster: justice.gov

Requirements

Must-haves

Employment Type: Full-Time
Work Setting: In-office/Remote
Work Location: United States, New York, Mexico, San Francisco, Canada
Work Hours: Office hours
InferenceMAX: The world first open inference benchmark that continuous benchmarks performance of popular frontier models
MI300X vs H100 vs H200 Training : Extensive Benchmarking & Deep Dive into CUDA & ROCm training developer experience & performance
Trainium2 Architecture & Networking : Deep Dive into Amazon’s new Trainium2 rack scale system & 3D torus scale up topology
Position Overview
We are seeking a highly motivated & skilled Member of Technical Staff to join our growing engineering team.
Member of Technical Staff will play a crucial role in developing inference benchmarks & system modelling
You will also play a role in writing and preparing our newsletter articles for publishing, with the opportunity for direct authorship recognition.
We are hiring individual contributors at all experience levels. Compensation will be competitive
As part of the interview process, you'll complete a paid coding challenge designed to reflect typical daily tasks at SemiAnalysis
Competitive Compensation depending on experience, skillset, location & business needs
Conduct training & inference performance benchmarks across various AI hardware (e.g. NVIDIA H100, AMD Mi300X, Google TPUs, AWS Trainium2) using frameworks such as PyTorch, JAX, vLLM, SGLang, etc.
Author detailed technical research reports analyzing benchmark results, hardware performance, scalability, & efficiency.
Develop comprehensive system modelling using Python & NCCL for existing & future AI compute clusters, scaling from single-GPU setups to O(100k) GPU clusters.
Establish and maintain strategic partnerships & collaborations with over 50 leading neocloud providers & AI chip manufacturers, including AMD, NVIDIA, and other industry stakeholders.
Stay current on emerging trends & technologies by attending major industry & academic conferences such as NeurIPS, MLSys, NVIDIA GTC, AMD’s Advancing AI, etc.
Proactive, self-motivated, and capable of working independently in a global team.
Demonstrated experience in ML frameworks such as PyTorch or JAX through professional experience, personal projects, or personal Substack blogs
Solid understanding of at least 1 of the following: transformer architecture, LLM parallelism strategies, and/or CUDA parallel programming
Strong research skills and the ability to synthesize information from various sources to draw insights.

Nice-to-haves

English language proficiency required, Chinese language proficiency preferred

Application prep

Use the role’s language and application details while tailoring your materials.

Keywords to mirror

aiawspythonmlllm

Platform: careers-page
Effort: medium

Benefits

Benefits detected in the listing.

Dental

Vision

Pto