AI Systems Performance Engineer

Broadcom

USA-CA San Jose Innovation Drive Full-time yesterday
Workplace
On-site
Location
USA-CA San Jose Innovation Drive
Who can apply
Based in the United States: you usually need the right to work there

Check your CV against this job

Free · No signup · A 0–100 ATS match score and the keywords you're missing.

Check my CV free

$14.99/month, cancel anytime. Already have an account? Log in

About the role

Please Note:

1. If you are a first time user, please create your candidate login account before you apply for a job. (Click Sign In > Create Account)

2. If you already have a Candidate Account, please Sign-In before you apply.

Job Description:

Senior AI Network Performance Engineer (NIC / Host Networking)

We are seeking an experienced Senior AI Network Performance Engineer to join the Performance Lab within our Architecture group. You will benchmark AI inference, training, and storage workloads on GPU clusters, with a focus on NIC and host networking performance. Your reports will guide customers in deployment and help our marketing team position the product. Your primary focus will be the server side of the network: the NIC, its drivers, and the host stack that connects AI workloads to the fabric. You will run rigorous benchmarks, isolate bottlenecks, and tune for maximum throughput and minimum latency. If you have gone deep on NIC performance, built or operated AI clusters, or run inference serving at scale, we want to hear from you.

Key Responsibilities

Benchmarking: Install, configure, and run AI performance benchmarks, including MLPerf (Training and Inference) and NCCL collective communication tests. NIC and host tuning: Optimize NIC, driver, and host network settings (RDMA/RoCEv2, congestion control, queue and interrupt configuration, NUMA placement) for distributed AI workloads. Debugging: Isolate performance bottlenecks across the Linux OS, server hardware, NICs, and the network. Automation: Build tools and frameworks that make benchmarking repeatable. Communication: Document test methodologies and present findings and recommendations to hardware, software, and networking teams.

Required Qualifications

Bachelor’s or Master’s degree in Computer Science, Computer Engineering, Electrical Engineering, or a related field. We typically look for 12+ years of related industry experience, but candidates with fewer years and an exceptional track record are encouraged to apply. Strong hands-on Linux experience, including system-level performance tuning and troubleshooting. Proficiency in Python or a similar scripting language. Deep experience in at least one of the following: NIC / host networking: performance tuning or validation of high-speed NICs, drivers, or RDMA/RoCEv2. AI cluster building: bringing up and tuning multi-node GPU clusters, including collective communication libraries such as NCCL. Proven ability to diagnose root causes of performance problems in distributed systems.

Preferred Qualifications

Experience in more than one of the three areas above. Experience with MLPerf Training or Inference. Familiarity with Ethernet switch and fabric behavior (PFC, ECN, load balancing). Experience with Docker, Kubernetes, or Slurm in AI deployments. Experience building CI/CD pipelines for performance regression testing.

Must have authorization to work in the US.

Compensation and Benefits

The annual base salary range for this position is USD 143,800.00 To USD 230,000.00

As a valued member of our team, you'll be eligible for a discretionary annual bonus and the opportunity to receive not only a competitive new hire equity grant, but also annual equity awards, connecting your success directly to the company's growth. All subject to relevant plan documents and award agreements.

Broadcom offers a competitive and comprehensive benefits package: Medical, dental and vision plans, 401(K) participation including company matching, Employee Stock Purchase Program (ESPP), Employee Assistance Program (EAP), company paid holidays, paid sick leave and vacation time. The company follows all applicable laws for Paid Family Leave and other leaves of absence.

Broadcom is proud to be an equal opportunity employer.  We will consider qualified applicants without regard to race, color, creed, religion, sex, sexual orientation, national origin, citizenship, disability status, medical condition, pregnancy, protected veteran status or any other characteristic protected by federal, state, or local law.  We will also consider qualified applicants with arrest and conviction records consistent with local law.

If you are located outside USA, please be sure to fill out a home address as this will be used for future correspondence.

Get matched & apply with FindAJobAI

Upload your resume once. We score every job against your profile, tailor your resume and cover letter, and autofill the application.