Job Description

Our vision is to transform how the world uses information to enrich life for all.
Micron Technology is a world leader in innovating memory and storage solutions that accelerate the transformation of information into intelligence, inspiring the world to learn, communicate and advance faster than ever.
Principal / Senior Systems Performance Engineer
Micron Data Center and Client Workload Engineering in Hyderabad, India, is seeking a senior/principal engineer to join our dynamic team.
The successful candidate will primarily contribute to the ML development, ML DevOps, HBM program in the data center by analyzing how AI/ML workloads perform on the latest MU-HBM, Micron main memory, expansion memory and near memory (HBM/LP) solutions, conduct competitive analysis, showcase the benefits that workloads see with MU-HBM's capacity / bandwidth / thermals, contribute to marketing collateral, and extract AI/ML workload traces to help optimize future HBM designs.
Job Responsibilities:
The Job Responsibilities include but are not limited to the following:

• Design, implement, and maintain scalable & reliable ML infrastructure and pipelines.
• Collaborate with data scientists and ML engineers to deploy machine learning models into production environments.
• Automate and optimize ML workflows, including data preprocessing, model training, evaluation, and deployment.
• Monitor and manage the performance, reliability, and scalability of ML systems.
• Troubleshoot and resolve issues related to ML infrastructure and deployments.
• Implement and manage distributed training and inference solutions to enhance model performance and scalability.
• Utilize DeepSpeed, TensorRT, vLLM for optimizing and accelerating AI inference and training processes.
• Understand key care abouts when it comes to ML models such as: transformer architectures, precision, quantization, distillation, attention span & KV cache, MoE, etc.
• Build workload memory access traces from AI models.
• Study system balance ratios for DRAM to HBM in terms of capacity and bandwidth to understand and model TCO.
• Study data movement between CPU, GPU and the associated memory subsystems (DDR, HBM) in heterogeneous system architectures via connectivity such as PCIe/NVLINK/Infinity Fabric to understand the bottlenecks in data movement for different workloads.
• Develop an automated testing framework through scripting.
• Customer engagements and conference presentations to showcase findings and develop whitepapers.

Requirements:

• Strong programming skills in Python and familiarity with ML frameworks such as TensorFlow, PyTorch, or scikit-learn.
• Experience in data preparation: cleaning, splitting, and transforming data for training, validation, and testing.
• Proficiency in model training and development: creating and training machine learning models.
• Expertise in model evaluation: testing models to assess their performance.
• Skills in model deployment: launching server, live inference, batched inference
• Experience with AI inference and distributed training techniques.
• Strong foundation in GPU and CPU processor architecture
• Familiarity with and knowledge of server system memory (DRAM)
• Strong experience with benchmarking and performance analysis
• Strong software development skills using leading scripting, programming languages and technologies (Python, CUDA, C, C++)
• Familiarity with PCIe and NVLINK connectivity

Preferred Qualifications:

• Experience in quickly building AI workflows: building pipelines and model workflows to design, deploy, and manage consistent model delivery.
• Ability to easily deploy models anywhere: using managed endpoints to deploy models and workflows across accessible CPU and GPU machines.
• Understanding of MLOps: the overarching concept covering the core tools, processes, and best practices for end-to-end machine learning system development and operations in production.
• Knowledge of GenAIOps: extending MLOps to develop and operationalize generative AI solutions, including the management of and interaction with a foundation model.
• Familiarity with LLMOps: focused specifically on developing and productionizing LLM-based solutions.
• Experience with RAGOps: focusing on the delivery and operation of RAGs, considered the ultimate reference architecture for generative AI and LLMs.

• Data management: collect, ingest, store, process, and label data for training and evaluation. Configure role-based access control; dataset search, browsing, and exploration; data provenance tracking, data logging, dataset versioning, metadata indexing, data quality validation, dataset cards, and dashboards for data visualization.
• Workflow and pipeline management: work with cloud resources or a local workstation; connect data preparation, model training, model evaluation, model optimization, and model deployment steps into an end-to-end automated and scalable workflow combining data and compute.
• Model management: train, evaluate, and optimize models for production; store and version models along with their model cards in a centralized model registry; assess model risks, and ensure compliance with standards.
• Experiment management and observability: track and compare different machine learning model experiments, including changes in training data, models, and hyperparameters. Automatically search the space of possible model architectures and hyperparameters for a given model architecture; analyze model performance during inference, monitor model inputs and outputs for concept drift.
• Synthetic data management: extend data management with a new native generative AI capability. Generate synthetic training data through domain randomization to increase transfer learning capabilities. Declaratively define and generate edge cases to evaluate, validate, and certify model accuracy and robustness.
• Embedding management: represent data samples of any modality as dense multi-dimensional embedding vectors; generate, store, and version embeddings in a vector database. Visualize embeddings for improvised exploration. Find relevant contextual information through vector similarity search for RAGs.

Education:

• Bachelor's or higher (with 12+ years of experience) in Computer Science or related field.

About Micron Technology, Inc.
We are an industry leader in innovative memory and storage solutions transforming how the world uses information to enrich life for all. With a relentless focus on our customers, technology leadership, and manufacturing and operational excellence, Micron delivers a rich portfolio of high-performance DRAM, NAND, and NOR memory and storage products through our Micron and Crucial brands. Every day, the innovations that our people create fuel the data economy, enabling advances in artificial intelligence and 5G applications that unleash opportunities - from the data center to the intelligent edge and across the client and mobile user experience.
To learn more, please visit micron.com/careers
All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran or disability status.
To request assistance with the application process and/or for reasonable accommodations, please contact
Micron Prohibits the use of child labor and complies with all applicable laws, rules, regulations, and other international and industry labor standards.
Micron does not charge candidates any recruitment fees or unlawfully collect any other payment from candidates as consideration for their employment with Micron.
AI alert: Candidates are encouraged to use AI tools to enhance their resume and/or application materials. However, all information provided must be accurate and reflect the candidate's true skills and experiences. Misuse of AI to fabricate or misrepresent qualifications will result in immediate disqualification.
Fraud alert: Micron advises job seekers to be cautious of unsolicited job offers and to verify the authenticity of any communication claiming to be from Micron by checking the official Micron careers website in the About Micron Technology, Inc.