$ads={1}
Microsoft DeepSpeed is an easy-to-use deep learning optimization software suite that enables unprecedented scale and speed for DL Training and Inference1. DeepSpeed powers some of the world’s most powerful language models like MT-530B and BLOOM2. It offers a confluence of system innovations, such as ZeRO, 3D-Parallelism, DeepSpeed-MoE, ZeRO-Infinity, etc., that make large-scale DL training effective, efficient, and easy to use1. It also optimizes large model inference with parallelism technology, high performance custom kernels, communication optimizations and heterogeneous memory technologies1. Moreover, it provides compression techniques to further increase the inference efficiency and reduce the model size1.
Responsibilities
As a software developer in the DeepSpeed team, you will be responsible for:
- Designing, developing, testing, and maintaining high-quality code for DeepSpeed features and components
- Collaborating with researchers, engineers, and customers to understand their needs and requirements
- Contributing to the open-source DeepSpeed GitHub repository and community
- Staying up-to-date with the latest research and trends in deep learning optimization and scaling
Qualifications
To be successful in this role, you should have:
- A bachelor’s degree or higher in computer science, engineering, or a related field, PHD is prefered.
- Strong programming skills in Python and C/C++
- Experience with deep learning frameworks such as PyTorch or TensorFlow
- Experience with distributed systems, parallel computing, and performance optimization
- Knowledge of deep learning concepts and algorithms
- Excellent communication and collaboration skills
- A growth mindset and a passion for learning new things
Microsoft is an equal opportunity employer. Consistent with applicable law, all qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.
$ads={2}
