About Microsoft
Microsoft is a global technology leader committed to empowering individuals and organizations worldwide. They foster a culture of innovation and collaboration, striving to create a diverse and inclusive environment where everyone can thrive.
Job Description
Microsoft is seeking a Research Intern to work on distillation of large language models (LLMs) within the Special Projects team in Microsoft Research (MSR). The intern will focus on training smaller and more efficient LLMs from larger models without compromising performance. This internship offers an opportunity to apply cutting-edge distillation methods and integrate structured domain knowledge into the distillation process.
Responsibilities
- Implement and refine distillation techniques for LLMs.
- Explore and integrate structured representations of domain knowledge into the distillation process.
- Collaborate with a multidisciplinary team to apply distilled models to practical applications.
- Analyze performance metrics to ensure minimal loss of effectiveness compared to larger models.
- Document and present research findings.
Skills and Qualifications
- Currently enrolled in a PhD program or a research master’s degree program in Computer Science, Artificial Intelligence, or a related field.
- At least 1 year of experience in programming languages used in AI research, such as Python, and familiarity with ML frameworks (e.g., TensorFlow, PyTorch).
- Background in machine learning, particularly in natural language processing and model distillation.
- Proficient analytical, problem-solving, and research skills.
- Ability to work collaboratively in a fast-paced research environment.
Duration and Location
- Duration: Spring, Summer, or Fall 2024
- Location: Redmond, Washington, United States (Up to 50% work from home)
Compensation
- Base pay range varies based on location and level: USD $5,090 – $13,240 per month.
Application Process
Interested candidates can visit the Microsoft Careers website.
Equal Opportunity Statement
Microsoft is an equal opportunity employer committed to diversity and inclusion. They do not discriminate based on age, ancestry, gender identity, disability, race, religion, sexual orientation, or any other characteristic protected by applicable laws and regulations. Accommodations for applicants with disabilities are available upon request.
