Research Intern - Speaking the World into Existence
Redmond, WA 
Share
Posted 2 days ago
Job/Internship Description
OverviewResearch Internships at Microsoft provide a dynamic environment for research careers with a network of world-class research labs led by globally-recognized scientists and engineers, who pursue innovation in a range of scientific and technical disciplines to help solve complex challenges in diverse fields, including computing, healthcare, economics, and the environment. The Speaking the world into existence research effort aims to apply the recent progress in large language models (LLMs) to prompt-based creation of interactive three-dimensional (3D) scenes. Integrating LLMs with a game engine should enable not only faster development of 3D content in various domains, such as gaming, mixed reality applications or animated films, but also allow for spontaneous user-generated content in the course of an interactive experience. Our previous work has also demonstrated that giving a large Artificial Intelligence (AI) model the ability to act in a simulated environment with feedback has the potential to improve the outputs of generative models by grounding them in the real world. One of the fundamental research directions of this project is to make large multimodal models more reliable in the domain of human-scale activity, by not only incorporating what has been said about the world, but also testing results in a simulation of the world. Beyond application in gaming and building compelling virtual worlds, easier creation of interactive 3D content and simulations by non-coding users also opens applications to education (e.g. allowing teachers to create immersive virtual reality (VR) lessons in a short time), rapid creation of interactive training scenarios (imagine a group of first responders spinning up a simulation in the 30 minutes it takes them to arrive at the location of a disaster so that they can be prepared for the potential difficulties at the location) and many other applications in various domains such as real-time generation of virtual environments for therapy or creative applications. Microsoft's mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.
ResponsibilitiesResearch Interns put inquiry and theory into practice. Alongside fellow doctoral candidates and some of the world's best researchers, Research Interns learn, collaborate, and network for life. Research Interns not only advance their own careers, but they also contribute to exciting research and development strides. During the 12-week internship, Research Interns are paired with mentors and expected to collaborate with other Research Interns and researchers, present findings, and contribute to the vibrant life of the community. Research internships are available in all areas of research, and are offered year-round, though they typically begin in the summer. For this Research Internship (Summer 2024), our group is seeking PhD Research Interns with a similar passion for research on applications of the newest generative AI models to creative domains, with particular interest in mixed reality and gaming, as well as improving large multimodal generations by grounding them in the real world. Intern responsibilities will include (1) helping to develop a research platform integrating large multimodal models within a rendering engine, (2) building compelling scenarios exploring the various potential uses of this new technology.

 

Position Summary
Company
Start Date
As soon as possible
Employment Type
Full Time
Period of Employment
Open
Type of Compensation
Paid
College Credits Earned
No
Tuition Assistance
No
Required Student Status
Open
Preferred Majors
Other
Email this Job to Yourself or a Friend
Indicates required fields