Deep Reinforcement Learning Researcher (Phd.) Ai@Unity

Unity San Francisco , CA 94118

Posted 7 months ago

We are looking for an exceptional researcher to join Unity's ML-Agents team within AI@Unity. The ML-Agents team is an applied research team focused on: 1. Enabling Unity as a premier simulation platform for Artificial Intelligence research ranging from locomotion to language-guided visual navigation, and 2. Enabling Unity developers to train character behaviors using machine learning techniques such as deep reinforcement learning and imitation learning. You will be working with a team of researchers and engineers to develop technologies for creating intelligent agent behaviors within Unity environments. Bringing these technologies to the Unity platform has the potential to both transform how games are created, tested, and evaluated, and push forward RL research by providing novel simulation environments.

You will have access to Unity's vibrant ecosystem of developers and games, providing simulation environments that range from 2D turn-based to 3D real-time strategy, including networked and multi-player games. You will have the opportunity to extend state-of-the-art machine learning within this ecosystem, exploring areas such as generalization and adapting to changing observation and action spaces, efficiently leveraging real player data, hierarchical modeling, multi-agent, active/interactive learning within the Unity Editor and large-scale distributed training.


  • Conducting original machine learning research on training character behaviors. This includes algorithm development, experimentation and writing high-impact research papers.

  • Experimenting with training character behaviors in live and pre-production Unity games

  • Contributing to the development of developer-facing APIs for transforming games into learning environments

  • Contributing to the design and development of our large-scale distributed training system


  • Ph.D. in Computer Science, Math or Statistics, Physics, or a related area

  • Strong foundation in mathematics, statistics, data structures and algorithms

  • Experienced developer with solid skills in Python, C# or C++

  • Experience with Deep Learning Frameworks (e.g. TensorFlow, PyTorch)

  • Published research in Deep Learning or Reinforcement Learning at major conferences or journals

  • Excellent communication skills with the ability to build relationships across the company

Bonus points

  • Contributed to open source projects

  • Experience with large scale data/distributed systems

  • Experience with Unity Engine, 3D simulators, game development, or robotics

Who we are

Unity is the creator of the world's most widely-used real-time 3D (RT3D) development platform, providing content creators around the world with the tools they need to build rich, interactive 2D, 3D, VR and AR experiences. In fact, apps made with Unity reach 2.7 billion devices worldwide, and were installed more than 24 billion times in the last 12 months.

The global engineering team keeps Unity at the forefront of technology and working alongside partners like Magic Leap, Google, Facebook, Oculus and Microsoft ensures optimized support for the latest technology and platforms. Unity is powering the real-time revolution, expanding beyond games and breaking into other industries including automotive, film, architecture, engineering, construction and more.

Unity is an equal opportunity employer committed to fostering an inclusive, innovative environment with the best employees. Therefore, we provide employment opportunities without regard to age, race, color, ancestry, national origin, religion, disability, sex, gender identity or expression, sexual orientation, or any other protected status in accordance with applicable law. If there are preparations we can make to help ensure you have a comfortable and positive interview experience, please let us know.

Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.

Headhunters and recruitment agencies may not submit resumes/CVs through this Web site or directly to managers. Unity does not accept unsolicited headhunter and agency resumes. Unity will not pay fees to any third-party agency or company that does not have a signed agreement with Unity.


icon no score

See how you match
to the job

Find your dream job anywhere
with the LiveCareer app.
Mobile App Icon
Download the
LiveCareer app and find
your dream job anywhere
App Store Icon Google Play Icon

Boost your job search productivity with our
free Chrome Extension!

lc_apply_tool GET EXTENSION

Similar Jobs

Want to see jobs matched to your resume? Upload One Now! Remove
Data Scientist Deep Learning

The Climate Corporation

Posted 2 days ago

VIEW JOBS 2/22/2020 12:00:00 AM 2020-05-22T00:00 Position Overview The Climate Corporation's mission is to help the world's farmers sustainably increase their productivity with digital tools. The Data and Analytics team is focused on creating competitive advantage for The Climate Corporation and our customers through novel data infrastructure, metrics, insights, and data services. We are a small but rapidly growing data science and engineering team that builds and leverages state-of-the-art analytics systems. Our work informs decisions and direction for our business, while also impacting our products. Data Scientists at The Climate Corporation build predictive and prescriptive models to deliver insights to farmers. In order to take advantage of increasing amounts of agricultural and environmental data, we are hiring new data scientists to drive the research and development of scalable machine learning models. In this role, your work will broadly influence the company's data and products. What You Will Do: * Build and implement state-of-the-art machine learning and deep learning systems * Help to define the infrastructure required to train models at scale * Work with data engineers to build real time and offline features and maintain the datasets from which models are created * Partner with scientists and product experts in the R&D organization to build scalable models that support our suite of decision support services * Help to assess new technologies for data scientists at The Climate Corporation Basic Qualifications: * B.Sc. in Statistics, Mathematics, Computer Science or other relevant technical field * Either minimum two years of experience in applying statistical/machine learning solutions on a scalable platform to real-world applications, or M.A. or M.Sc. in machine learning, statistics, applied mathematics, or an equivalent technical field * Fully proficient in Python (including PySpark) * Experience with at least one Deep Learning framework, including Tensorflow and/or Torch/Pytorch * Strong software engineering fundamentals Preferred Qualifications: * Ph.D. in machine learning, statistics, applied mathematics or other relevant technical field * Experience building distributed systems and/or scalable backend systems with the ability to maintain in production * Proficiency in developing performant large-scale queries using SQL, Hive or Pig * Experience with a cloud platform such as AWS * Proficiency with SQL, R, Scala * Experience working with Engineering and Product organizations using an Agile development process What We Offer: Our teams are composed of industry experts, top scientists, and talented engineers. The environment is extremely engaging and fast-paced, with dozens of specialties coming together to provide the best possible products and experiences for our customers. We provide competitive salaries and some of the best perks in the industry, including: * Superb medical, dental, vision, life, disability benefits, and a 401k matching program * A stocked kitchen with a large assortment of snacks & drinks to get you through the day * Encouragement to get out of the office and into the field with agents and farmers to see first-hand how our products are being used * We take part and offer various workshops, conferences, meet-up groups, tech-talks, and hackathons to encourage participation and growth in both community involvement and career development We also hinge our cultural DNA on these five values: * Inspire one another * Innovate in all we do * Leave a mark on the world * Find the possible in the impossible * Be direct and transparent Learn more about our team and our mission: The Climate Corporation - The Technology Behind Making A Difference or visit Climate aims to create a welcoming and collaborative environment for our employees in which a diverse set of perspectives and voices are represented and celebrated. As part of our dedication to the diversity of our workforce, The Climate Corporation is committed to Equal Employment Opportunity and does not discriminate based on race, religion, color, national origin, ethnicity, gender, sex (including pregnancy), protected veteran status, age, disability, sexual orientation, gender identity, gender expression, or any unlawful criterion existing under applicable federal, state, or local laws. If you need assistance or an accommodation due to a disability, you may contact us at The Climate Corporation San Francisco CA

Deep Reinforcement Learning Researcher (Phd.) Ai@Unity