Research Intern, Photorealistic Telepresence (Phd University Student)

Facebook Pittsburgh , PA 15201

Posted 4 days ago

Facebook Reality Labs in Pittsburgh is looking for exceptional interns to help us create a revolution in virtual reality: achieving true photorealistic telepresence, where you can with anyone, anywhere, at anytime. We have made some important advances, but it will take a diverse team with a wide spectrum of skills to accomplish this future. If you have expertise in computer vision, machine learning, and computer graphics, we expect you will find the work here highly intriguing. We are looking for motivated software, electrical, and mechanical engineers; and strong math skills are always a huge plus. We publish our work at leading conferences and journals. Come join us as we make photorealistic telepresence in VR happen!

Available projects may include, but are not limited to:

  • Multiview Data Compression for Machine Perception

  • Multi-modal Face Tracking

  • CNN Acceleration for realtime tracking

  • Full Body Tracking from the Headset

  • Speech Aware Gesturing for Dialogue Avatars in VR

  • Realtime Markerless Motion Capture for Faces and Bodies

  • High Fidelity Face Model Fitting to Photo Collections

  • Building a Multi-scale Body Rig

  • Building a Multicamera Head Mounted System

  • Realtime Gaze Tracking using EOG

  • High-Fidelity Tongue Rigging

  • High-Precision 3D Hair Reconstruction

  • 3D Audio Reconstruction from Multiple Microphones

  • Geometric Camera Calibration

  • Photometric Camera Calibration

  • High Fidelity Hand Model Reconstruction and Tracking

  • Speech Synthesis

  • High Fidelity Geometrical and Photometric 3D Reconstruction of Eyes

  • 3D Eyelash Reconstruction

  • High-Frequency Reflectance Capture of Faces and Bodies

RESPONSIBILITIES

  • Solve real problems in enabling Photorealistic Telepresence

Collaboration with and support of other researchers across various disciplines

Communication of research agenda, progress, and results

MINIMUM QUALIFICATIONS

  • In the process of obtaining a Masters or PhD degree in the field of Audio Processing, Computer Vision, Computer Graphics, Robotics, Machine Learning, or similar

Must be currently enrolled in a full-time degree program and returning to the program after the completion of the internship/co-op
1+ years experience with solving inverse problems in imaging emphasizing modeling, algorithm development, and hardware prototyping
2+ years experience with scientific programming languages such as Matlab, Python, or similar

Must be available for a 3, 4, or 6-month internship between January 1, 2019 and December 31, 2019

Interpersonal experience: cross-group and cross-culture collaboration

Must obtain work authorization in country of employment at the time of hire, and maintain ongoing work authorization during employment

PREFERRED QUALIFICATIONS

  • In the process of obtaining a PhD degree in the field of Audio Processing, Computer Vision, Computer Graphics, Robotics, Machine Learning, or similar

Experience with systems building in C++

Experience with OpenCV, TensorFlow, Ceres, or Caffe2

Experience with Machine Learning for Sequence Prediction, NLP, or Speech Synthesis

Experience with Machine Learning for 3D Data (such as meshes, point clouds, and voxels)

Experience with Machine Learning for Visual Synthesis

Proven track record of achieving significant results as demonstrated by patents and first-authored publications at leading workshops or conferences such as ICCV, CVPR, NIPS, SIGGRAPH, ICASSP, or similar

Demonstrated engineering experience via an internship, work experience, coding competitions, or widely used contributions in open source repositories (e.g., GitHub)


See if you are a match!

See how well your resume matches up to this job - upload your resume now.

Find your dream job anywhere
with the LiveCareer app.
Download the
LiveCareer app and find
your dream job anywhere
lc_ad

Boost your job search productivity with our
free Chrome Extension!

lc_apply_tool GET EXTENSION

Similar Jobs

Want to see jobs matched to your resume? Upload One Now! Remove
Postdoctoral Research Scientist Computer Vision (Phd University Grad)

Facebook

Posted 4 days ago

VIEW JOBS 11/12/2018 12:00:00 AM 2019-02-10T00:00 Facebook Reality Labs is dedicated to the research and development required to bring virtual and augmented reality to billions of people around the world. At the Pittsburgh lab, we aspire to a vision of social VR and AR, where people are able to interact with each other across distances in a way that is indistinguishable from in-person interactions. We are looking for an exceptional researcher with a proven track record in high performance computer vision (e.g., multi-view camera calibration, multi-view stereo, 3D reconstruction) as well as an outstanding software engineer who can prototype invented algorithms. As a Postdoctoral Research Scientist at FRL, you will pursue research, and work with other Computer Vision Engineers to solve challenges at the forefront of computer vision that transform virtual reality from dream to reality. We're looking for a creative researcher to usher in the next era of human-computer interaction by solving open and exciting computer vision problems. The position is a fixed-term (postdoctoral) contract for 24 months. RESPONSIBILITIES * Participating in cutting edge research in computer vision Developing creative computer vision and tracking software for a variety of Oculus products Formulating and solving numerical optimization problems in computer vision Prototyping hardware and software solutions for characterizing, modeling and calibration of camera lenses and image sensors Developing cutting edge 3D reconstruction system Developing robust software for integrating multiple image sensors and embedded systems Contributing research that can be applied to Oculus product development Publish research results in top-tier journals and at leading international conferences MINIMUM QUALIFICATIONS * Currently has or is in the process of obtaining a PhD degree or completing a postdoctoral assignment in the field of Computer Vision, Machine Learning or similar Must be available to start employment on or after July 1, 2018 3+ years experience designing and developing computer vision algorithms in C++ 3+ years of experience with prototyping algorithms in MATLAB or Python Experience in linear algebra, multi-view camera geometry and numerical optimization Interpersonal experience: cross-group and cross-culture collaboration Able to obtain work authorization in the U.S. beginning in 2018 PREFERRED QUALIFICATIONS * Proven track record of achieving significant results as demonstrated by grants, fellowships, patents, as well as first-authored publications at leading workshops or conferences such as CVPR, ECCV, ICCV, 3DV, or similar 3+ years experience with multi-view camera geometry, geometric and photo-metric camera calibration, 3D reconstruction or photogrammetry Experience with wide field of view, fisheye and omnidirectional camera geometry and calibration Experience with formulating and solving computer vision optimization problems Demonstrated software engineer experience via an internship, work experience, coding competitions, or widely used contributions in open source repositories (e.g. GitHub) Facebook Pittsburgh PA

Research Intern, Photorealistic Telepresence (Phd University Student)

Facebook