Computer Vision Engineer

The Reality Labs (RL) organization at Meta is helping more people around the world come together and connect through industry-leading Augmented and Virtual reality (AR/VR) products. RL has global departments dedicated to research and development in computer vision, machine learning, haptics, social interaction, and more. RL is committed to driving the state of the art forward through relentless innovation. Our XR Tech organization is focused on advanced research and development of machine perception technologies from early concepts to production level across all of Meta's AR/VR products and surfaces. These include Quest products, Meta Glasses and Family of Apps (Facebook, Instagram, Messenger, WhatsApp). We develop core capabilities across a range of product domains including Avatars, AR/VR remote presence/calling, AR Commerce, AR Sharing, Spatial, Calibration and more. In this role, you will be researching and applying a range of software, computer vision, and machine learning techniques for solving challenges that bridge the virtual and real worlds and will impact billions of people. We're addressing a variety of technical challenges in the areas of real-time image processing, hand tracking, micro-gestures, eye tracking, 3D reconstruction, visualization, and tooling. In addition, there are opportunities to collaborate with researchers in Reality Labs Research (RLR).

Responsibilities

• Lead the productization of CVML models for Surface inputs, including Surface keyboard and Surface trackpad, from development through deployment
• Partner with cross-functional teams to ship ML models end-to-end, leveraging broad ML expertise to drive solutions from prototype to production
• Develop prototypes for future VR/AR/MR experiences, drive continued development, and integrate robust solutions into the product
• Collaborate with cross-functional engineering and research teams from Reality Labs (RL) in computer vision, machine learning, and graphics
• Participate in cutting-edge research in computer vision that can be applied to AR/VR product development
• Define and scope projects for other engineers, providing technical direction and success criteria

Minimum Qualifications

• Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience
• Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience
• 7+ years of industry experience in machine learning, computer vision, or related fields
• Experience shipping ML models to production, including the full ML production cycle from development to deployment
• Prototyping and engineering experience in at least ONE relevant specialization area in either Computer Vision or Machine Learning: SLAM State Estimation, Online Calibration, Sensor Fusion, 3D reconstruction, object detection, segmentation and tracking, scene understanding, or semantic segmentation Industry experience working on projects such as: real-time Simultaneous Localization and Mapping (SLAM) and 3D reconstruction, sensor fusion and active depth sensing, object and body tracking and pose estimation, and/or image processing. Image and/or semantic segmentation, 2D and 3D key point estimation and surface reconstruction, depth estimation
• Experience developing and designing Computer Vision and/or Machine Learning technologies and systems for running on edge devices (mobile phones, and/or custom hardware)
• Publication track record at conferences such as SIGGRAPH, CVPR, NIPS, ECCV, ICCV, ISMAR, ICML, etc
• PhD degree in Computer Science, Computer Vision, Machine Learning, Robotics or related technical field
• Experience productizing and deploying ML models on edge devices (mobile phones, AR/VR headsets, and/or custom hardware)