Machine Learning Engineer, Twelve Labs

Video Streaming

Salary not provided
Docker
Kubernetes
Python
Airflow
Terraform
C++
Kubeflow
CUDA
PyTorch
Golang
Expert level
San Francisco Bay Area

More information about location

Twelve Labs

AI-enabled video understanding technology

Job no longer available

Twelve Labs

AI-enabled video understanding technology

21-100 employees

B2BArtificial IntelligenceContentMachine LearningSaaSVideo

Job no longer available

Salary not provided
Docker
Kubernetes
Python
Airflow
Terraform
C++
Kubeflow
CUDA
PyTorch
Golang
Expert level
San Francisco Bay Area

More information about location

21-100 employees

B2BArtificial IntelligenceContentMachine LearningSaaSVideo

Company mission

To build the best video understanding platform driven by leading perceptual-reasoning research

Role

Who you are

  • 10+ years of software development experience, including experience in machine learning engineering
  • 5+ years of experience in building end-to-end machine learning systems encompassing infrastructure, MLOps, and data management
  • You have experience working with engineers at different levels and have coached them in their career development
  • 2+ years of experience managing high output engineering teams
  • Proficiency in working with video processing and data pipelining
  • Experience in establishing and maintaining secure software and system development environments

Desirable

  • MS or PhD in Computer Science, Math, or equivalent real-world experience
  • Fast-paced startup engineering experience
  • Experience working with large scale models
  • Experience working with both cloud and on-premise environment
  • ML research experience would be helpful, as this role requires interchangeable effort on both research side and software side
  • Experience in handling large-scale computing system and firm understanding on scale-up and scale-out approach in cloud environment

What the job involves

  • As the Lead ML Systems Engineer at Twelve Labs, you will lead the ML Engineering team, driving the development of optimal machine learning systems for video foundation (VFM) and language model (VLM) in production
  • Your role encompasses the entire spectrum of machine learning engineering, from optimizing and scaling the inference infrastructure, which involves extensive video processing both in the cloud and on-premise, to model deployment and operations, and data infrastructure
  • For the first 3 to 6 months, you will be hands on and actively contribute as an individual contributor in our development process
  • As the lead, you will set the technical strategies and goals, recruit top talent, and be responsible for your team’s success, ensuring our machine learning systems exceed user expectations in terms of speed, efficiency, and reliability
  • Your expertise will be key in overcoming challenges related to processing vast amounts of video data and deploying sophisticated models in production
  • Together with your team, you will work to enhance our VFMOps & VLMOps, contributing to a superior user experience that distinguishes Twelve Labs from its competitors
  • Your leadership, technical expertise, and commitment to excellence will be critical to our team's success and our users' satisfaction
  • Prioritize the team’s work in building and improving our machine learning systems in production for video foundation and language model (VFM & VLM), in collaboration with senior engineers and other stakeholders
  • Inference Infrastructure: Construct the most performant, scalable, and reliable inference engine optimized for Twelve Lab’s video foundation and language models
  • ML Deployment & Operations (VFMOps / VLMOps): Lead the initiative in serving the model in the most optimized manner, deploying the pipeline, and automating the model training to deployment process
  • Data: Oversee the data infrastructure and preparation of high-quality video data for our training runs
  • Design processes (e.g. postmortem review, incident response, on-call rotations) that help the team operate effectively
  • Coach and develop your reports to decide how they would like to advance in their careers and help them do so
  • Run the team’s recruiting efforts through a period of rapid growth

Application process

  • Recruiter Phone Screen
  • Phone Interview
  • Technical Screen
  • Onsite Interview
  • Reference Checks

Our take

Developing an algorithm that can understand text or images is (relatively) straightforward. However, the challenge escalates when it comes to understanding video, where these modes merge with audio, and context becomes much harder to grasp.

Twelve Labs has developed a machine learning solution that tackles this challenge by making the inner content of videos both indexable for developers and highly searchable for users. This technology could prove immensely valuable, with use cases extending far beyond simple searchability for end users. It could be employed for more accurate monitoring of community guidelines on social media, enterprise knowledge searches, and a deeper understanding of the value of video content.

With recent funding under its belt, Twelve Labs is set for rapid growth. The investment will drive R&D, nearly double its workforce, and advance its video understanding technology. As it expands, Twelve Labs is well-positioned to lead the future of multimodal AI and revolutionize how organizations extract values from video content.

Steph headshot

Steph

Company Specialist

Insights

Led by a woman
Top investors

Some candidates hear
back within 2 weeks

Company

Funding (last 2 of 5 rounds)

Jun 2024

$50m

SERIES A

Oct 2023

$10m

EARLY VC

Total funding: $77.2m

Company benefits

  • Full health, dental, and vision benefits
  • Extremely flexible PTO and parental leave policy. Office closed the week of Christmas and New Years
  • Remote-flexible, offices in San Francisco and Seoul and coworking stipend
  • VISA support (such as H1B and OPT transfer for US employees)

Company values

  • Curiosity is power: The complexities of understanding videos present incredibly challenging problems. Curiosity fuels us to create technology that is not only adaptable but also exceptionally robust. Our products have unlocked a powerful new way for developers and enterprises to amplify their understanding of petabytes of data, and we are just getting started
  • Embrace the underdog: We strive to be the best by championing innovation, resilience, and empathy. Failure does not intimidate us but encourages us to always speak up and try new things. In the face of adversity, we rally together, and it is our collective purpose that propels us forward achieving things as a team that exceed even our own expectations
  • Thought leaders: We're not just part of the industry; we shape it. At Twelve Labs, ​​you will immerse yourself in an environment brimming with creativity and forward-thinking. Each day presents an opportunity to gain invaluable insights, challenge conventional wisdom, and pioneer new frontiers as we push the boundaries of AI with our research

Company HQ

SoMa, San Francisco, CA

Founders

Jae Lee

(Co-Founder & CEO)

After Interning as a Software Engineer at Samsung and Amazon, they joined the Republic of Korea's Cyber Operations Command as a Lead Data Scientist. Co-founded Twelve Labs after this period of military service.

Aiden Lee

(Co-Founder & CTO)

Interned at Korea Advanced Institute of Science and Technology (KAIST) as a Deep Learning Researcher. Completed their National Defense duty as an AI & ML Engineer in the Cyber Operations Command.

Sung Jun (SJ) Kim

(Co-Founder)

Served for the Ministry of National Defense as a Lead Software Engineer in the Cyber Operations Command. Before this, they were a Cyber Security Research Scientist at Sungkyunkwan University.

Dave Chung

(Co-Founder)

Previously a Project Team Lead at the Institute of East and West Studies (IEWS) at Yonsei University, focusing on the planning and development of the Korean Web 3.0 ecosystem (Funded by the Ministry of ICT).

Soyoung Lee

(Co-Founder)

Worked in Risk Assurance for PricewaterhouseCoopers in Seoul before co-founding Twelve Labs.

Salary benchmarks

We don't have enough data yet to provide salary benchmarks for this role.

Submit your salary to help other candidates with crowdsourced salary estimates.

Share this job

View 9 more jobs at Twelve Labs