Machine Learning Engineer, Twelve Labs

Video Streaming

Salary not provided
Docker
Kubernetes
Python
Airflow
Terraform
C++
Kubeflow
CUDA
PyTorch
Golang
Expert level
San Francisco Bay Area

More information about location

Twelve Labs

AI-enabled video understanding technology

Job no longer available

Twelve Labs

AI-enabled video understanding technology

21-100 employees

B2BArtificial IntelligenceContentMachine LearningSaaSVideo

Job no longer available

Salary not provided
Docker
Kubernetes
Python
Airflow
Terraform
C++
Kubeflow
CUDA
PyTorch
Golang
Expert level
San Francisco Bay Area

More information about location

21-100 employees

B2BArtificial IntelligenceContentMachine LearningSaaSVideo

Company mission

To help developers build programs that can see, listen, and understand the world by giving them the most powerful video understanding infrastructure.

Role

Who you are

  • 10+ years of software development experience, including experience in machine learning engineering
  • 5+ years of experience in building end-to-end machine learning systems encompassing infrastructure, MLOps, and data management
  • You have experience working with engineers at different levels and have coached them in their career development
  • 2+ years of experience managing high output engineering teams
  • Proficiency in working with video processing and data pipelining
  • Experience in establishing and maintaining secure software and system development environments

Desirable

  • MS or PhD in Computer Science, Math, or equivalent real-world experience
  • Fast-paced startup engineering experience
  • Experience working with large scale models
  • Experience working with both cloud and on-premise environment
  • ML research experience would be helpful, as this role requires interchangeable effort on both research side and software side
  • Experience in handling large-scale computing system and firm understanding on scale-up and scale-out approach in cloud environment

What the job involves

  • As the Lead ML Systems Engineer at Twelve Labs, you will lead the ML Engineering team, driving the development of optimal machine learning systems for video foundation (VFM) and language model (VLM) in production
  • Your role encompasses the entire spectrum of machine learning engineering, from optimizing and scaling the inference infrastructure, which involves extensive video processing both in the cloud and on-premise, to model deployment and operations, and data infrastructure
  • For the first 3 to 6 months, you will be hands on and actively contribute as an individual contributor in our development process
  • As the lead, you will set the technical strategies and goals, recruit top talent, and be responsible for your team’s success, ensuring our machine learning systems exceed user expectations in terms of speed, efficiency, and reliability
  • Your expertise will be key in overcoming challenges related to processing vast amounts of video data and deploying sophisticated models in production
  • Together with your team, you will work to enhance our VFMOps & VLMOps, contributing to a superior user experience that distinguishes Twelve Labs from its competitors
  • Your leadership, technical expertise, and commitment to excellence will be critical to our team's success and our users' satisfaction
  • Prioritize the team’s work in building and improving our machine learning systems in production for video foundation and language model (VFM & VLM), in collaboration with senior engineers and other stakeholders
  • Inference Infrastructure: Construct the most performant, scalable, and reliable inference engine optimized for Twelve Lab’s video foundation and language models
  • ML Deployment & Operations (VFMOps / VLMOps): Lead the initiative in serving the model in the most optimized manner, deploying the pipeline, and automating the model training to deployment process
  • Data: Oversee the data infrastructure and preparation of high-quality video data for our training runs
  • Design processes (e.g. postmortem review, incident response, on-call rotations) that help the team operate effectively
  • Coach and develop your reports to decide how they would like to advance in their careers and help them do so
  • Run the team’s recruiting efforts through a period of rapid growth

Application process

  • Recruiter Phone Screen
  • Phone Interview
  • Technical Screen
  • Onsite Interview
  • Reference Checks

Otta's take

Xav Kearney headshot

Xav Kearney

CTO of Otta

Developing an algorithm that can understand text, or images is (relatively) straightforward. However, it becomes a lot more challenging when it’s required to understand video, where these modes fuse with audio and context becomes much harder to gauge.

Twelve Labs has developed a Machine Learning solution that can do just that, then make the inner content of the video indexable for developers and highly searchable for users.

This kind of tech could prove immensely valuable as its use cases go far beyond searchability for the end user. In theory it could be used for more accurate community guidelines monitoring on social media, enterprise knowledge search, and a better overall understanding of the value of video content.

Founded in 2021, Twelve Labs is still a relatively young startup. However Index Ventures, Radical Ventures, Expa, and Techstars have provided significant backing, showing that there’s plenty of confidence in the company’s potential.

Insights

Led by a woman
Top investors

Some candidates hear
back within 2 weeks

Company

Funding (last 2 of 5 rounds)

Jun 2024

$50m

SERIES A

Oct 2023

$10m

EARLY VC

Total funding: $77.2m

Company benefits

  • Voluntary commuting, voluntary remote work and flexible work system (Work-from-anywhere & anyhow)
  • Home office setup stipend
  • Market-leading competitive compensation packages (salary, stock options, etc.)

Company HQ

SoMa, San Francisco, CA

Founders

Jae Lee

(CEO)

After interning as a Software Engineer at Samsung and Amazon, they joined the Republic of Korean's Cyber Operations Command as a Lead Data Scientist. Co-founded Twelve Labs after this period of military service.

Interned at Korea Advanced Institute of Science and Technology (KAIST) as a Deep Learning Researcher. Completed their National Defense duty as an AI & ML Engineer in the Cyber Operations Command.

Sung Jun (SJ) Kim

(Head Of Software Architecture)

Like co-founders Aiden and Jae Lee, served for the Ministry of National Defense as a Lead Software Engineer in the Cyber Operations Command. Before this they were a Cyber Security Research Scientist at Sungkyunkwan University.

Dave Chung

(Head of Operations)

Previously a Project Team Lead at the Institute of East and West Studies (IEWS) at Yonsei University, focusing on the planning and development of the Korean Web 3.0 ecosystem (Funded by the Ministry of ICT).

Soyoung Lee

(Head of Business Development)

Worked in risk assurance for PricewaterhouseCoopers in Seoul before co-founding Twelve Labs.

Salary benchmarks

We don't have enough data yet to provide salary benchmarks for this role.

Submit your salary to help other candidates with crowdsourced salary estimates.

Share this job

View 12 more jobs at Twelve Labs