Machine Learning Engineer, Twelve Labs

Inference System

Salary not provided
AWS
Docker
Kubernetes
GCP
Python
Go
Azure
CUDA
Senior level
San Francisco Bay Area

More information about location

Twelve Labs

AI-enabled video understanding technology

Job no longer available

Twelve Labs

AI-enabled video understanding technology

21-100 employees

B2BArtificial IntelligenceContentMachine LearningSaaSVideo

Job no longer available

Salary not provided
AWS
Docker
Kubernetes
GCP
Python
Go
Azure
CUDA
Senior level
San Francisco Bay Area

More information about location

21-100 employees

B2BArtificial IntelligenceContentMachine LearningSaaSVideo

Company mission

To help developers build programs that can see, listen, and understand the world by giving them the most powerful video understanding infrastructure.

Role

Who you are

  • Proficiency in Python and Go
  • 3 years + experience in building and designing ML infrastructure
  • 5 years + software development experience, including experience in building ML infrastructure
  • Experience in deploying AI/ML models on cloud platforms such as AWS, Azure, GCP
  • Ability to communicate effectively in English with individuals from diverse language backgrounds and different timezones

Desirable

  • MS or PhD in Computer Science, Math, or equivalent real-world experience
  • Experience in leading a team of engineers
  • Experience in designing and building Micro Services Architecture (MSA)
  • Strong understanding of container ecosystems such as Docker and Kubernetes
  • Experience in training deep learning models
  • Experience in model deployment using Triton and TensorRT
  • Proficiency in GPU Computing (i.e. CUDA)
  • Ability to communicate effectively in Korean

What the job involves

  • As a Software Engineer, Inference Infrastructure at Twelve Labs, you will play a crucial role in the ML Platform team, where your primary focus will be scaling the infrastructure to host one of the industry's most powerful video foundation models
  • Your responsibility will be to ensure the scalability, performance, and reliability of our model inference pipeline, which involves handling high volumes of traffic, video processing, and model deployment
  • Develop an end-to-end video processing pipeline that processes multimodal data (images, audio, etc.) in a video to fit the required format for models
  • Deploy ML models, ensuring consistent and optimal performance in both cloud (like AWS, Azure, GCP) and on-premise environments
  • Collaborate closely with DevOps and system engineering teams to ensure seamless deployments, rollbacks, and updates
  • Engage in troubleshooting and quick resolution of any deployment-related issues, ensuring minimal downtime and optimal user experience

Application process

  • Recruiter Phone Screen
  • CTO Chat
  • Take-home Assignment
  • Technical Interview
  • Culture Interview
  • Reference Checks

Otta's take

Xav Kearney headshot

Xav Kearney

CTO of Otta

Developing an algorithm that can understand text, or images is (relatively) straightforward. However, it becomes a lot more challenging when it’s required to understand video, where these modes fuse with audio and context becomes much harder to gauge.

Twelve Labs has developed a Machine Learning solution that can do just that, then make the inner content of the video indexable for developers and highly searchable for users.

This kind of tech could prove immensely valuable as its use cases go far beyond searchability for the end user. In theory it could be used for more accurate community guidelines monitoring on social media, enterprise knowledge search, and a better overall understanding of the value of video content.

Founded in 2021, Twelve Labs is still a relatively young startup. However Index Ventures, Radical Ventures, Expa, and Techstars have provided significant backing, showing that there’s plenty of confidence in the company’s potential.

Insights

Led by a woman
Top investors

Some candidates hear
back within 2 weeks

Company

Funding (last 2 of 5 rounds)

Jun 2024

$50m

SERIES A

Oct 2023

$10m

EARLY VC

Total funding: $77.2m

Company benefits

  • Voluntary commuting, voluntary remote work and flexible work system (Work-from-anywhere & anyhow)
  • Home office setup stipend
  • Market-leading competitive compensation packages (salary, stock options, etc.)

Company HQ

SoMa, San Francisco, CA

Founders

Jae Lee

(CEO)

After interning as a Software Engineer at Samsung and Amazon, they joined the Republic of Korean's Cyber Operations Command as a Lead Data Scientist. Co-founded Twelve Labs after this period of military service.

Interned at Korea Advanced Institute of Science and Technology (KAIST) as a Deep Learning Researcher. Completed their National Defense duty as an AI & ML Engineer in the Cyber Operations Command.

Sung Jun (SJ) Kim

(Head Of Software Architecture)

Like co-founders Aiden and Jae Lee, served for the Ministry of National Defense as a Lead Software Engineer in the Cyber Operations Command. Before this they were a Cyber Security Research Scientist at Sungkyunkwan University.

Dave Chung

(Head of Operations)

Previously a Project Team Lead at the Institute of East and West Studies (IEWS) at Yonsei University, focusing on the planning and development of the Korean Web 3.0 ecosystem (Funded by the Ministry of ICT).

Soyoung Lee

(Head of Business Development)

Worked in risk assurance for PricewaterhouseCoopers in Seoul before co-founding Twelve Labs.

Salary benchmarks

We don't have enough data yet to provide salary benchmarks for this role.

Submit your salary to help other candidates with crowdsourced salary estimates.

Share this job

View 12 more jobs at Twelve Labs