ML Research Scientist, Twelve Labs
AI-enabled video understanding technology
Open for applications
AI-enabled video understanding technology
21-100 employees
Open for applications
21-100 employees
Company mission
To help developers build programs that can see, listen, and understand the world by giving them the most powerful video understanding infrastructure.
Role
Who you are
- Research experience and interest in fields such as Video Understanding, Multimodal Language Modeling, Vision + X, Open-domain QA, Generative Models, Video Representation Learning, Action Recognition, Multimodal AI, or similar areas
- PhD in a related field, or a Master's degree with 3+ years of industry experience
- Ability to independently lead research projects
- Passionate and responsible in performing job duties
- Experience developing large-scale commercial ML products
- Experience in large-scale model training and acceleration
- Published research in top-tier AI conferences (e.g., NeurIPS, ICML, ICLR, AAAI, NAACL, ACL, EMNLP, CVPR, ICCV, ECCV, KDD, SIGGRAPH) related to video, Vision + NLP, or multimodal studies
- High-ranking records in international conference challenges, Kaggle competitions, or domestic AI competitions
- Excellent English writing and communication skills
What the job involves
- We're seeking a talented AI Research Scientist to drive our research efforts in video embedding and retrieval, multimodal language models, and intelligent agents
- As a key member of our team, you will collaborate closely with the team lead to select and execute AI research projects responsibly and proactively
- Your contributions will be instrumental in shaping the future of our products and ensuring their success in the market
- Conduct AI research projects essential for advancing Twelve Labs' products (e.g. video embedding & retrieval, multimodal language model, agents)
- Collaborate with the team lead to select AI research projects and execute them responsibly and proactively
- Discuss and determine data collection and labeling methods for project execution
- Provide regular communication and feedback among ML team members on ongoing projects
- Proactively communicate and provide feedback on ongoing projects with the team lead and other team members
- Discuss and contribute to creating a culture and environment that enables the team to work most efficiently
Otta's take
Xav Kearney
CTO of Otta
Developing an algorithm that can understand text, or images is (relatively) straightforward. However, it becomes a lot more challenging when it’s required to understand video, where these modes fuse with audio and context becomes much harder to gauge.
Twelve Labs has developed a Machine Learning solution that can do just that, then make the inner content of the video indexable for developers and highly searchable for users.
This kind of tech could prove immensely valuable as its use cases go far beyond searchability for the end user. In theory it could be used for more accurate community guidelines monitoring on social media, enterprise knowledge search, and a better overall understanding of the value of video content.
Founded in 2021, Twelve Labs is still a relatively young startup. However Index Ventures, Radical Ventures, Expa, and Techstars have provided significant backing, showing that there’s plenty of confidence in the company’s potential.
Insights
Some candidates hear
back within 2 weeks
Company
Funding (last 2 of 5 rounds)
Jun 2024
$50m
SERIES A
Oct 2023
$10m
EARLY VC
Total funding: $77.2m
Company benefits
- Voluntary commuting, voluntary remote work and flexible work system (Work-from-anywhere & anyhow)
- Home office setup stipend
- Market-leading competitive compensation packages (salary, stock options, etc.)
Company HQ
SoMa, San Francisco, CA
Articles
Founders
Jae Lee
(CEO)After interning as a Software Engineer at Samsung and Amazon, they joined the Republic of Korean's Cyber Operations Command as a Lead Data Scientist. Co-founded Twelve Labs after this period of military service.
Aiden Lee
(CTO)Interned at Korea Advanced Institute of Science and Technology (KAIST) as a Deep Learning Researcher. Completed their National Defense duty as an AI & ML Engineer in the Cyber Operations Command.
Sung Jun (SJ) Kim
(Head Of Software Architecture)Like co-founders Aiden and Jae Lee, served for the Ministry of National Defense as a Lead Software Engineer in the Cyber Operations Command. Before this they were a Cyber Security Research Scientist at Sungkyunkwan University.
Dave Chung
(Head of Operations)Previously a Project Team Lead at the Institute of East and West Studies (IEWS) at Yonsei University, focusing on the planning and development of the Korean Web 3.0 ecosystem (Funded by the Ministry of ICT).
Soyoung Lee
(Head of Business Development)Worked in risk assurance for PricewaterhouseCoopers in Seoul before co-founding Twelve Labs.
Salary benchmarks
We don't have enough data yet to provide salary benchmarks for this role.
Submit your salary to help other candidates with crowdsourced salary estimates.
Share this job
View 11 more jobs at Twelve Labs