Senior Data Engineer, Stability AI
Open source generative AI company
Open for applications
Open source generative AI company
101-200 employees
Open for applications
101-200 employees
Company mission
To build the foundation to activate humanity's potential.
Role
Who you are
- Proven background within large-scale distributed workloads
- Experience with large-scale data loading for machine learning training runs
- Experience with cloud storage and file systems. AWS (S3) is strongly preferred, but open to other cloud platforms
- Experience with Python
- Experience with large-scale data processing and software development for unstructured data
- Expertise in database, data lake, and data warehouse technologies (Redshift, BigQuery, Snowflake)
- Experience working with machine learning projects and ideally some deep learning / computer vision knowledge
- Good teamwork and communication skills based on experience working with a distributed international team with timezone and cultural differences
- Excellent communication skills to effectively collaborate with users, solve issues, and provide guidance
- Attention to detail and the ability to document processes and solutions effectively
What the job involves
- We are looking for a talented Data Engineer to be part of our Data team
- You will work alongside a growing multidisciplinary team of talented research scientists and machine learning engineers to improve and scale the efficiency within our models
- You will contribute in building the data infrastructure that manages our data and powers the training of all Stability AI models
- Clean, normalize, and preprocess data in a scalable, parallelizable way to prepare it for ingestion into our machine learning model training pipelines while ensuring data quality
- Design, implement, and maintain scalable data infrastructure for generative AI
- Develop tools to search and serve the data at scale
- Collaborate with cross-functional teams to understand and meet their data requirements
- Develop and manage data processing pipelines to support machine learning teams
- Maintain and improve data quality and integrity across various databases and data stores
- Manage and organize large-scale unstructured data, including image, text, audio, video and 3D
Our take
Stability AI is an AI-driven visual art company that designs and implements an open AI tool that creates images based on text input. Through collective intelligence and augmented technology, Stability AI is helping research communities develop cutting-edge AI models for image, language, audio, video, 3D content, biotech and other scientific research.
Working in partnership with Amazon Web Services, Stability AI's latest release, Stable Diffusion is a text-to-image model that utilizes the Ezra-1 UltraCluster (the world's fifth-largest supercomputer). The model quickly proved to be a success, with four of the top ten applications on Apple's App Store being powered by Stable Diffusion after just one month.
Alongside Stable Diffusion, Stability AI offers premium imagining application, DreamStudio, as well as externally built products Lensa, Wonder and NightCafe, which have too amassed great success, with over 40M users and counting. The company is dedicated to investing in more supercomputing power in order to further accelerate its product offerings and is looking to expand its workforce, expecting to grow to over 300 employees by the end of the year.
Freddie
Company Specialist
Insights
Some candidates hear
back within 2 weeks
324% employee growth in 12 months
Company
Funding (last 2 of 3 rounds)
Jun 2024
$80m
EARLY VC
Oct 2023
$50m
CONVERTIBLE
Total funding: $231m
Company values
- Pragmatic and Impact-Driven: We are committed to finding practical solutions that make a positive difference.
- Bold: We constantly push the boundaries of what's possible to create meaningful change and drive progress.
- Collaborative: We believe that working with our partners, customers, and communities can achieve far more than we could alone.
- Innovative: We are always exploring new ideas, experimenting with new technologies, and looking for fresh ways to tackle the world's most pressing challenges.
- Ambitious: We never settle for the status quo. We constantly strive to do better, achieve more, and make a bigger impact in the world.
- Transparent and Trustworthy: We are committed to being open and honest in all our interactions and building long-term partnerships with our customers, employees, and stakeholders based on mutual respect and trust.
Company HQ
Westminster, London, UK
Articles
Leadership
Emad Mostaque
(CEO)Graduated from Oxford University with a master's degree in mathematics and computer science. Founder of Symmitree, a startup aimed at reducing the cost of technology.
Share this job
View 9 more jobs at Stability AI