Data Solutions Architect, Astronomer
$150-175k
+ Equity
Data orchestration platform
Open for applications
Data orchestration platform
201-500 employees
Open for applications
$150-175k
+ Equity
201-500 employees
Company mission
Astronomer's mission is to help companies build, run, and observe their data pipelines through its data orchestration platform powered by Apache Airflow.
Role
Who you are
- Experience with Apache Airflow in production environments
- Experience in designing and implementing ETL, Data Warehousing, and ML/AI use cases
- Proficiency in Python
- Knowledge of cloud-native data architecture
- Demonstrated technical leadership on team projects
- Strong oral and written communication skills
- Strong customer empathy
- Willingness to learn new technologies and build reference implementations
Desirable
- 5+ years experience in a data engineering or similar role
- 2+ years in a customer-facing role
- Consulting experience
- Experience in migrating workflows from legacy schedulers (Control-M, Autosys, Oozie, Cron, etc.) to Apache Airflow
- Snowflake experience
- Databricks or Spark experience
- Experience working with containers
- SQL experience
- Kubernetes experience, either on-premise or in the cloud
- Enterprise data experience in regulated environments
What the job involves
- As a Data Solutions Architect, you will work with a small group of named customers and become a trusted advisor delivering world-class technical solutions leveraging Apache Airflow and Astronomer products
- In this role, you will be exposed to a wide range of use cases where Apache Airflow sits at the center of the solution
- The impacts you make will enable customers to rapidly grow their businesses by adopting Astronomer products to meet their goals
- Help guide our customers in their Apache Airflow journeys, including identifying new use cases and onboarding new teams
- Review, optimize, and tune customer data pipelines
- Build architecture, data flow, and customer operational diagrams and documents
- Provide reference implementations of various activities, including composing data pipelines in Airflow, implementing new Airflow features, or integrating Airflow with 3rd party solutions
- Keep up with the latest Astro and Airflow features, in order to better advise customers on impactful improvements they can make
- Collaborate to build reusable assets, automation tools, and documented best practices
- Interact with Product and Engineering teams to channel product feedback and requirements discussions
- Work with Customer Success team members to ensure clients are realizing value in their Airflow and Astronomer journeys
Otta's take
Xav Kearney
CTO of Otta
Developing data pipelines is essential for modern businesses to stay competitive, but building them can be a slow process. Workflow management tools for data engineering pipelines such as Apache Airflow makes the development process significantly simpler, but managing it manually is still a repetitive, convoluted, and time-consuming process.
Astronomer provides a data orchestration platform called Astro powered by Apache Airflow, aiming to automate its data pipeline management processes, unify data flows, and ultimately help businesses to access the software's full potential without DevOps. The company claims that its collaborative system helps teams to build data pipelines faster, increase data availability, ensure runtime environments are reliable within cloud infrastructures, and provide a holistic overview of business data.
Whilst it is undeniable that the company faces competition from other data orchestration platforms, Astronomer has been smart to recognize the presence of inefficiencies in Apache Airflow, despite its great potential. The company is thus providing solutions to improve it not replace it, a unique perspective that shows great potential for Astronomer to disrupt the market.
Insights
Company
Funding (last 2 of 8 rounds)
Mar 2022
$213m
SERIES C
Jan 2021
$43.6m
SERIES B
Total funding: $279.8m
Company benefits
- Remote friendly, work from anywhere
- If you’re in a city with an office, it’s there (and stocked with snacks) when you need it
- Co-workers in over 40 states and 15 countries around the world
- Health, dental, and vision insurance at little to no cost for individuals, and at competitive rates for your dependents
- Disability and life insurance policies in case something happens
- Unlimited vacation - we do track vacation days and actively encourage people to take it (on average, Astronomers take 20 days of vacation per year)
- Parental leave
- Laptop of your choice, and a stipend to help with your work-from-home setup
- Monthly $170 pre-tax stipend intended to cover your cellphone and WiFi bills
- Yearly internal summit for all employees
- Regular access to conferences, workshops, and meetups in the ecosystem
Company values
- Empathy - We're humans first. We seek to understand why people do what they do and believe that innovation comes from human-centric questions, discoveries, and decisions. We act with compassion and build trust by owning our impact on the people and systems around us
- Inclusion - We welcome diverse perspectives and value our differences. We're intentional about cultivating a respectful and welcoming environment with no ceiling on opportunity. Collaboration is our superpower
- Agility - We're a multi-disciplined team that’s focused on execution but nimble enough to adapt as the needs of our company, industry, and world evolve. We see change as opportunity
- Grit - We are energetic problem-solvers. We roll up our sleeves and figure it out as we go, navigating ambiguity with resilience. We’re powered by a shared sense of purpose and commitment to delivering excellence
- Curiosity - We’re humble learners with deep curiosity about the world, technology, and each other. We're active listeners and questioners, skilled at breaking down complex problems and making sense of them. We're unafraid to challenge the past and present, and are driven in the pursuit of truth and continuous improvement
- Transparency - Openness is at the core of everything we do. We disrupt knowledge silos and seek feedback early and often. We take pride in contributing our work to the open-source community and owning our role as educators
Company HQ
Pendleton, Cincinnati, OH
Articles
Founders
Greg Neiheisel
(Co-founder)Software Engineer for Great American Insurance from 2011 to 2013. Experience as Founder and CTO of USERcycle.
Tim Brunk
(Co-founder)Co-founder of Cladwell since 2012 and of Ocean Accelerator since 2014. Founder of MetaRouter since 2018.
Share this job
View 9 more jobs at Astronomer