Twitter is the infrastructure of the world’s public conversation. Events break on Twitter, from massive and world-changing to the local data science meet-up. Users exchange and shape their thoughts by forming communities with shared interests.
The Consumer Data Science Organization works closely with our partners in Consumer Engineering, Product, and Twitter’s leadership to understand user behavior, inform product decisions and influence the company strategy.
The Data Engineering group, which is part of the Consumer Data Science organization, provides core datasets and tooling, which has driven significant growth in our organization. The technologies we work on include Hadoop, Scalding, DataFlow, Summingbird, Spark, Presto, Looker, BigQuery and many others. Several of these technologies were originally developed at Twitter and we actively make open source contributions for many others. We operate at a substantial scale, with multiple Hadoop clusters of 10k+ nodes each, hundreds of Petabytes of data, trillions of log messages arriving daily, and tens of thousands of jobs executed each day. We are making investments around Privacy and data adoption, embracing a hybrid cloud strategy and various data engineering initiatives. We are looking for a manager to help us execute on long-term bets around data engineering initiatives.
You will lead a team of talented Data Engineers and will be looked upon to set team roadmaps, present to executives, drive the career development of your teammates, and influence all facets of the company’s data engineering strategies. As part of our company's data science leadership, you will also be responsible for improving the culture of our organization, attracting extraordinary data science and engineering talent, and elevating the role of data engineering in the company.
You have previous experience leading high-performing teams working at scale. You will also have a passion for open source software. You will enjoy pursuing novel, ambiguous problems, collaborating with a variety of diverse partners, and will bring a strong learning orientation
Ideally, you have experience with:
As an engineering manager, you will lead the careers of extraordinary software developers. You’ll work with internal customers across engineering at Twitter.
Experience and Skills
Leading data engineering teams within Twitter’s Data Science organization
Developing and delivering high-impact, forward-looking roadmaps for your teams
Communicating fearlessly to build trust with diverse stakeholders
Contribute to a culture of technical and operational excellence
Helping solve cross-team problems at scale
Delighting internal customers
Growing the skills and careers of a team of engineers
5+ years of industry experience
Bachelor's degree or equivalent experience in computer science, engineering, or another technical discipline (MS/PhD is a plus)
Comfortable managing multiple technically complex projects in parallel
Robust project management skills, including work estimation, prioritization, planning, tracking, and retrospectives
Excellent people manager with a record of recruiting, managing, and retaining talent
Empathetic, self-aware, and learning-oriented leadership style
High-judgement, data-driven decision-maker
Strong communication skills
Previous management experience in a high-performing, large-scale technology company
Experience developing teams that work on large scale data infrastructure.
Experience in data warehouse technologies, data modeling, and ETL development.
Experience in any programming language like Java, Scala or Python.
Experience with big data technologies like Hadoop, Spark, Hive, Presto, etc.
Experience working on both real-time and batch processing data pipelines.
Passion for privacy and security
A few other things we value:
Challenge - We solve some of the industry’s hardest problems. Come to be challenged, learn, and thrive as an engineer.
Diversity - Diversity makes us a better organization and team. We value diverse backgrounds, ideas, and experiences.
Work, Life, Balance - We work hard, but we believe with hard work should come balance.