We are the company behind WordPress.com, Jetpack, WooCommerce, and Tumblr! We are looking for a Senior Data Engineer with experience in Spark/Scala to join our team of data scientists and engineers to build, deploy, and iterate on large-scale data pipelines and applications.
How do we work
We’re kind to each other and our users – we strive to build a positive, supportive, and inclusive culture of cohesive teams focused on delivering value to our customers.
We work as a global and distributed workforce resulting in a unique way of working built around our creed .
We offer flexible work arrangements allowing our team members to work when they feel best.
We welcome collaboration, and you can be involved in any discussion across our many communication channels.
Enough about us, let‘s talk more about you. The Senior Data Engineer position might be a good fit if you:
Have hands-on experience with Scala, Spark, and Python to implement large-scale data flows.
Have production experience with open source technologies like Hadoop, Hive, Kafka, Airflow, HBase, etc.
Have experience in managing and tuning Hadoop and related services in production.
Care about architecture, unit testing, and building reliable infrastructure and pipelines.
Are motivated to propose technical solutions, own software architecture, evaluate technologies and infrastructure, and develop technical roadmaps for future applications.
Bring programming skills in multiple programming languages and paradigms. In addition to Scala and Python, you are likely to encounter Java, PHP, and SQL in this role and the idea of using them on a regular basis should not be a blocker for you.
Are familiar with professional software engineering methods and standards such as coding conventions, code reviews, continuous integration, build processes, testing, and operations.
Are open and able to travel 3-4 weeks per year to meet your teammates in person. We hold an annual all-company meeting every year , and meet up with our teams for a week once or twice per year. Important note: at the moment all company travel has been suspended due to COVID-19. Automattic is monitoring government and health agency reports closely and responding however possible to prioritize safety and well-being for our team and communities.
Like all positions at Automattic, you’ll work remotely, and can be based wherever you live.
How to apply
Please answer the following questions in the application form. Applications without these questions answered will not be considered:
Tell us some details about an interesting at-scale data problem you’ve worked on. What made it interesting or challenging?
Include a link to a recent favorite blog post or paper about working with lots of data.
We’re a distributed company with more than 1600 Automatticians in 80+ countries speaking 90+ different languages. We democratize publishing and commerce so anyone with a story can tell it, and anyone with a product can sell it, regardless of income, gender, politics, language, or country.
We believe in Open Source and the vast majority of our work is available under the GPL .
Diversity, Equity, and Inclusion at Automattic
We’re improving diversity, equity, and inclusion in the tech industry. At Automattic, we want people to love their work and show respect and empathy to all. We welcome differences and strive to increase participation from traditionally underrepresented groups. Our DEI committee involves Automatticians across the company and drives grassroots change. For example, this group has helped facilitate private online spaces for affiliated Automatticians to gather and helps run a monthly DEI People Lab series for further learning. Diversity, Equity and Inclusion is a priority at Automattic, though our dedication influences far more than just Automatticians: We make our products freely available and translate our products into and offer customer support in numerous languages. We require unconscious bias training for our hiring teams and ensure our products are accessible across different bandwidths and devices. Learn more about our dedication to diversity, equity, and inclusion and our Employee Resource Groups .