Staff Data Engineer - Infura
Our mission is to unlock the collaborative power of communities by making Web3 universally easy to use, access, and build on.
Working with Consensys puts you at the forefront of an evolving paradigm, transforming our society for the better. We fundamentally believe blockchain is the next generation of technology that can lay the foundation for a more just and equitable society.
Blockchain tech is just over 10 years old. Ethereum itself is still a toddler and we’re far from reaching our full potential. You’ll get to work on the tools, infrastructure, and apps that scale these platforms to billions of users.
You’ll be constantly exposed to new concepts, ideas, and frameworks from your peers, and as you work on different projects — challenging you to stay at the top of your game. You’ll join a network of entrepreneurs and technologists that reaches the edge of our ecosystem. Consensys alumni have moved on to become tech entrepreneurs, CEOs, and team leads at tech companies.
About MetaMask and Infura Business Group
About MetaMask
We’re building for a future where the internet and world economy empowers people through interactions based on consent, privacy, and free association. Where both communities and individuals flourish. To accomplish that, we’re working hard to make web3 accessible for everyone around the world.
MetaMask is both a crypto wallet and a gateway to the decentralized web. Our tools help people create communities, play video games, access financial services, make payments, invest in assets, protect against economic turmoil, and more. Our browser extension and mobile platforms meet the needs of millions of users and developers across the world.
Originally a humble key manager, today MetaMask serves millions of monthly active users as a decentralized application development platform, an aggregator of decentralized cryptocurrency exchanges, and a decentralized identity manager.
About Infura
Infura is the leading infrastructure platform providing scalable and easy-to-use APIs and cloud solutions for blockchain and decentralized application developers. Infura currently offers APIs for Ethereum, IPFS, and other leading decentralized networks, allowing developers to immediately begin building instead of spending time on architecting and maintaining their own infrastructure.
Infura provides developers instant access to decentralized and blockchain networks without the need to sync or understand complicated peer to peer infrastructure. Similar to how one might access a cloud service to alleviate the friction of owning proprietary compute and storage, Infura lowers the barrier to entry for engineers to begin building.
We believe in a more equitable and decentralized future, and we know developers will be at the forefront of that progress. We want to empower developers to spend their time building, creating, and evolving by providing them with the best and easiest solution to their infrastructure needs.
Some things to know about the Infura team, we are a remote first company, with team members all over the world. We strive to reduce meetings, respect work life balance, promote diversity, and generally be good people. We depend on each other not only to make an amazing product but to be a group that wants to succeed together.
What you’ll do
As a Senior Staff Data Engineer, you will be responsible for end-to-end data pipelines implementation, starting from product/system requirements discussions, architectural alignments, development, deployment, and maintenance. Most of these projects contain a highly ambiguous scope, high complexity and critical business impact. You will directly collaborate to shape the data architecture of the company, ensuring its scalability, simplicity, and sustainable growth. As a technical leader, your work will impact the trajectory of the company both through working on the most impactful problems and being able to bring about change through influence.
Would be great if you brought this to the role
You have at least 5-7 years of experience leading complex projects. You have 3-5 years of experience in cloud environments. You come from an engineering background and have shaped the engineering culture of past teams. You have hands-on experience with systems in our data stack including Redshift, Airflow, EMR / PySpark, streaming systems like Kinesis or similar, and Data Lake implementations. An understanding of various analytics methodologies and how data products feed into end user analytics.
This is a hands on position, where the candidate will contribute to in the following areas:
- Discussing product requirements with several business stakeholders, ensuring a good communication with them, and managing timelines and outcomes expectations.
- Collaborating with other engineering teams to discuss architectural points and technical implementations of data pipelines.
- Releasing/ensuring the necessary infrastructure to deploy data pipelines using Infrastructure as Code (E.g.: Terraform, Pulumi).
- Regularly reviewing the data platform to ensure its scalability and simplicity.
- Collaborating to create an engineering culture in the data team, improving our CI/CD pipelines, building workflows automations, and reviewing pull requests.
- Ingesting data in the data platform using SQL/Python/PySpark.
- Modeling data for business purposes (E.g.: using dbt, Looker).
- Orchestrating and maintaining data pipelines execution (E.g.: Airflow).
- Creating big data pipelines using Apache Spark on AWS.
- Tuning our current data services (data lake, data warehouse, reporting, data integration) on AWS.
- Documenting the current data pipelines and good practices, supporting the onboarding of new team members.
Don't meet all the requirements? Don't sweat it. We’re passionate about building a diverse team of humans and as such, if you think you've got what it takes for our chaotic-but-fun, remote-friendly, start-up environment—apply anyway, detailing your relevant transferable skills in your cover letter. While we have a pretty good idea of what we need, we're ready for you to challenge our thinking on who needs to be in this role.
Consensys is an equal opportunity employer. We encourage people from all backgrounds to apply. We are committed to ensuring that our technology is made available and accessible to everyone. All employment decisions are made without regard to race, color, national origin, ancestry, sex, gender, gender identity or expression, sexual orientation, age, genetic information, religion, disability, medical condition, pregnancy, marital status, family status, veteran status, or any other characteristic protected by law. Consensys is aware of fraudulent recruitment practices and we encourage all applicants to review our best practices to protect yourself which can be found (https://consensys.io/careers/best-practices-to-avoid-recruitment-fraud/).