Senior Data Engineer
As a Sr Data Engineer, you will actively contribute to, architect for, and lead IT in the design and development of data engineering solutions. You will be instrumental in helping us solve, by architecture and implementation, complex data integrity, security, process, and sanitization problems among IT’s robust inventory cloud services, data tooling, and business applications. You will work closely with a team of highly skilled individuals to deliver on high impact engagements at Sumo Logic, reporting directly to the Director of Infrastructure and Architecture in IT.
You are a strong data engineer and architect who is passionate about scalable, resilient, secure, and cost-efficient data solutions. You care about producing clean, elegant, maintainable, robust, well-tested code; you do this as a member of a team, helping the group come up with a better solution than you would as individuals and providing experienced guidance and insight. Ideally, you have experience with performance, scalability, and reliability issues of 24x7 uptime systems and solutions.
Responsibilities:
- Designing and implementing complex and well-architected enterprise data solutions that support mid-to-large size organizations
- Work to improve existing data warehouse systems, solutions, and process through architectural reviews and design enhancement initiatives
- Experience in devops methodologies and practices as applied to infrastructure, cloud, and business applications
- Improve systems to provide strict data compliance adherence, security guardrails, and cost-optimization
- Lead and contribute to the re-architecting of data solutions and processes for more streamlined, scalable, reliable, and resilient implementations
- Design and manage data schemas and the flow of data through corporate systems and applications to ensure compliance, data integrity, and data security
- Deliver well-architected, end-to-end data solutions to a growing enterprise organization across multiple infrastructure environments and business applications
- Build strong partnerships and engage with other teams at Sumo Logic to create solutions that enable and benefit all parties and increased derived value
Requirements:
- 6+ years of industry experience with a proven track record of ownership and delivery
- Experience developing scalable, secure, and resilient data architectures and implementations
- Extensive experience in AWS data solution and infrastructure services such as S3, Managed Airflow, Glue, ECS and EMR
- Experience working with data warehouses (Amazon Redshift, Snowflake, Databricks, Cloudera desired)
- Experience with Python scripting, PySpark, and other data analytics frameworks or tools
- Experience working with the data ingestion, data storage, and data consumption layers
- Experience with SQL and data schemas
- Experience with both structured and unstructured databases
- Experience with docker and container registries such as ECR
- Hands-on infrastructure as code experience in Terraform as well as strong working knowledge of git and GitHub
- Experience with writing business application processes and integrations at an enterprise level (Python preferred)
- Excellent verbal and written communication skills
- Experience building robust and well-architected designs for enterprise scale data architectures and workflows
- Experience and comfort with an on-call schedule for enterprise systems
Desirable:
- Experience in the following specific technologies is a plus:
- Tableau, Looker, and AWS Quicksight
- Big Data services such as HDFS, Spark, Hive, HBase, Yarn, and Oozie
- Data concepts such as model training, data cleaning, ETL, and data orchestration
- AI/ML experience in relation to data and business application solutions
- You should have a passion for continuous learning and deep technological curiosity
- Agile development experience and a familiarity with Jira, sprints, and pointing
About Us:
Sumo Logic, Inc., empowers the people who power modern, digital business. Sumo Logic enables customers to deliver reliable and secure cloud-native applications through its SaaS analytics platform. The Sumo Logic Continuous Intelligence Platform™ helps practitioners and developers ensure application reliability, secure, and protect against modern security threats, and gain insights into their cloud infrastructures. Customers worldwide rely on Sumo Logic to get powerful real-time analytics and insights across observability and security solutions for their cloud-native applications. For more information, visit www.sumologic.com.
Sumo Logic Privacy Policy