Data Quality and Catalog Engineer

Full Time
Bengaluru, Karnataka, India
8 months ago

Get to know Okta

Okta is The World’s Identity Company. We free everyone to safely use any technology—anywhere, on any device or app. Our Workforce and Customer Identity Clouds enable secure yet flexible access, authentication, and automation that transforms how people move through the digital world, putting Identity at the heart of business security and growth. At Okta, we celebrate a variety of perspectives and experiences. We are not looking for someone who checks every single box - we’re looking for lifelong learners and people who can make us better with their unique experiences. Join our team! We’re building a world where Identity belongs to you.

The Data Engineering Team

Our focus is on building platforms and capabilities that are utilized across the organization by sales, marketing, engineering, finance, product, and operations. The ideal candidate will have a strong engineering background with the ability to tie engineering initiatives to business impact. 

You will be part of a team doing detailed technical designs, development, and implementation of applications using cutting-edge technology stacks.

The Data Quality Catalog Engineer Opportunity

This role is responsible for developing and implementing scalable solutions that improve data quality across our entire data platform in a fast-paced, Agile environment. 

  • Experience with data quality and observability infrastructure.
  • Knowledge of DevOps practices and tools.
  • Familiarity with microservices architecture.
  • Previous experience in Agile/Scrum development methodologies.

What you’ll be doing 

  • Develop and execute manual and automated test cases across the entire data ecosystem to ensure the reliability of data pipelines, ETL processes, and data transformations.  
  • Collaborate with cross-functional teams to ensure quality and timely delivery of data artifacts.
  • Conduct end to end integration testing between multiple independent systems.
  • Utilize AWS services, Snowflake data warehouse, Databricks lakehouse to test data integration and migration processes.
  • Conduct functional, integration, regression, and performance testing of database systems using standard technologies.
  • Create and maintain documentation of test plans, test cases, testing results, and root cause analyses.
  • Assist in developing and maintaining data governance and security policies and standards.
  • Design, monitor, and maintain data quality reports, KPIs, and trends for internal data systems.
  • Own, improve, and enhance data observability processes and systems.

 

What you’ll bring to the role

  • BS in Computer Science, Engineering or another quantitative field of study
  • 3+ years of expertise in data engineering
  • 3+ years’ experience working with SQL, ETL tools such as Airflow, with relational and columnar MPP databases like Snowflake, Athena or Redshift
  • 1+ years’ experience in conducting functional and performance testing and building testing frameworks
  • Expert in Relational Database design, implementation, queries, and reporting (DDL, SQL)
  • Experience with data quality and observability tools (Monte Carlo, Soda, dbt)
  • Excellent oral and written communication skills, both technical and non-technical audience

And extra credit if you have experience in any of the following! 

  • Experience with packaging and distributing containerized applications using Docker and Kubernetes
  • Strong knowledge of cloud computing platforms like AWS, including serverless services and infrastructure as code using terraform
  • Experience with cloud infrastructure/platforms  (AWS, Azure, Google Cloud Platform) and Data Lake development
  • Experience with data cataloging tools (data.world, Alation, Atlan)

What you can look forward to as an Okta employee!

  • Amazing Benefits
  • Making Social Impact
  • Fostering Diversity, Equity, Inclusion and Belonging at Okta 

Okta cultivates a dynamic work environment, providing the best tools, technology and benefits to empower our employees to work productively in a setting that best and uniquely suits their needs. Each organization is unique in the degree of flexibility and mobility in which they work so that all employees are enabled to be their most creative and successful versions of themselves, regardless of where they live. Find your place at Okta today! https://www.okta.com/company/careers/.

Okta is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, ancestry, marital status, age, physical or mental disability, or status as a protected veteran. We also consider for employment qualified applicants with arrest and convictions records, consistent with applicable laws. If reasonable accommodation is needed to participate in the job application or interview process, please use this Form to request an accommodation.

Okta is committed to complying with applicable data privacy and security laws and regulations. For more information, please see our Privacy Policy at https://www.okta.com/privacy-policy/.