Senior Data Engineer

Full Time
Johannesburg, South Africa
9 months ago
About us:

Luno is the crypto investment app you can rely on, enabling you to buy, store and explore crypto securely. We’re committed to putting the power of cryptocurrency in everyone's hands sensibly and responsibly.

Since 2013, we’ve helped millions of people around the world invest safely in crypto. We do this by cutting through the hype and supporting customers at every step of the way. All products and cryptocurrencies on our platform must first meet stringent legal, risk and technical security standards. We don’t do memecoins.

Transparency is key for us. Luno stores all crypto on a 1:1 basis and we have rigorous processes in place so you can be confident your investment is secure. We’re available in more than 40 countries around the world and we work closely with respective regulators in all of these markets to be fully compliant, as we believe this is the best way to help everyone, everywhere, invest safely.

About the team:

Our engineering team (currently ~200 engineers) is split into organisations which we call Fleets. Each Fleet focuses on a core customer journey (onboarding, security, payments, support, new business, growth and marketing etc.). Each of these fleets contains multiple smaller teams called Pods, each of which focuses on a specific aspect of the product.

The Data Platform pod sits across the Fleets within our Engineering Operations structure, building and maintaining our data platforms and infrastructure. Provisioning data to our Fleets and Pods to enable the delivery of data projects and products to meet the business data needs.

We're agile, use scrum, continuous integration and continuous delivery, deploying to production every single day.

The role in a nutshell:

You'll be joining a diverse and highly motivated team of data platform engineers who you'll work collaboratively with to help Luno succeed with our mission. You will set standards, recommend continual improvement, and mentor fellow engineers to do the right thing. You will become the domain expert, trusted by your fellow engineers and product teams to design and deliver secure, data-focused solutions.

Your mission will be:

As a Data Platform Engineer, you will play a crucial role in designing, implementing, and maintaining our organisation's data infrastructure. You will be responsible for developing robust and scalable data platforms that support the efficient processing and analysis of large datasets.

The role will require you to:

  • Design, implement and maintain scalable and efficient data storage solutions.
  • Collaborate with data scientists, analysts, and other stakeholders to understand data needs and design appropriate solutions.
  • Manage and optimise database systems for performance, reliability, and scalability.
  • Implement and maintain database security measures to protect sensitive information.
  • Troubleshoot and resolve database-related issues in a timely manner.
  • Implement and optimise distributed computing solutions for data processing and analytics.
  • Work with big data technologies to process large datasets.
  • Collaborate with cross-functional teams, including data scientists, analysts, software engineers, and business stakeholders.
  • Communicate technical concepts and solutions to non-technical stakeholders in a clear and understandable manner.
  • Implement automation for routine tasks to improve efficiency and reduce manual intervention.
  • Set up monitoring systems to proactively identify and address issues affecting data platform performance.
A little about you:
  • Bachelor's degree in Computer Science, Information Technology, or a related field.
  • Proven experience as a Data Engineer or similar role.
  • Strong programming skills in languages such as Python, Java, or Scala.
  • Experience with database management systems (e.g., SQL, NoSQL) and data warehousing solutions.
  • Familiarity with big data technologies and frameworks (e.g., Hadoop, Spark, Kafka).
  • Knowledge of ETL processes and tools.
  • Strong problem-solving and troubleshooting skills.
  • Excellent communication and collaboration skills.
Extra points for:
  • Master's degree in Computer Science, Information Technology, or a related field.
  • Certification in relevant technologies (e.g., AWS, Azure, Google Cloud).
  • Experience with containerization and orchestration tools (e.g., Docker, Kubernetes).
  • Familiarity with machine learning concepts and tools.
  • Experience working with Databricks.
Our tech stack:
  • Programming Languages: GoLang, Python, SQL
  • IaC Tooling: Terraform
  • Databases: MySQL, Redshift
  • Data Platforms: Databricks
  • Cloud Platforms: AWS
Life at Luno:
  • Forward-thinking and ambitious team that values diversity, hard work, and the continuous quest for excellence.
  • Remote but reachable work policy gives you the freedom to choose between working from home or the office.
  • Improve body and mind, with excellent private medical insurance.
  • Free training courses
  • Generous maternity / paternity and even paw-ternity for your furry friend.
  • Annual Inspiration Day.
  • A collaborative, friendly work community, with regular social events and virtual cooking, dancing, drawing and house planting classes hosted by our Lunauts.
  • Free lunch and snacks.
  • Free access to Headspace – a full library of guided meditations, sleep stories, and music.
  • 0 fees with Luno from the day you start.*

*Offer only available on Luno Instant Buy, not Luno Exchange

We are an equal opportunity employer and value diversity at our company. We do not negatively discriminate on the basis of race, religion, colour, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.