Databricks Architect

Full Time
3 months ago
Who We Are Headquartered in New York City, Take-Two Interactive Software, Inc. is a leading developer, publisher, and marketer of interactive entertainment for consumers around the globe. The Company develops and publishes products principally through Rockstar Games, 2K, Private Division, and Zynga. Our products are currently designed for console gaming systems, PC, and Mobile, including smartphones and tablets, and are delivered through physical retail, digital download, online platforms, and cloud streaming services. The Company’s common stock is publicly traded on NASDAQ under the symbol TTWO. While our offices (physical and virtual) are casual and inviting, we are deeply committed to our core tenets of creativity, innovation and efficiency, and individual and team development opportunities. Our industry and business are continually evolving and fast-paced, providing numerous opportunities to learn and hone your skills. We work hard, but we also like to have fun, and believe that we provide a great place to come to work each day to pursue your passions.

 

The Challenge

Become a driving force in building a Near Real-time modelling architecture to process data from Kafka streams/Databricks and perform inference using pretrained models.

 

What You’ll Take On Immediate Responsibilities:

 

Behavioral Analytical Model Development:

  • Deploying Behavioural analytical models to Databricks and SageMaker 
  • Data Sourcing and Integration:
    • Source data from Snowflake and Kafka/Confluent.
    • Define and implement data flow into and out of models.

 

Business Modelling and Data Architecture:

  • Understand various business modelling use cases.
  • Advise on the correct data architecture for different use cases.
  • Work with Data Scientists to help build  proof of concept models using Kafka/Snowflake for near real-time inferencing.

 

Environment and Infrastructure:

  • Advise on specifications for different Databricks environments.
  • Ensure the modelling architecture is scalable to meet growing platform and use case demands.
  • Ensure models and architecture are compliant and secure.
  • Help define the architecture for data flow, including best practices and standards.

 

Monitoring and Troubleshooting:

  • Advise Site Reliability Engineering (SRE) on implementing monitoring for the analytical environment.
  • Troubleshoot issues within Databricks/SageMaker environments.
  • Delta Lake Tables:
    • Understand and utilise Delta Lake tables in Databricks.

 

Comparative Analysis:

  • Understand the pros and cons of building in Databricks versus SageMaker.
  • Business Unit Integration:
    • Advise Business Units (BUs) on integrating their modelling requirements into the defined architecture.

 

Long-term Responsibilities:

 

MLOps and Model Management:

  • Develop and implement a model versioning strategy.
  • Oversee model versioning and lifecycle management.

 

Experimentation and Uplift Measurement:

  • Help define efforts in experimentation and measure behavioural modelling uplift.
  • Craft a vision for behavioural modelling with experimentation at its core.

 

Strategy and Vision:

  • Develop and communicate a strategic vision for behavioural modelling.
  • Stay updated with the latest trends and technologies in analytics and machine learning.

 

Collaboration and Leadership:

  • Collaborate with cross-functional teams to ensure alignment with organisational goals.
  • Provide mentorship and guidance to junior team members.

 

Additional Responsibilities:

 

Documentation and Training:

  • Create and maintain documentation for models and data architecture.
  • Conduct training sessions for stakeholders on the usage and benefits of the architecture.

 

Performance Optimisation:

  • Continuously evaluate and optimise model performance.
  • Implement best practices for data processing and model inferencing.

 

Compliance and Security:

  • Ensure all models and data handling processes comply with relevant regulations and organisational policies.
  • Implement robust security measures to protect data integrity and confidentiality.

 

Stakeholder Communication:

  • Act as a point of contact for stakeholders, providing regular updates and insights on the modelling architecture and its impact.
  • This refined job specification aims to provide a clear and comprehensive overview of the project expectations, covering both short and long term responsibilities and ownership.

 

 

What You Bring 
  • Bachelor's degree in Computer Science/Data Science/Analytics/Mathematics/Stats or a related field
  • 6+ years of experience spanning Data, Machine Learning, Stats, Data Modelling, Behavioural Modelling based solutions with an informed opinion on pros and cons of different architectures. 
  • Understanding of CI/CD processes especially as it relates to Behavioural Modelling. 
  • Demonstrated experience in managing teams and working with external agencies
  • Deep understanding of Databricks/Sagemaker. Bonus points for knowing in depth other parts of the AWS Behavioural Modelling Stack. 
  • Understanding of database technologies and data modelling techniques, including SQL and relational databases like Snowflake.
  • Strong business acumen and the ability to translate technical information into business terms
  • Excellent communication skills, with the ability to effectively communicate with both technical and non-technical stakeholders
  • Strong project management skills, with the ability to prioritise and manage multiple projects simultaneously

 

What we offer you
  • Great Company Culture. We pride ourselves as being one of the most creative and innovative places to work, creativity, innovation, efficiency, diversity and philanthropy are among the core tenets of our organization and are integral drivers of our continued success.
  • Growth: As a global entertainment company, we pride ourselves on creating environments where employees are encouraged to be themselves, inquisitive, collaborative and to grow within and around the company.
  • Work Hard, Play Hard. Our employees’ bond, blow-off steam, and flex some creative muscles – through corporate boot camp classes, company parties, our Office bar, game release events, monthly socials, and team challenges.
  • Benefits. Benefits include, but are not limited to Private healthcare, Private dental, pension plan, Cycle to work scheme, Flu vouchers, Annual health, 4X death in service insurance, Income protection (66% salary), Workplace Savings, 22 days holiday, Enhanced Family friendly policies + other great perks and great office facilities!
  • Perks. Fitness reimbursement up to €45 per month, employee discount programs, free games & events, and stocked pantries.

 

 

As an equal opportunity employer, Take-Two Interactive Software, Inc. (“Take-Two”) is committed to fostering and celebrating the diverse thoughts, cultures, and backgrounds of its talent, partners, and communities throughout its organization. Consistent with this commitment, Take-Two does not discriminate or retaliate against any employee or job applicant because of their race, color, religion, sex (including pregnancy, sexual orientation, and gender identity), national origin, age, disability, and genetic information (including family medical history), or on the basis of any other trait protected by applicable law. If you need to report a concern or have questions regarding Take-Two’s equal opportunity commitment, please contact Careers@take2games.com

 

Please be aware that Take-Two does not conduct job interviews or make job offers over third-party messaging apps such as Telegram, WhatsApp, or others. Take-Two also does not engage in any financial exchanges during the recruitment or onboarding process, and the Company will never ask a candidate for their personal or financial information over an app or other unofficial chat channel. Any attempt to do so may be the result of a scam or phishing exercise. Take-Two’s in-house recruitment team will only contact individuals through their official Company email addresses (i.e., via a take2games.com email domain). If you need to report an issue or otherwise have questions, please contact Careers@take2games.com

 

#LI-PH1

#LI-Hybrid