Backend Engineer - Big Data

Backend Engineer - Big Data

This job is no longer open

Joining Collibra’s Backend Engineering - Big Data team:

  • You will join a brand new Engineering team reporting the Senior Manager for Data Quality  
  • You will work on evolving our new Data Quality Product with leading minds in Data Quality detection & monitoring
  • You will build large-scale batch and streaming data pipelines and data processing frameworks with predictive models
  • You will design, develop, and deploy backend services in Java & Scala with a focus on high availability, robustness, and scalability
  • You will be a lead engineer for this project and oversee that the designs and implementation are pragmatic and of high quality

 

Backend Engineers Collibra are responsible for:

  • Developing high quality code, including participating in testing and maintenance of that code
  • Collaborating with Product Management, Design, Architecture, and other Engineers to help estimate work, design scalable and performant solutions that will delight our customers, and produce high quality production-grade software
  • Applying pragmatic engineering approaches to deliver value to customers
  • Working closely with Data Science and Backend Engineering teams to ensure quality of product
  • Being seen as leading engineer who focuses and aligns on the team objectives
  • Play an active role in designing and building new, cutting-edge Data Quality management product features

 

You Have:

  • At least 6 years of software engineering experience with some combination of the following: Java, Scala, Spark DataFrame, PySpark, and/or Database Modeling 
  • Knowledge of enterprise level software architecture and infrastructure such as multi-tenant DB
  • Experience in designing relational database models and exposing the data to frontend as REST APIs
  • Experience in using Spark or other similar distributed frameworks (e.g. Databricks, Hadoop) for processing big datasets in the cloud
  • Experience with working with and safely modernizing existing, complex software

You Are:

  • Agile-minded, optimistic, passionate, and pragmatic about delivering valuable software to customers
  • Obsessive about data and how it impacts customer’s business processes
  • Able to work productively and independently with a geographically distributed remote team and to be able to mentor and advise other engineers you work with on the scrum team
  • Accustomed to a fast paced environment and able to identify and suggest solutions for gaps in software development process
  • Interested in putting machine learning (ML) models in production and understand engineering trade-offs during production process

Reporting to Collibra’s Senior Manager for Data Quality measures of success are:

  • Within your first month, you will get familiar with the environment we use, the way we implement software as an organization, simple business use cases and submit code to production
  • Within your third month, you will implement new user stories with quality and care, and understand what value they will bring to our customers. You will start providing input on how best to move the product forward and improve the product
  • Within your sixth month, you will be a lead engineer of the Data Quality team, regularly delivering quality code, participating in testing, and ensuring good, scalable, pragmatic engineering practices are followed by the team 

Benefits at Collibra:

We strive to provide all Collibrians with competitive and cost-efficient benefits that are aligned to our company values. As a high-growth company, our goal is to offer flexibility and choice with our benefits programs to support the evolving needs of our changing workforce. The specific offerings will differ slightly by region but our {Be}well benefit programs encompass the following strategic pillars:

  • {Be}Healthy: Healthcare for yourself and eligible dependents (inclusive of partners/domestic partners), mental health resources and care, tax-advantaged accounts, income protection, discount programs and more! Additionally, we encourage employees to treat their whole self by offering a bi-monthly calendar of events and programming dedicated to our {Be}well initiatives which focus on wellbeing areas including emotional, professional & social, financial, physical, allyship & belonging and giving back.
  • {Be}With Family: We offer multiple types of leave so that you can spend time with loved ones, including parental leave, caregiver leave and our annual family day. These are all complementary to our culture in which we value output over hours!
  • {Be}Kind: Collibra For Good, Unconscious Bias & Allyship training, Manager Racial Injustice training and Collibra-led fundraisers.
  • {Be}Unplugged: Our paid time off programs include vacation, holidays, sick time and compassionate/bereavement leave. We also offer remote-friendly meditation sessions and cooking lessons – all of which you’re actively encouraged to use!
  • {Be}Informed: Competitive compensation, bonus potential, private company equity, merit reviews and promotion cycles, company pension, discounts programs, access to LinkedIn Learning, employee referral program, employee rewards & recognition, development programs and more!
  • {Be}Together: Community and belonging with our Employee Resource Groups (ERGs) and personal interest groups, ERG-driven events, speaker series, and celebrations, a dedicated DEI council, the virtual Collibra cafe, trivia, bingo games and much more! 

When in-person (office) life resumes, we look forward to more snacks, catered lunches, team offsites and social events (think holiday gift exchange, fundraising events, happy hours, celebrations and more)!

Equal Opportunity:

At Collibra, we’re proud to be an equal opportunity employer – which ties directly to our core value, “open, direct, and kind.” We realize the key to creating a company with a world-class culture and employee experience comes from who we hire and creating a workplace that celebrates everyone. 

With this, we proudly consider qualified applicants without regard to race, color, religion, creed, gender, national origin, age, disability, veteran status, sexual orientation, pregnancy, sex, gender identity, gender expression, genetic information, physical or mental disability, HIV status, registered domestic partner status, caregiver status, marital status, veteran or military status, citizenship status or any other legally protected category.

 

#LI-DL1

This job is no longer open
Logos/outerjoin logo full

Outer Join is the premier job board for remote jobs in data science, analytics, and engineering.