Jul 22, 2019

Lead Data Engineer - Multiple Roles

  • Versent
  • Melbourne VIC, Australia
Full time Data Engineer Back End Software Engineer

Job Description

DESCRIPTION

Versent is a rapidly growing services, product and platform company that works exclusively on AWS. We have offices in Sydney, Melbourne, Brisbane, Perth, Denver and Singapore and have grown to over 350 people in just five years! We are the Australian AWS Consulting partner for the Year for the 3rd time and recently became a Snowflake and Talend Partner.

We believe in bringing craftsmanship back to technology, because as technology artisans, we passionately care about the quality outcomes we leave behind.

We have some of the best techs in Australia and due to client demand, we're looking to expand our data team with a number of Lead Data Engineer(s).

Our Data Engineers know their craft, and know it well. We will also need you to have the right soft skills to listen to and understand other ideas, plus know and see the patterns from your experience across a variation of complex implementations.

Our Lead Data Engineers build upon the skill set of the Senior Data Engineer role, Lead Engineers understand where and how to get going on issues, what discipline to ensure the team follows and what is an acceptable level of technical debt that the team is allowed to accumulate. A Lead Engineer understands how to implement Team Based Decisioning within a known framework and ensures that everyone is working.

The above and beyond skillset of the Senior Engineer is the ability to bring the customer on a journey, helping them understand they aren’t the first to build a scalable, reliable and auditable big data pipeline, to sit with them and help get things over the line and to help win “hearts and minds” across customers internally where Cloud or Big Data analytics is still a foreign term or used in name but not in practice.

REQUIREMENTS

Our Lead Data Engineers exhibit the following behaviours;

  • Ability to lead change with customers
  • Lead engineers understand what requirements may be missing or required to complete a solution
  • Focus on delivery and outcomes with a customer
  • Has the experience to authentically tell the customer when something is an anti-pattern or will fail
  • Can design Data Patterns for re-use and re-implementation (factory based approach)
  • Continually strive toward optimal extraction, transformation, loading and management of data from a wide variety of data sources using SQL and AWS ‘big data’ technologies
  • Can lead small team (2 - 3) DataOps outcomes on a customer site
  • Understand traditional and emerging data pipeline delivery as well as CI and CD processes
  • Lead and mentor data engineers

People wanting to become Lead Data Engineers at Versent have the following skills;

  • From a development or operations background (or an existing DevOps Team)
  • Understanding what getting something done done looks like (documentation, testing, operational requirements, continuous improvement of process)
  • Have experience with the AWS ecosystem (particularity Kinesis, Glue, Redshift, EMR, RDS, Aurora, DMS, etc…)
  • Have exposure to the broader Hadoop and broader data warehouse ecosystems (Cloudera, Hortonworks, Exadata, Greenplum, Terradata, SAP Hana etc)
  • Have some experience with industry leading ETL tools, Informatica, Talend, Snowflake
  • Familiar with data modelling concepts
  • Familiar with end user analytic tools such as SAS, Tableau, etc
  • Can demonstrate what discipline looks like in the AWS ecosystem
  • Advanced experience in one or many of the following programming languages – SQL, Python, Java, SCALA etc

Example Tasks for a Lead Data Engineer;

  • Participating in agile rituals (stand ups, planning sessions, retros, etc...)
  • Working on stories and tasks
  • Conducing Code Reviews (PR's or Pair Programming)
  • Conduct and Participate in Technical Spikes
  • Take Ownership of their card moving to "done, done" which may include some ETL and Data Pipeline development, Infrastructure provisioning, DataOps, Security

BENEFITS

At the core of what we do, we're an engineering company. We value our people more than commercials and put culture at the centre of everything.

We do weekly internal tech meetups with food and drinks, host game nights, organise Hackathons, pay for your AWS training and certifications, and other relevant certs (if it's something you want to do).

We have many social events, often supporting charity initiatives such as TourXOz and RUOK Day. We also have family functions such as lawn bowls, company picnics etc. We have a paid parental leave program.

We embrace the notion of Versent as a Family, working together to achieve outstanding success.

We have flexible working hours and a culture based on respect, trust and collaboration.

WHY WE'RE DIFFERENT

You know, work doesn't have to feel like work. In fact, we don't want it to. That's why we've cultivated an environment based on creativity. Because when people who care about their craft are given the freedom to explore possibilities without restriction, amazing things can happen.

OUR CULTURE

No cool cliques, just hard-working humans generating ideas and devising solutions in a creative, collaborative work space. Professional but not corporate, we believe success is achieved through strong leadership (without interference from middle-management) and an autonomous working environment backed by the moral support of like-minded peers. This is a highly collaborative, supportive environment.

VERSENT VALUES AND BEHAVIOURS

  • People: We believe in a positive team with family spirit, because life is to short for anything else.
  • Customer: We create remarkable experiences for customers and treat them as you would wish to be treated.
  • Quality: Be Artisans who care for their craft and lead change through continuous improvement.
  • Reliability: Do what we say we will do when we say we will do it, every time.
  • Transparency: Full disclosure, integrity and honesty in all things.
  • Reciprocate: Give back and assist as much as possible, whenever possible.

Role

Data Engineer