Jul 22, 2019

Senior Data Engineer - Multiple Roles

  • Versent
  • Melbourne VIC, Australia
Full time Data Engineer Back End Software Engineer

Job Description

DESCRIPTION

Versent is a rapidly growing services, product and platform company that works exclusively on AWS. We have offices in Sydney, Melbourne, Brisbane, Perth, Denver and Singapore and have grown to over 350 people in just five years! We are the Australian AWS Consulting partner for the Year for the 3rd time and recently became a Snowflake and Talend Partner.

We believe in bringing craftsmanship back to technology, because as technology artisans, we passionately care about the quality outcomes we leave behind.

We have some of the best techs in Australia and due to client demand, we're looking to expand our data team with a number of Senior Data Engineer(s).

Our Data Engineers know their craft, and know it well. We will also need you to have the right soft skills to listen to and understand other ideas, plus know and see the patterns from your experience across a variation of complex implementations.

Our Senior Data Engineers have been around the block a few times and have some battle scars from building data pipelines in the cloud in an automated fashion. They will have worked in larger teams and understand the Corporate Wheel of Death (Risk, Security, Governance, Finance, etc…) and have worked through these issues before.

The above and beyond skill set of the Senior Engineer is the ability to bring the customer on a journey, helping them understand they aren’t the first to build a scalable, reliable and auditable big data pipeline, to sit with them and help get things over the line and to help win “hearts and minds” across customers internally where Cloud or Big Data analytics are still a foreign term or used in name but not in practice.

REQUIREMENTS

Our Senior Data Engineers exhibit the following behaviours;

  • Ability to lead change with customers
  • Focus on delivery and outcomes
  • Delivery sprint tasks within the sprint
  • Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
  • Continually strive toward optimal extraction, transformation, loading and management of data from a wide variety of data sources using SQL and AWS ‘big data’ technologies
  • Has the experience to authentically tell the customer when something is an anti-pattern or will fail
  • Can design Data Patterns for re-use and re-implementation (factory based approach)
  • Workshops and agree technical approaches with team members and customers
  • Can work in an enterprise-type environment and demonstrate the expected controls and processes adherence.
  • Understand traditional and emerging data pipeline delivery as well as CI and CD processes
  • Lead and mentor Data engineers

People wanting to become Senior Data Engineers at Versent have the following skills;

  • From a development or operations background (or an existing DataOps Team)
  • Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
  • Experience building and optimizing ‘big data’ data pipelines, architectures and data sets.
  • Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
  • Strong analytic skills related to working with unstructured datasets.
  • Build processes supporting data transformation, data structures, metadata, dependency and workload management.
  • A successful history of manipulating, processing and extracting value from large disconnected datasets.
  • Working knowledge of message queuing, stream processing, and highly scalable ‘big data’ data stores
  • Have experience with the AWS ecosystem (particularity Kinesis, Glue, Redshift, EMR, RDS, Aurora, DMS, etc…)
  • Have exposure to the broader Hadoop and broader data warehouse ecosystems (Cloudera, Hortonworks, Exadata, Greenplum, Terradata, SAP Hana etc)
  • Have some experience with industry leading ETL tools, Informatica, Talend, Snowflake
  • Familiar with data modelling concepts
  • Familiar with end user analytic tools such as SAS, Tableau, etc
  • Can demonstrate what discipline looks like in the AWS ecosystem
  • Advanced experience in one or many of the following programming languages – SQL, Python, Java, SCALA etc

Example Tasks for a Senior Data Engineer;

  • Participating in agile rituals (stand ups, planning sessions, retros, etc...)
  • Working on stories and tasks
  • Conducting Code Reviews (PR's or Pair Programming)
  • Conduct and Participate in Technical Spikes
  • Take Ownership of their card moving to "done, done" which may include some ETL and Data Pipeline development, Infrastructure provisioning, DataOps, Security

BENEFITS

At the core of what we do, we're an engineering company. We value our people more than commercials and put culture at the centre of everything.

We do weekly internal tech meetups with food and drinks, host game nights, organise Hackathons, pay for your AWS training and certifications, and other relevant certs (if it's something you want to do).

We have many social events, often supporting charity initiatives such as TourXOz and RUOK Day. We also have family functions such as lawn bowls, company picnics etc. We have a paid parental leave program.

We embrace the notion of Versent as a Family, working together to achieve outstanding success.

We have flexible working hours and a culture based on respect, trust and collaboration.

WHY WE'RE DIFFERENT

You know, work doesn't have to feel like work. In fact, we don't want it to. That's why we've cultivated an environment based on creativity. Because when people who care about their craft are given the freedom to explore possibilities without restriction, amazing things can happen.

OUR CULTURE

No cool cliques, just hard-working humans generating ideas and devising solutions in a creative, collaborative work space. Professional but not corporate, we believe success is achieved through strong leadership (without interference from middle-management) and an autonomous working environment backed by the moral support of like-minded peers. This is a highly collaborative, supportive environment.

VERSENT VALUES AND BEHAVIOURS

  • People: We believe in a positive team with family spirit, because life is to short for anything else.
  • Customer: We create remarkable experiences for customers and treat them as you would wish to be treated.
  • Quality: Be Artisans who care for their craft and lead change through continuous improvement.
  • Reliability: Do what we say we will do when we say we will do it, every time.
  • Transparency: Full disclosure, integrity and honesty in all things.
  • Reciprocate: Give back and assist as much as possible, whenever possible.

Role

Data Engineer