Australia and New Zealand
Job Categories

Data Engineer - Data Transformation Project

Melbourne, Sydney

Our Commodities and Global Markets Data Transformation is an exciting program of work as we embark on our journey to build the innovative and future ready Data Platform that will help Macquarie businesses meet customer needs.

As a Big Data Engineer, you will join our dynamic Engineering team developing cutting-edge applications. We are industry pioneers and we actively look for innovative ways to achieve great results, which do speak for themselves:

To be successful in this role, you will have:

  • Data warehousing experience with emphasis on Information management domain
  • Data modelling experience 
  • Linux/Unix skills
  • Prior working experience with AWS - any or all of EC2, S3, EBS, ELB, RDS, Dynamo DB, EMR
  • Solid SQL experience, authoring complex queries and DDL
  • Big data querying tools like Hive, Spark, Presto
  • Working knowledge of Data Pipelines tools like Apache Oozie, LUIGI or Airflow
  • Exposure to working in an Agile environment
  • Proven ability to troubleshoot and resolve production issues under a DevOps model 
  • A track record of continuously identify opportunities to improve the performance and quality of your ecosystem
  • Experience monitoring performance and ensuring infrastructure is appropriately matched to support workload and SLAs
  • A broad knowledge of technical solutions, design patterns, and code for medium/complex applications deployed in clustered computing environment.

Ideally you will also any of the have:

  • Good experience in programming languages like (Scala or Java or Python) in context of Big data technologies like Spark
  • Data Streaming
  • Experience working in environments with Docker, Kubernetes, Openshift
  • Exposure to security concepts and best practices
  • Knowledge of machine learning (E.g. Spark ML or R)
  • Experience with real-time integration (using Kafka, Spark streaming or other technologies)
  • Experience with Flink, Beam
  • Experience with various messaging systems, such as Kafka, RabbitMQ, Solace
  • A critical understanding of Lambda Architecture
  • Experience and knowledge of major Hadoop distribution such as Cloudera, MapR, Hortonworks HDP
  • Good experience with build tools like Maven, Gradle, Ant
  • Working knowledge of API-based integration for modern system

If this role sounds like the right opportunity to further your career, please apply via the link.

About the Corporate Operations Group

The Corporate Operations Group brings together specialist support services in Digital Transformation & Data, Technology, Operations, Human Resources, Business Services, Business Improvement & Strategy, and the Macquarie Group Foundation. We deliver service excellence to ensure Macquarie is open for business, deliver on transformational change, invest in our people and have deep relationships with our customers.

Our commitment to Diversity and Inclusion 

The diversity of our people is one of our greatest strengths, and in combination with our inclusive environment, it enables us to deliver innovative and sustainable outcomes for our people, clients, shareholders and communities. From day one, you'll be encouraged to be yourself and supported to perform at your best. If our purpose of ‘empowering people to innovate and invest for a better future’ is as inspiring to you as it is to us, please apply. With the right technology, support and resources, our people can work in a range of flexible ways.

We are committed to providing a working environment that embraces and values diversity and inclusion. We encourage candidates to speak with a member of our recruitment team if you require adjustments to our recruitment process to support you, and the type of working arrangements that would help you thrive.


About Macquarie

A career at Macquarie means you’ll have the opportunity to develop and utilise new skills, explore interesting fields and do challenging work that will impact the lives of people around the world—whether it’s accelerating the green energy transition, helping sustain global food supplies, financing social housing projects or investing in essential infrastructure. At Macquarie, we’re empowering people to innovate and invest for a better future.

Our size and international presence means your work can take you anywhere—across business groups, disciplines, sectors and borders. With 18,000+ employees and offices in 33 markets around the world, we’re a truly global organisation.

You’ll be supported by a diverse team where the unique perspectives, ideas and experiences that all of our people bring are valued. You’ll be empowered to address unmet needs in our communities whilst advising and investing alongside our clients and partners. Working with us, you’ll have the opportunity to make a difference.

Macquarie is a global financial group providing clients with asset management, retail and business banking, wealth management, leasing and asset financing, market access, commodity trading, renewables development, specialist advisory, capital raising and principal investment.

Find out more at

Job no: CGM-966685
Work type: Permanent - Full time
Location: Melbourne, Sydney
Category: Mid-level, Technology
Group: Corporate Operations Group
Division: Technology
Recruiter: Kymberley Weir
Opening Date: