Commonwealth Bank
Data Engineer - Data Operations
To empower our people and the communities in which we work and making sustainable, transparent and balanced business decisions.
Data and analytics
Full-time
Office | Sydney, NSW, Australia
Visa sponsorship · No
Senior · A role for someone with advanced knowledge and skills. May involve mentoring, leading others or specialisation. Typically at least 5 years of experience.
·
Why Commonwealth Bank
We really love working here, and we think you will too. Diversity, flexibility and innovation are just some of the reasons why our people come to work every day.
Our team includes around 45,000 people from all walks of life, with different goals, experiences, and perspectives. At CommBank we’ll encourage and support you to be yourself. This is a place where you can feel confident expressing who you really are; where you belong because of your uniqueness.
About the role
Do work that matters To us, data is everything. It powers our cutting-edge features and enables us to provide seamless experiences for millions of customers from app to branch. We are one of Australia’s most advanced big data operations teams, doing work that matters. Here, you’ll be part of a team of engineers transitioning from existing technology stacks into cloud-based, future-ready technologies and agile, DevSecOps ways of working.
See yourself in our team We’re responsible for CommBank’s key analytics capabilities and work to create world-leading capabilities for analytics, information management, and decisioning. We work across the Group Data Warehouse, Hadoop Big Data Platform, Pega Decisioning, SAS, R, Tableau, Ab Initio, and Data Stage.
We’re interested in hearing from people who
- Have solid hands-on experience in building ETL applications and commendable production support experience in deploying and managing large-scale, complex big data applications on a Hadoop platform
- Strong knowledge of data governance areas such as data lineage, technical metadata, data quality, and reconciliation
- Pride themselves on their Big Data and Hadoop expertise and experience with focus on Spark, Hive, Abinitio (or other query engines), big data storage formats (such as Parquet, ORC, Avro) and data pipeline orchestration tools like Airflow
- Are confident with Spark SQL, with proven ability in tuning and optimisation
- Are knowledge and have proven hands-on experience in implementing data integration tools (such as Abinitio, DataStage or Informatica) and data warehouses
- Pride themselves on their AWS Experience - any or all of EC2, S3, RDS, EMR
- Strong Data Architecture expertise including different data modelling techniques
- Are constantly communicating with a variety of technical and non-technical stakeholders
- Are confident in production support with a passion for providing data-driven platform solutions
- Are constantly ahead of trends and work at the forefront of Big Data platforms
- Pride themselves on their execution of state-of-the-art ITIL practices, driving high-quality outcomes to solve core business objectives and minimising risks
- Possess problem-solving abilities with a strategic approach to tackling data-related challenges
Tech skills: We use a broad range of tools, languages, and frameworks. We don’t expect you to know them all but experience or exposure with some of these (or equivalents) will set you up for success in this team
- Building and supporting Data pipelines using Bigdata Hadoop
- Strong scripting knowledge in Unix, SQL
- AWS EMR, GLUE
- Streaming frameworks such as Kafka
- Optimisation of Bigdata ETL Pipelines
What you'll be responsible for
- 🧩
Data Cleaning and Preparation
Extract and clean data ready to use in analysis or to users
- 📶
Data Analysis and Reporting
Analyze data to discover and communicate insights, and offer concrete recommendations for key stakeholders to make critical decisions
- 📊
Data Management and Visualization
Create and maintain the organization’s Business Intelligence tools, and present complex data in simple, visual ways for key stakeholders
Skills you'll need
- 🤓
Learning agility
Identifies and applies strategies to enhance reception, retention and use of newly acquired information, skills, and abilities
- 🧮
Numerical problem solving
Works with numerical information and performs mathematical calculations to solve problems
- 🔍
Attention to detail
Accurately identifies and rectifies discrepancies or errors that exists in information and deliverables
Meet the team
