Data Engineer

Hawthorn East Temporary Work from Home or Hybrid View Job Description
We're seeking a Data Engineer skilled in Azure and PySpark to design and maintain scalable data systems and pipelines. You'll implement real-time data streaming with Spark and collaborate with teams to support data needs and integrate new technologies.
  • Innovative Projects: Lead the development of scalable data solutions
  • Flexible Work: Hybrid work model with occasional office visits in Melbourne

About Our Client

Our client is a retail giant in Australia who provide fresh produce, general merchandise, liquor and fuel to millions of customers. With over 2,200 locations nationwide and over 100,000 employees they have a reputation for excellence in their industry. The team culture is fantastic with a customer driven approach and a focus on goals and values. They are looking for someone in this role who can hit the ground running and add value to their highly motivated team.

Job Description

Job Description
We are seeking a highly skilled and experienced Data Engineer to join our dynamic team. The ideal candidate will have a broad experience in data engineering, particularly in Azure and PySpark-based data engineering applications.
Key Responsibilities
1. Design, construct, install, test and maintain highly scalable data management systems.
2. Develop and implement data pipelines in Azure Data Factory (ADF).
3. Implement complex, scalable, and robust architecture to support real-time data streaming using Spark.
4. Work closely with data science and engineering teams to provide direct and indirect data-related support.
5. Ensure systems meet business requirements and industry practices.
6. Integrate up-and-coming data management and software engineering technologies into existing data structures.
7. Develop set processes for data mining, data modelling, and data production.
8. Create custom software components and analytics applications.
9. Research new uses for existing data.

The Successful Applicant

  • Experience: strong experience in data engineering with a strong track record in Azure and PySpark applications.
  • Technical Skills: Proficient in designing and maintaining scalable data systems, developing data pipelines with Azure Data Factory, and implementing real-time streaming with Spark.
  • Problem-Solving: Excellent analytical and troubleshooting skills, with the ability to optimize data processes and integrate new technologies.
  • Collaboration: Proven ability to work effectively with data science and engineering teams to meet data requirements and support business needs.
  • Adaptability: Experience with emerging data management technologies and a knack for developing innovative solutions.
  • Communication: Strong communication skills to clearly articulate technical concepts and collaborate with cross-functional teams.



What's on Offer

  • Flexible Work Arrangements: Enjoy a hybrid work model with the flexibility to work from home and occasional office visits in Melbourne.
  • Competitive Rate: Up to $1,100/day incl. super for a 6-month contract.
  • Career Development: Opportunity to work on high-impact projects and advance your career in a leading data-centric role.
  • Inclusive Culture: A commitment to a diverse and inclusive workplace with ongoing DEI initiatives.
  • On-site cafe
  • Fitness club facilities



Contact
Divya Khangura
Quote job ref
JN-092024-6527774
Phone number
+61386166236

Job summary

Function
Information Technology
Specialisation
Data Warehousing
What is your industry?
Retail
Location
Hawthorn East
Job Type
Temporary
Consultant name
Divya Khangura
Consultant phone
+61386166236
Job Reference
JN-092024-6527774
Work from Home
Work from Home or Hybrid

Diversity & Inclusion at Michael Page

We don't just accept difference - we celebrate it. We encourage applicants from all backgrounds to apply for this role and are committed to building inclusive, diverse workplaces where everyone can thrive. If you require any support or reasonable adjustments during the recruitment process, please let us know. PageGroup acknowledge and pay our respects to the Traditional Custodians of the land we operate on.