Data Engineer

Your new company

You will be working for a technology company that supports a larger business with their data and IT infrastructure. They proudly specialise in advanced technology solutions for critical infrastructure industries across Australia. It is a small group in Brisbane; however, you will also receive support from their offices in different cities across Australia.

Your new role

• Design and execute efficient data pipelines for extracting, transforming, and loading data.
• Develop and uphold data integration and quality processes.
• Collaborate with data scientists, analysts, and stakeholders to meet evolving data needs.
• Implement security measures to safeguard sensitive information.
• Monitor and enhance data system performance, leveraging industry trends and emerging technologies.
• Create and maintain ETL/ELT solutions using both code-based and low-code platforms.
• Design and analyse algorithms for structured and unstructured data, including records, text, images, video, and audio.
• Foster strong relationships and act as a trusted influencer in delivering impactful data-driven solutions.

What you'll need to succeed

Essential Skills and Experience

• Please note that you MUST be an Australian Citizen as NV1 Clearance is needed for this role.

• Must have 5+ years of experience in similar roles, building data transformation pipelines and data products.

• Tools: Must have experience with data bricks for data processing and transformation, along with a strong command of SQL and Python for data analysis and pipeline scripting.

• Must have commercial experience using Databricks (e.g. Databricks workflow, Delta Live Tables (DLT), etc) in a data project.

• Data Product Development: Demonstrated ability to work with customers and business analysts to understand and translate data requirements into actionable data products, supporting needs such as business modelling, visualisation, and machine learning.

• Problem-Solving: Excellent analytical and problem-solving skills, with the ability to troubleshoot complex data issues and deliver scalable solutions.

• Must be competent with Python and SQL, with the ability to diagnose bottlenecks of Python (particularly Pyspark) and/or SQL scripts.

• Exposure to Azure services (e.g. Function/Logic apps, Azure Data Factory, etc) are highly desirable.

Personal Attributes

• Communication: Strong communication skills to interact with technical and non-technical stakeholders, ensuring clear and concise articulation of data requirements and solutions.

• Team Player: Collaborative mindset with the ability to work effectively in a team environment and adapt to changing requirements.

• Attention to Detail: High level of attention to detail to ensure accuracy and reliability in data processing and product development.

What you'll get in return

This company is part of a large construction organisation that will be working on several key projects in the next few years, so you will be kept busy!

As a mid-level engineer, you will also have great lead Data Engineers to learn from.

What you need to do now

If you're interested in this role, click 'apply now' to forward an up-to-date copy of your CV, or call Mounia now.

If this job isn't quite right for you, but you are looking for a new position, please contact us for a confidential discussion on your career.