x
Get our mobile app
Fast & easy access to Jobstore
Use App
Congratulations!
You just received a job recommendation!
check it out now
Browse Jobs
Companies
Campus Hiring
Download App
Jobs in Australia   »   Jobs in Melbourne   »   Information Technology Job   »   Data engineer- Melbourne
 banner picture 1  banner picture 2  banner picture 3

Data engineer- Melbourne

Centelon Pty Ltd

Centelon Pty Ltd company logo
Job Description


Hands on experience in Batch (must) and Streaming (preferable) processing on Cloudera data platform tool-stack:
Must have: Hadoop, Spark, HIVE, Oozie and Python/Pyspark as the programming language
Preferable: Scala, Hbase, Java, Shell scripting



Min 3 years of hands-on project experience on Big Data platform – preferable Cloudera/Hortonworks
Min 2 years of Cloud experience – preferable on Azure
Min 2 end to end data lake project delivery experience
A very clear understanding of data warehousing processes, methodologies and supporting capabilities
Be able to propose solutions and clearly articulate pros and cons of various technologies and platforms in the Big Data world
To be able to benchmark systems, analyse system bottlenecks.
To be able to document use cases, solutions, and recommendations.
To have excellent written and verbal communication skills
To be able to perform detailed analysis of business problems and technical environments and use this in designing the solution
To be able to work in teams, as a big data environment is developed in a team of employees with different disciplines
To be able to work in a fast-paced agile development environment.


Job Types: Full-time, Permanent

Salary: $91,383.00 – $164,767.00 per year
✱   This job post has expired   ✱

Sharing is Caring

Know others who would be interested in this job?