Data Engineer
- Employer
- Rio Tinto
- Location
- Singapore, SG, Singapore
- Salary
- Competitive
- Posted
- Sep 25, 2020
- Closes
- Oct 06, 2020
- Ref
- 1223064862
- Category
- Computer etc., Engineering
- Work Term
- Permanent
- Work Load
- Full Time
- Language
- English
Data Engineer
· Build a complex data ingestion pipeline using modern technologies
· Work with a product team of passionate engineers
· Contribute meaningfully to the outcome of the customer
About the role
We're looking for an experienced Data Engineer to build the data and feature engineering pipelines powering the next generation of products at Rio Tinto. Data engineers at Rio Tinto interact with the product managers and internal customers to understand the data landscape and more importantly, how to acquire the data for the product.
You'll work within the Commercial Product Team which is accountable for delivering value to business groups within Rio Tinto Commercial. The team does this by using modern techniques, tooling and behaviors to deliver software as quickly as possible. You'll be asked to learn new things quickly and accomplish a wide range of tasks, all focused on using modern technology to build scalable, robust data ingestion and staging pipelines. We understand that narrow and well-defined job responsibilities are good for some people. If you are one of those people, this role may not be right for you.
· Come ready to do the best work of your life and influence your team to do the same
· Own all aspects of your code (e.g. architecture, documentation, bug fixes, deployments)
· Sit directly with the commercial business to explore source data and help define required transformations
· Work closely with your product team to implement feature engineering where required
· Recommend, justify and implement changes to the AWS infrastructure as required
· Set the standard for disciplined software engineering (e.g. automated testing, continuous integration and deployment, code reviews and writing high quality, well documented code)
· Own the data pipeline, working with owners of source data to continuously improve
· Communicate closely with users and the product manager to prioritize and implement new features of the product
· Champion good agile practices that provide a foundation for iterative product development
About you
To be successfully considered for this role, you will have:
· A technical background in computer science, data science, machine learning, statistics or other quantitative and computational science
· A compelling track record of designing and deploying large scale technical solutions, which deliver tangible, ongoing value (and ability to show work)
· Professional experience writing high-quality Python code with expert level knowledge of Numpy, Scipy, Pandas and PySpark/Spark SQL
· Professional experience working with relational database technologies (e.g. Athena, PostreSQL) with expert level knowledge of SQL
· Professional experience designing, building and maintaining data ingestion pipelines
· Professional experience working within teams to collectively build and deploy high quality code using the tools of the trade (e.g. Git, Slack)
· Professional experience with cloud native architectures, design and tools with specific focus on AWS services ECS, Docker, Glue, S3, Lambda and RDS
· Experience using Git at the command line and Github on the web
It would also be beneficial if you have:
· Ability to context-switch, to provide support to dispersed teams which may need an "expert hacker" to unblock an especially challenging technical obstacle
· An "engineering" mindset, willing to make rapid, pragmatic decisions to improve performance, accelerate progress or magnify impact; recognizing that the "good" is not the enemy of the "perfect"
· Strong willingness to learn and grow in a startup-like environment
· Experience working in a product company
· Comfortable with devops and infrastructure technologies such as Terraform and CircleCI
We're looking for a passionate, team oriented, experienced engineer who's self-motivated and loves technology. We expect you to do the best work of your life and influence those around you to do the same. We value humility and intellectual honesty in our engineers. In return, you have an incredible opportunity to enjoy the freedom and responsibility of a startup-like environment within a large, successful corporate enterprise.
About us
As pioneers in mining and metals, we produce materials essential to human progress.
Our long history is filled with firsts. We've developed some of the world's largest and best quality mines and operations, and our people work in around 35 countries across six continents. Aluminium and copper, diamonds, gold and industrial minerals, iron ore, coal and uranium: our materials make up the world around us. You'll find then in smartphones, planes, cars, hospitals and throughout your home.
The Commercial group is focused on maximising the value of our products; growing value in the marketplace through partnership with the company's customers, suppliers, product groups and Group functions. Headquartered in Singapore, and integrated with Rio Tinto's assets, hubs, and offices globally, Commercial's purpose is to provide the commercial insights to drive value along the mine-to-market value chain. Commercial incorporates and utilises the knowledge and capabilities of the global Sales & Marketing, Procurement, and Marine & Logistics organisations, supported by the Market Analysis, Commercial Treasury and other functions, to ensure our approach to business is driven by a commercially-astute and innovative mind-set.
Creating an inclusive and diverse workforce
We are a diverse team of talented, enthusiastic individuals who foster a culture of inclusion. No matter how they may differ, our people share one thing in common. It's a belief that work is more rewarding when we are accepted and valued for our differences, not judged by them. We all have something to contribute, and it's this contribution that makes for a great organization and fulfilling career.
Application Deadline: 10/10/2020
Our process involves a set of pre-screening questions, a short introductory call with the hiring manager, a technical challenge and several face-to-face interviews focusing on the results of your challenge and background. We strive to be efficient and complete the entire interview process in four weeks.
· Build a complex data ingestion pipeline using modern technologies
· Work with a product team of passionate engineers
· Contribute meaningfully to the outcome of the customer
About the role
We're looking for an experienced Data Engineer to build the data and feature engineering pipelines powering the next generation of products at Rio Tinto. Data engineers at Rio Tinto interact with the product managers and internal customers to understand the data landscape and more importantly, how to acquire the data for the product.
You'll work within the Commercial Product Team which is accountable for delivering value to business groups within Rio Tinto Commercial. The team does this by using modern techniques, tooling and behaviors to deliver software as quickly as possible. You'll be asked to learn new things quickly and accomplish a wide range of tasks, all focused on using modern technology to build scalable, robust data ingestion and staging pipelines. We understand that narrow and well-defined job responsibilities are good for some people. If you are one of those people, this role may not be right for you.
· Come ready to do the best work of your life and influence your team to do the same
· Own all aspects of your code (e.g. architecture, documentation, bug fixes, deployments)
· Sit directly with the commercial business to explore source data and help define required transformations
· Work closely with your product team to implement feature engineering where required
· Recommend, justify and implement changes to the AWS infrastructure as required
· Set the standard for disciplined software engineering (e.g. automated testing, continuous integration and deployment, code reviews and writing high quality, well documented code)
· Own the data pipeline, working with owners of source data to continuously improve
· Communicate closely with users and the product manager to prioritize and implement new features of the product
· Champion good agile practices that provide a foundation for iterative product development
About you
To be successfully considered for this role, you will have:
· A technical background in computer science, data science, machine learning, statistics or other quantitative and computational science
· A compelling track record of designing and deploying large scale technical solutions, which deliver tangible, ongoing value (and ability to show work)
· Professional experience writing high-quality Python code with expert level knowledge of Numpy, Scipy, Pandas and PySpark/Spark SQL
· Professional experience working with relational database technologies (e.g. Athena, PostreSQL) with expert level knowledge of SQL
· Professional experience designing, building and maintaining data ingestion pipelines
· Professional experience working within teams to collectively build and deploy high quality code using the tools of the trade (e.g. Git, Slack)
· Professional experience with cloud native architectures, design and tools with specific focus on AWS services ECS, Docker, Glue, S3, Lambda and RDS
· Experience using Git at the command line and Github on the web
It would also be beneficial if you have:
· Ability to context-switch, to provide support to dispersed teams which may need an "expert hacker" to unblock an especially challenging technical obstacle
· An "engineering" mindset, willing to make rapid, pragmatic decisions to improve performance, accelerate progress or magnify impact; recognizing that the "good" is not the enemy of the "perfect"
· Strong willingness to learn and grow in a startup-like environment
· Experience working in a product company
· Comfortable with devops and infrastructure technologies such as Terraform and CircleCI
We're looking for a passionate, team oriented, experienced engineer who's self-motivated and loves technology. We expect you to do the best work of your life and influence those around you to do the same. We value humility and intellectual honesty in our engineers. In return, you have an incredible opportunity to enjoy the freedom and responsibility of a startup-like environment within a large, successful corporate enterprise.
About us
As pioneers in mining and metals, we produce materials essential to human progress.
Our long history is filled with firsts. We've developed some of the world's largest and best quality mines and operations, and our people work in around 35 countries across six continents. Aluminium and copper, diamonds, gold and industrial minerals, iron ore, coal and uranium: our materials make up the world around us. You'll find then in smartphones, planes, cars, hospitals and throughout your home.
The Commercial group is focused on maximising the value of our products; growing value in the marketplace through partnership with the company's customers, suppliers, product groups and Group functions. Headquartered in Singapore, and integrated with Rio Tinto's assets, hubs, and offices globally, Commercial's purpose is to provide the commercial insights to drive value along the mine-to-market value chain. Commercial incorporates and utilises the knowledge and capabilities of the global Sales & Marketing, Procurement, and Marine & Logistics organisations, supported by the Market Analysis, Commercial Treasury and other functions, to ensure our approach to business is driven by a commercially-astute and innovative mind-set.
Creating an inclusive and diverse workforce
We are a diverse team of talented, enthusiastic individuals who foster a culture of inclusion. No matter how they may differ, our people share one thing in common. It's a belief that work is more rewarding when we are accepted and valued for our differences, not judged by them. We all have something to contribute, and it's this contribution that makes for a great organization and fulfilling career.
Application Deadline: 10/10/2020
Our process involves a set of pre-screening questions, a short introductory call with the hiring manager, a technical challenge and several face-to-face interviews focusing on the results of your challenge and background. We strive to be efficient and complete the entire interview process in four weeks.