Send me more jobs like this

Data Engineer (1 year contract)

Keywords / Skills : Data Engineer (1 year contract)

Posted: 2019-03-14

Industry
Insurance
Function
IT
Role
Software Engineer/ Programmer
Posted On
14th Mar 2019
Job Ref code
510370200
Job Description
Job Description :

Key Responsibilities
As a member of the Data analytics team you will be required to leverage strong data engineering experience with cutting edge technologies in the relational, unstructured and cloud ecosystem and data lake/warehouse spaces to support and enable a true data driven company. The ideal candidate will have a track record of developing data pipelines to extract, transform and aggregate data that can scale to petabytes, elastically, with low latency and high availability

Key Requirements
  • A background in Computer Science, Engineering, Mathematics or Statistics.
  • Experience building complex data pipelines for data integration from enterprise wide applications/systems into centralised big data lakes/warehouses
  • Experience and understanding of distributed database technologies/concepts. Strong knowledge in SQL and bash scripting.
  • Experience integrating real-time data streaming including Spark and Kafka
  • Strong analytical competencies with the ability to turn requests from Business Intelligence and Data Analyst personnel into efficient and scalable data transformations
  • A proficient Python/Java programmer
  • Experience building and enforcing strong data quality guarantees and anomaly detection into data pipelines

Good to have
  • Experience in Azure cloud and their suite of product offerings.
  • Knowledge of database internals and optimizations.
  • Knowledge of optimised data storage and serialisation formats
  • Fundamental data science knowledge and experience


Similar Jobs
View All Similar Jobs


Walkin for you