Send me more jobs like this

Sorry, This job is expired.

Senior Big Data Engineer

Keywords / Skills : Big Data, Big Data Engineer, Big Data Developer, Big Data Consultant, Big Data Hadoop, hadoop, Hive, Spark, SCALA, Sqoop, Java, Spring, Informatica, NoSQL, RDBMS, Data Warehouse, MDM, Master data management, Hbase, ETL, ETL Informatica

4 - 14 years
Posted: 2018-11-14

Job Description
Connect
  • We are looking for a Big Data Engineer who will be accountable for big data implementation capabilities of Singtel Data & Analytics within Group IT by designing and implementing big data solutions in a distributed system. This includes developing architecture solutions for varied latency needs like batch, real-time, near-real-time and on-demand APIs. 
  • You will be have the opportunity to enable a machine learning environment for advanced analytics, and ensure proposed solutions are aligned and conformed to the big data architecture guidelines and roadmap. 
Grow
  • You will design, develop and maintain data pipelines, with a focus on writing scalable, clean, and fault-tolerant code to handle disparate data sources, process large volume of structured / unstructured data from various sources. 
  • You will also further hone your skills driving optimization, testing and tooling to improve data quality, as well documenting and communicating technical complexities completely and clearly to team members and other key stakeholders. 
Impact
  • Your ability to work closely with our data scientist team to gather data requirements to support modelling, and understand business requirements and solution designs to develop and implement solutions that adhere to big data architectural guidelines and address business requirements ensures your work creates the highest impact for our customers and Singtel. 
  • You are excited by opportunities to provide guidance and consultation on other projects in active development as well as support and maintain previously implemented big data projects to foster a data-centric culture to drive business decisions. 
Requirements
  • Degree qualified in Business management, IT, Computer Systems, software or computer engineering fields or equivalent. 
  • Minimum 6 years of experience in data warehousing / big data environments. 
  • Experience in relational & dimensional data modelling and performance tuning of enterprise warehouses / big data environments. 
  • Experience with big data processing (Spark experience preferred) 
  • Experience in designing and developing data models, integrating data from multiple sources, building ETL pipelines, and other data wrangling tools in big data environments 
  • Understanding of structured and unstructured data design/modeling 
  • Experience using software engineering best practices in programming, testing, version control, agile development, etc. 

Technical competency:
  • Hadoop / Big Data knowledge and experience 
  • Design & Development based on Hadoop platform and it’s components 
  • Big Data Platform based on Cloudera on Hadoop 
  • Informatica Big Data Management 
  • Python / Spark / Scala / Java 
  • HIVE / HBase / Impala / Parquet 
  • Sqoop, Kafka, Flume 
  • SQL 
  • Relational Database Management System (RDBMS) 
  • NOSQL database 
  • Data warehouse platforms or equivalent 

Essential skill set:
  • Highly organized, self-motivated, pro-active, and able to plan. 
  • Ability to analyze and understand complex problems. 
  • Ability to explain technical information in business terms. 
  • Ability to communicate clearly and effectively, both verbally and in writing. 
  • Strong in User Requirements Gathering, Maintenance and Support. 
  • Good experience managing users and vendors. 
  • Agile Methodology 
  • Data Architecture, Data Modeling of BI Applications / Data Warehouse / Big Data


About Company

"Using technology to find technologists"

HackerTrail is a curated marketplace exclusively for IT talent ranging from developers to infrastructure specialists to data scientists. Using clever technology and gamification, HackerTrail connects the right candidate to the right job opportunities with top companies across Southeast Asia.


Walkin for you