Send me more jobs like this

Data Engineer

Keywords / Skills : Mysql, MariaDB, AWS, Python, SCALA, Java, Data Analyst, Hadoop

2 - 7 years
Posted: 2018-04-15

Software Engineer/ Programmer
Datawarehousing Consultants
Posted On
15th Apr 2018
Job Description
The role
You will be tasked with the monumental responsibility of shaping firm into a more data-driven team by kickstarting the development of our data warehouse. You will be responsible for firm’s data architecture and will spearhead exciting data projects that will be instrumental in driving the performance of the group.

Main responsibilities
  • Create and maintain optimal data pipeline architecture and warehouse
  • Design, and prototype data processing pipelines that are used for making product decisions
  • Build/Improve and deploy data tools for data analysis
  • Create and expansion of ETL data flows from all data sources i.e. web analytics, e-commerce store, retail POS, ERP etc.
  • Design, construct, install, test and maintain highly scalable data management systems
  • Assemble large, complex data sets that meet functional business requirements
  • Continuously identify, design and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability
  • Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS ‘big data’ technologies
  • Build high-performance catalog algorithms, prototypes, predictive models and proof of concepts
  • Implement web tracking to provide advanced reports on the customers’ experience
  • Integrate new data management technologies and software engineering tools into existing structures
  • Collaborate closely with other functional stakeholders especially BI, Marketing and Management to support in their data infrastructure needs
  • Work closely alongside BI team who will be responsible for the visualizaton and building of reports
You should have
  • A self starter with a strong work ethic and ‘get things done’ attitude
  • A genuine curiosity to know how things work and how to make them better
  • A knack for solving problems in a creative manner
  • Humility and self confidence in being comfortable with the fact that you will be the wizard who will be building the underlying infrastructure, but ultimately always in a supporting role for all other teams
  • Focus and a high attention to detail especially in understanding the intricacies of how and why a data pipeline works as it does
  • Strong project management skills especially with meaty data warehousing projects
  • Strong relationship management and influencing abilities; ability to build strong relationships and trust with internal and external stakeholders
  • Strong project management skills and ability to manage and influence other functional peers

Experience & Preferred Qualifications
  • Highly proficient in MySQL/MariaDB
  • Experience in AWS Redshift
  • Programming proficiency in at least major language such Python/Java/Scala
  • 3+ years of experience in a Data Engineer role with a degree or higher in Computer Science, Electronics or Electrical Engineering, Software Engineering, Information Technology or other related technical disciplines.
  • Experience in building data pipelines using Hadoop, Spark is a big plus
  • Strong project management and organizational skills
  • Experience supporting and working with cross-functional teams in a dynamic environment
  • Able to communicate and collaborate with business stakeholders to understand data requirements and translate them

About Company

"Using technology to find technologists"

HackerTrail is a curated marketplace exclusively for IT talent ranging from developers to infrastructure specialists to data scientists. Using clever technology and gamification, HackerTrail connects the right candidate to the right job opportunities with top companies across Southeast Asia.
Similar Jobs
View All Similar Jobs

Walkin for you