Send me more jobs like this

Sorry, This job is expired.

Senior Data Engineer

Keywords / Skills : Hadoop, Python, AWS, SQL, Database Architect, Data Processing, Data Structures

2 - 12 years
Posted: 2019-03-18

Job Description
Job description:
  • Developing the architecture and infrastructure to ensure optimal ETL of data from a pool of various sources while using SQL.
  • Collaborating closely with key stakeholders, external vendors and internal analytics team to design and develop enhanced functionalities.
  • Conducting continuous optimization, this includes to monitor and track data flows to establish pipelines for architecture purposes.
  • Conducting extensive data reconciliations while ensuring optimal accuracy in data.
Job requirements:
  • Experienced in Python development
  • Proficient in SQL, Shell Scripting or another languages
  • Experience working with AWS ecosystem and distributed systems
  • Experience with building real-time stream-processing systems
  • Knowledge of NoSQL databases
  • 4+ years of experience with data modelling and designing / supporting Data
  • Warehouses
  • 2+ years of experience in data processing / ETL implementation
Preferred Technology
Spray, Hadoop, Kibana, Elastic Search, Yarn, Mesos, Kafka, Redis, Scala, Python,
Cassandra, Postgres, Spark, OpenStack, Logstash, Couchbase, Vertica, Grafana, Go


About Company

"Using technology to find technologists"

HackerTrail is a curated marketplace exclusively for IT talent ranging from developers to infrastructure specialists to data scientists. Using clever technology and gamification, HackerTrail connects the right candidate to the right job opportunities with top companies across Southeast Asia.


Walkin for you