Senior Data Engineer

Techknowledgey Pte Ltd
2 - 12 Years
Not Specified

Job Description

Job description:

  • Developing the architecture and infrastructure to ensure optimal ETL of data from a pool of various sources while using SQL.
  • Collaborating closely with key stakeholders, external vendors and internal analytics team to design and develop enhanced functionalities.
  • Conducting continuous optimization, this includes to monitor and track data flows to establish pipelines for architecture purposes.
  • Conducting extensive data reconciliations while ensuring optimal accuracy in data.
Job requirements:
  • Experienced in Python development
  • Proficient in SQL, Shell Scripting or another languages
  • Experience working with AWS ecosystem and distributed systems
  • Experience with building real-time stream-processing systems
  • Knowledge of NoSQL databases
  • 4+ years of experience with data modelling and designing / supporting Data
  • Warehouses
  • 2+ years of experience in data processing / ETL implementation
Preferred Technology
Spray, Hadoop, Kibana, Elastic Search, Yarn, Mesos, Kafka, Redis, Scala, Python,
Cassandra, Postgres, Spark, OpenStack, Logstash, Couchbase, Vertica, Grafana, Go

"Using technology to find technologists"

HackerTrail is a curated marketplace exclusively for IT talent ranging from developers to infrastructure specialists to data scientists. Using clever technology and gamification, HackerTrail connects the right candidate to the right job opportunities with top companies across Southeast Asia.

About Recruiter



Functions : IT

Industries : Other

Skills/Roles I hire for: Developers

level Hiring For: Junior Level, Mid Level, High Level, Top Management

People Also Considered

Career Advice to Find Better