Talend Developer / Data Engineer

Talend Developer / Data Engineer

Optimum Solutions (Singapore) Pte Ltd
2-7 years
Not Specified

Job Description

What is the opportunity

The data engineer will work closely with the business users, project managers, technical teams like database engineers and source system data owners to develop data pipelines to automate data acquisition and cleansing, to sustain analytics and AI initiatives.
The role requires the ability to translate business and technical requirements into data interfaces, data transformation jobs and design data models that powers self-service analytics or AI projects. To support this, you may also need to establish data management processes such as data governance, data cataloguing, security/privacy classification and advise our clients on the collection, storage and consumption of information in their organisations.
What will you do

• Design and implement relevant data models in the form of data marts stored in Operational Data Stores, Data Warehouses or Big Data platforms
• Build data pipelines to bring information from source systems, harmonise and cleanse data to support analytics initiatives for core business metrics and performance trends.
• Perform data profiling to understand data quality and advise practical measures to address such data issues through data transformation and data loading
• Dive into company data to identify sources and features that will drive business objectives.
• Work closely with project manager and technical leads to provide regular status reporting and support them to refine issues/problem statements and propose/evaluate relevant analytics solutions
• Bring your experience and ideas to effective and innovative engineering, design and strategy
• Work in interdisciplinary teams that combine technical, business and data science competencies that deliver work in waterfall or agile software development lifecycle methodologies
• The range of accountability, responsibility and autonomy will depend on your experience and seniority, including:
• Contributing to our internal networks and special interest groups
• Mentoring to upskill peers and juniors
The ideal candidate:

• Undergraduate or graduate degree in Computer science or equivalent
• Possesses implementation experience in using Talend software for ETL (Extract-Transform-Load)
• At least 2 to 5 years of hands on ETL experience using Talend / Big Data Platforms
• At least 2 to 3 years of java development experience with the ability to use java tools to perform data injection into Big Data Platforms
• Strong knowledge of data manipulation languages such as SQL and other DB technologies necessary to build and maintain complex queries and data pipelines
• Experience in handling APIs using Talend
• Knowledge of Talend ESB and AWS (S3, RDS-SQL Server and other services)
• Practical appreciation of data quality metrics and remediation strategies
• Data modelling and architecting skills including strong foundation in data warehousing concepts, data normalisation, and dimensional data modelling such as OLAP
• Experience with other aspects of data management such as data governance, metadata management, archival, data lifecycle management
• Processing of semi-structured and unstructured data sets such as NoSQL, graph and Hadoop based data storage technologies such as MongoDB, Cassandra, HBase, Hortonworks/Cloudera, Elastic Search and Neo4j using Spark, Splunk or Apache Nifi for batch or streaming data
• Large scale data loading experience moving enterprise or operational data from source systems to new applications or data analytics solutions
• Experience in leveraging on cloud-based data analytics platform such as:
o AWS serverless architecture in Lambda on AWS DynamoDB, EMR Redshit
o Azure Data Factory or SQL Data Warehouse
o GCP BigQuery/BigTable, Cloud Dataprep/Dataflow/Dataproc
• Possess good communications skills to understand our customers core business objectives and build end-to-end data centric solutions to address them
• Good critical thinking and problem-solving abilities
Mandatory Skill:

• Talend Data Integration

Job Details

Optimum Solutions, is a full spectrum Software Solutions and a Managed Services Company. The services from Optimum are designed to deliver Enterprise Client-Server/ Multi-tier and Web based solutions across the entire value chain, spanning on-site consulting services to turnkey software projects. Opportunities abound when you work @ Optimum, a World-Class Software Solutions and Service Provider. Our client list includes major Fortune 500 organizations. Our customers are primarily from Banking and Finance, Manufacturing, Distribution, Technology, Service and Healthcare verticals.

We have got over 2200 plus consultants working with us and have developed into a rapidly growing, highly competitive and responsive firm with strong management, technical and financial resources and commitment to fully serve its clients in Singapore, USA, China, Malaysia, Philippines and India. Professional Services - Since 1997, we have been providing IT consulting professionals to major national and local firms, Fortune 500, software integrator and software development companies, and major national and local consulting firms. Managed Services group focuses on the comprehensive services on a managed mode- where the responsibility of delivery and Service Levels are undertaken by Optimum for providing a strong value to the customers. This Service enables organizations to optimize overheads and realign focus of their internal resource towards core competency and value addition aresas of the organization. Software Applications & Services provides a wide range of services and turnkey solutions that run gamut from short-term focused services to long-term comprehensive, leading-edge solutions. The scope covers the end-to-end application platforms from legacy domains to web based applications.

Product & Services
Information Technology and Services

About Recruiter




Active jobs

Functions : IT

Industries : IT/Computers - Hardware & Networking, IT/Computers - Software

Skills/Roles I hire for: Application, Infra, Java, .NET, BA

level Hiring For: Junior Level, Mid Level, High Level

Similar Jobs

Career Advice to Find Better

Simple body text this will replace with orginal content