Send me more jobs like this

Big Data Developer (Spark Streaming)

Keywords / Skills : Spark Streaming, Hadoop

4 - 10 years
Posted: 2018-06-13

Banking/ Financial Services
IT/ Computers - Software
Software Engineer/ Programmer
Database Architect
Posted On
13th Jun 2018
Job Description
Main responsibilities
  • Lead technical study into a propose solution, while involving expertise from infrastructure big data expert, business analyst requirement
  • Document proposed design and develop the solution
  • Implicitly ensure all CI-CD artefacts are part of the solution
  • Perform code review while fostering knowledge and coaching best practices to team members
  • Interact and provide reporting to project managers
  • Monitor technical risk and escalate appropriately to management
  • The position requires autonomy and reliability in performing duties with initiatives and leadership when it comes to all non-functional deliverables such as testing tools, mocking objects, production monitoring concerns, quality control including performance and load testing.

Qualifications and Profile
  • At least 5 years in Software development
  • At least 4 years in Java/J2EE development
  • Hands on Data ingest and data processing technology like Spark streaming and Spark
  • Hands on Messaging systems like Kafka, Flume or ActiveMQ, MQSeries or RabitMQ
  • Hands on knowledge on Hadoop (preferably Hortonworks distribution) - HDFS, HBase, Hive, ORC/Parquet.
  • Build tool - Maven/sbt/ant, UML, Restful web services, Jenkins/Team City, Source management – SVN/GIT, TDD using Junit, Jira/QC.

Good to have
  • Solution design using proven patterns, awareness of anti-patterns, performance tuning, especially in streaming
  • Knowledge of tools like Phoenix, ElasticSearch, Sqoop, StreamSets are good to have.
  • Basic understanding of finance and investment banking

Other Professional Skills and Mind-set
  • Excellent written and verbal communication skills for both team mates and management
  • Strong analytical and problem solving skills
  • Proficient software development life cycle
  • Appetite to follow technology trend and participate to communities

We offer a competitive remuneration package, consistent with your qualifications and experience.

Key Skill(s)

About Company

Crédit Agricole Corporate and Investment Banking (CA-CIB) is the CIB arm of Crédit Agricole Group, world’s 11th largest bank by total assets.
Similar Jobs
View All Similar Jobs

Walkin for you