Search Jobs

Project/ Tech Lead - Data Engineering

6 - 8 yrs
Apply without registration
Not Disclosed by Recruiter Openings: 1 Posted 30+ days ago Job Applicants: 51 Job Views: 231

Job Description

 
Send me Jobs like this

    Primary Skills

    - Spark

    - Hadoop (Hive, knowledge of Pig)

    - SQL

    - Kafka

    Secondary Skills

    - Python

    - Java

    - ML

    Behavioural Skills

    - Communication skills

    - Client management - experience

    - Maturity

    - Team leading / mentoring

    Experience:

    - Total experience - 6 to 8 years

    - Relevant experience - 3+ years

    - 2+ years of experience in the delivery of Hadoop data integration implementations, leading a team size of 10 Hadoop data engineers. Hortonworks experience would be a plus.

    Education : Bachelors/Masters in Computer Science or related areas

    Job Description :

    - Solid Big-Data Technologies hands on working experience

    - Strong hands-on experience of programming language like Java/Python/Scala/Spark

    - Should be very strong in the fields of Hadoop/MapReduce, HDFS, Hive, Hbase, Kafka, NoSQL Databases

    - Working experience with various ETL techniques and frameworks

    - Produce ETL design guidelines to ensure a manageable ETL infrastructure

    - Hands on working experience in analyzing source system data and data flows, working knowledge of structured and unstructured data.

    - Should be very strong in performance-optimized tuning techniques during data processing using Spark and data storage

    - Hands on working experience of data processing at scale with event driven systems, message queues (Kafka/Flink/ Spark Streaming)

    - Should possess strong experience in the execution of projects with the test-driven development approach in the Agile DevOps environment.

    - Should possess strong experience in handling Agile/Scrum based Data Engineering team

    working in a development environment designing and maintaining data stores

    - Proficient understanding of distributed computing principles

    - Hands on working experience on any of the data engineering/ analytics platform (Hortonworks/ Cloudera/ MapR), Hortonworks preferred

    - Experience building data pipelines for structured/ unstructured, real-time/batch, events/synchronous/asynchronous using Kafka, Steam processing

    - Experience gathering and processing raw data at scale (including writing scripts, calling APIs, write SQL queries, etc.)

    - Strong technical, analytical, and problem-solving skills

    - Excellent written and verbal communication skills

Salary: Not Disclosed by Recruiter

Industry: IT-Software, Software Services

Functional Area: IT Software - Application Programming , Maintenance

Role Category:Programming & Design

Role:Project Lead

Employment Type: Full Time, Permanent

Keyskills

Education-

UG: Any Graduate - Any Specialization, B.Tech/B.E. - Computers

PG:Any Postgraduate - Any Specialization

Doctorate:Doctorate Not Required

Company Profile:

Okda Solutions

Leading Client
View Contact Details
Apply without registration

IEIL has taken all reasonable steps to ensure that information on this site is authentic. Applicants are advised to research bonafides of advertisers independently. IEIL shall not have any responsibility in this regard. We also recommend that you visit Security Guidelines and Terms and Conditions for more comprehensive information on this aspect.

Get Better Jobs & Higher Salaries. Suggested courses

-or-
Max 2MB, doc, docx, rtf, pdf
We will create your profile