Search Jobs

Big Data Developer - Hadop/mapreduce

5 - 10 yrs
Apply without registration
Not Disclosed by Recruiter Openings: 1 Posted 30+ days ago Job Applicants: 58 Job Views: 217

Job Description

 
Send me Jobs like this
    must have Hadoop- Hive- Pig - Java

    Part of a team 5 developers -

    - Design and develop ETL data flows using Hive / Pig / Unix scripts/ Talend jobs

    Loading from disparate data sets.

    - Pre-processing using Hive / Pig / python/ Unix scripting.

    - Design & implement work flow jobs using Talend & Unix / Linux scripting to perform ETL on Hadoop platform.

    Translate complex functional and technical requirements into detailed design.

    - Perform analysis of data sets and uncover insights.

    - Maintain security and data privacy.

    - Propose best practices/standards.

    - Work with the System Analyst and development manager on a day-to-day basis

    - Work with other team members to accomplish key development tasks

    - Work with service delivery (support) team on transition and stabilization

    Responsibilities

    We are looking for a Sr. Big Data Developer for large-scale, high-speed, and low-latency data solutions in the areas of:

    - Large scale data manipulation / ETL .

    - Mentor junior developers in SDLC process.

    - Long-term data storage / data warehousing.

    - Low-latency retrieval systems, i.e. real-time reporting and analytics Data applications - visualization, BI, dashboards, ad-hoc analytics .

    - The primary focus will be on choosing optimal solutions to use for these purposes, then maintaining, implementing, and monitoring them.

    - Responsible for integrating the optimal solutions with the architecture used across the company.

    - Individual should have expertise and at least 5 years of hands-on experience with either distributed system such as Java / Python or any ETL tools as developer required .

    Help shape and augment team s continuous delivery capabilities and utilize DevOps best practices to improve delivery automation, collaboration, and efficiency.

    - 10+ years of hands-on experience in developing data solutions .

    - Expert-level skills and experience in Hadoop Map-Reduce .

    - 4+ years Expert-level skills and experience in Hive .

    - Experience with HBase, Talend, NoSQL databases-Experience Apache Spark or other streaming big data processing preferred.

    - Good skills and experience in Linux, Java, XML, JSON, REST .

    - Understanding of database internals and data warehouse implementation techniques; working knowledge of SQL

    - Knowledge of data structures and algorithms .

    - Solid understanding of data structures & common algorithms Understanding of time-complexity of algorithms .

    - Implementation and design of distributed systems.

    - Programming and language skills

    - Strong in Java and PIG .

    - Understanding and experience with UNIX and Shell scripting .

    - System design and implementation experience .

    - Familiar with fault tolerance system design and high performance engineering .

    - Fundamental concepts of scheduling, synchronization, IPC and memory management

    - Familiarity with information retrieval techniques is preferred .

    - Able to work well in extremely fast paced and entrepreneurial environments Independent self-starter who is highly focused and results oriented .

    - Strong analytical and problem solving skills.

    What skills/attributes are a must have-

    - Expert-level skills and experience in Hadoop Map-Reduce .

    - Expert-level skills and experience in Hive .

    - Programming and language skills

    - Strong in Java and PIG .

    - Good experience with UNIX and Shell scripting .

    What skills/attributes are nice to have :

    - Experience with HBase, Talend, NoSQL databases-Experience Apache Spark or other streaming big data processing preferred.

    - Previous experience with Insurance industry.

Salary: Not Disclosed by Recruiter

Industry: IT-Software, Software Services

Functional Area: IT Software - DBA , Datawarehousing

Role Category:Programming & Design

Role:Software Developer

Employment Type: Full Time, Permanent

Keyskills

Education-

UG: B.Tech/B.E. - Any Specialization

PG:Any Postgraduate - Any Specialization

Company Profile:

Career Infosystem

Leading client of Softtech Career Infosystem Pvt. Ltd
View Contact Details
Apply without registration

IEIL has taken all reasonable steps to ensure that information on this site is authentic. Applicants are advised to research bonafides of advertisers independently. IEIL shall not have any responsibility in this regard. We also recommend that you visit Security Guidelines and Terms and Conditions for more comprehensive information on this aspect.

Get Better Jobs & Higher Salaries. Suggested courses

I agree to the Terms and Conditions