- Hadoop (Hive, knowledge of Pig)
- Communication skills
- Client management - experience
- Team leading / mentoring
- Total experience - 6 to 8 years
- Relevant experience - 3+ years
- 2+ years of experience in the delivery of Hadoop data integration implementations, leading a team size of 10 Hadoop data engineers. Hortonworks experience would be a plus.
Education : Bachelors/Masters in Computer Science or related areas
Job Description :
- Solid Big-Data Technologies hands on working experience
- Strong hands-on experience of programming language like Java/Python/Scala/Spark
- Should be very strong in the fields of Hadoop/MapReduce, HDFS, Hive, Hbase, Kafka, NoSQL Databases
- Working experience with various ETL techniques and frameworks
- Produce ETL design guidelines to ensure a manageable ETL infrastructure
- Hands on working experience in analyzing source system data and data flows, working knowledge of structured and unstructured data.
- Should be very strong in performance-optimized tuning techniques during data processing using Spark and data storage
- Hands on working experience of data processing at scale with event driven systems, message queues (Kafka/Flink/ Spark Streaming)
- Should possess strong experience in the execution of projects with the test-driven development approach in the Agile DevOps environment.
- Should possess strong experience in handling Agile/Scrum based Data Engineering team
working in a development environment designing and maintaining data stores
- Proficient understanding of distributed computing principles
- Hands on working experience on any of the data engineering/ analytics platform (Hortonworks/ Cloudera/ MapR), Hortonworks preferred
- Experience building data pipelines for structured/ unstructured, real-time/batch, events/synchronous/asynchronous using Kafka, Steam processing
- Experience gathering and processing raw data at scale (including writing scripts, calling APIs, write SQL queries, etc.)
- Strong technical, analytical, and problem-solving skills
- Excellent written and verbal communication skills
Salary: Not Disclosed by Recruiter
Industry: IT-Software, Software Services
Role Category:Programming & Design
Employment Type: Full Time, Permanent
UG: Any Graduate - Any Specialization, B.Tech/B.E. - Computers
PG:Any Postgraduate - Any Specialization
Doctorate:Doctorate Not Required
FTD India Pvt. Ltd
8 - 12 yrs Hyderabad
Keyskills: etl architecture, Data Transformation, big, Kafka, Business Objects...
6 - 8 yrs Hyderabad
Keyskills: Jenkins, algorithms, Maven, java, spark, Software Architecture...
Han Digital Solution (P)
6 - 10 yrs Bengaluru, Mumbai, Chenna...
Keyskills: development, technical, software, Social media, developing, Apache, HBase...
Tech Mahindra Ltd
3 - 7 yrs Pune
Keyskills: Cloud computing, Linux, Db2, JSON, Oracle, Teradata, SDLC, Analytics, SQL...
IBM India Pvt. Limited
8 - 12 yrs Pune
Keyskills: Lambda / kappa, data management, Cloudera, Hadoop, Cassandra, Big Data...