Hi

• Role: Big Data Engineer (SE/SSE/TL)
• Reports to: Development Manager

• Responsibilities Deliverables:

This person would be responsible for design, development and deployment of platform components.

Job Description:

As a Big data engineer you will be responsible for

• Design and development of low-latency, highly-performance data analytics applications
• Collaborate with peer engineers and architects on various technical projects to maintain and enhance data analytics solutions
• Participate in code and design review of different application modules
• Write and run comprehensive integration tests to deliver high-quality products
• Capacity planning and specification of resource requirements for different deployment scenarios
• Trouble-shoot and provide fix for any production bug in timely manner
• Gather feedback from stakeholders for improvement in code-stack and feature-sets
• Assist documentation team in providing good customer documentation, support and deployment guides
• Adopt agile practice to track and update status of assigned tasks/stories

Educational Qualification:

• BE. / B.Tech., M.E./M. Tech. or M. Sc. in Computer Science or any related field.

Skill Set:

• Hands on programming experience in Java is must.

• Candidate should have practical knowledge of object-oriented programming concepts, data structures, algorithms, multithreading, collections, concepts of garbage collection.
• Conceptual understanding of Big Data concepts, relevant experience of minimum 2 years on Big Data Technologies- HDFS, s3, Spark, Spark Streaming, Kafka, Hive, Cassandra, etc is required.
• Expertise in performance tuning and resource optimization techniques of spark Broadcasting, Salting, Bucketing, Partitioning, Caching, Checkpointing.
• Hands-on experience with spark streaming, Data Frames and SQL API.
• Well familiar with data-warehousing concepts, data modelling, metadata management, data lineage etc is desirable.
• Some exposure to UI technologies is good to have.
• Well familiar with distributed systems, scalable architecture and parallel computing.
• Exposure to relational database like Oracle MySQL is must.
• Good understanding of source code maintenance tools and CI/CD (Continuous integration/continuous Development) pipelines.

Work Experience:

• 4-10 years of experience in Data platform and analytics application development

Location: Bangalore