Job Seekers, Please send resumes to resumes@hireitpeople.com

Job Seekers, Please send resumes to arun@hireitpeople.com or Call: (202) 719-0200 Ext: 107

Position                        : Big Data Architect (with Kafka)

Location                       : Chandler, AZ

Experience Level         : Minimum 10 years

Project Summary         : Architecture, Design and Proof of Concepts

Project Summary: Architecture, Design and Proof of Concepts.

 

Responsibilities:

Architecture and design of large programsLead the team and take responsibility of overall deliverablesAnalyze, Design, support SIT, UAT, PFIXCreate Proof of Concept/Technology as required

 

Technical Skills - In Detail

Good understanding of Data pipeline including Extraction, acquisition, transformation and visualizationPrior experience working with RBDMS and Big data distributionsExperience with requirements gathering, systems development, systems integration and designing/developing APIExperience with Linux and shell programmingExperience with frameworks like Anaconda and developing ETL using PySpark on any major Big Data distributionsGood understanding of XML processing using Python, Spark RDD and dataframesPerformance tuning, unit testing and integration testingExcellent communication and articulation skillsSelf starter and ability to work in dynamic and agile environmentExperience of working with Hadoop ecosystem – MapReduce, Hive, HBaseExperience of working with at least one NoSQL database like C*, MongoDB

 

ElasticSearch

Experience of designing for scale with considerations like sharding.Experience of various types of queries  – structured, proximity, relevance and query DSLData modelling with various hierarchies – Nested, Parent-child and schemaUnderstanding of ES analyzers and their use

Kafka

Experience in design Kafka topics, partitioning and topic hierarchiesExperience of various Kafka consumers and Kafka-SQL

 

Experience Level: Minimum 10 years