Bangalore
5 days ago
Associate Data Architect II

Additional Comments:

We are seeking an experienced Apache NiFi Architect to lead the design, development, and optimization of data workflows and integration processes across our organization. The ideal candidate will have extensive experience in data flow automation, system integration, and architecture, particularly within the Apache NiFi framework. This role will collaborate with cross-functional teams to design scalable data solutions, improve operational efficiency, and ensure high performance and data security. Key Responsibilities: Data Architecture & Design: Architect, design, and implement scalable data flows and ETL processes using Apache NiFi to meet business requirements. Define the data architecture and establish standards, best practices, and governance for NiFi workflows. Collaborate with data engineers, architects, and business stakeholders to understand and address data integration needs. Apache NiFi Administration: Configure, administer, and optimize NiFi clusters, processors, controllers, and templates for efficient data flow and processing. Monitor and maintain NiFi environments, ensuring high availability, scalability, and optimal performance. Design and implement robust security policies within NiFi to protect data in motion, including encryption, authentication, and access control. Integration & Workflow Development: Develop and maintain complex data ingestion, transformation, and extraction workflows that integrate data from various sources and systems. Optimize data flow pipelines, troubleshoot performance issues, and resolve data bottlenecks. Leverage NiFi’s advanced features (e.g., parameter contexts, version control, clustering) to enhance data processing efficiency and maintainability. Performance Tuning & Troubleshooting: Perform regular performance tuning of data workflows and monitor logs for potential issues. Analyze and optimize NiFi workflows for improved throughput, resource usage, and latency. Provide guidance and best practices for building reliable and efficient data pipelines. Documentation & Collaboration: Document all data workflows, architecture design, and configuration settings in accordance with organizational standards. Mentor and train team members on NiFi usage, best practices, and troubleshooting techniques. Collaborate with IT and security teams to ensure compliance with data governance and security policies. Experience: 5+ years of experience in data engineering or data architecture, with 3+ years specifically in Apache NiFi. Technical Skills: Expertise in Apache NiFi, including hands-on experience with flow development, configuration, and administration. Strong knowledge of data integration principles, ETL/ELT processes, and streaming data architectures. Proficiency in data formats (JSON, XML, Avro, Parquet) and data transport protocols (HTTP, FTP, Kafka, MQTT, etc.). Experience with cloud platforms (e.g., AWS, Azure, GCP) and cloud-based NiFi deployment. Solid understanding of relational and NoSQL databases, with the ability to integrate them into data workflows. Soft Skills: Strong problem-solving and analytical skills. Excellent communication skills for effective collaboration with technical and non-technical stakeholders. Detail-oriented, with a commitment to building high-quality and maintainable solutions.

Confirm your E-mail: Send Email