MS Fabric / ADF architects Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you’d like, where you’ll be supported and inspired by a collaborative community of colleagues around the world, and where you’ll be able to reimagine what’s possible. Join us and help the world’s leading organizations unlock the value of technology and build a more sustainable, more inclusive world. **Job Location : Newark NJ (Hybrid)** **Key Responsibilities** + Deep expertise in modern data architecture, with specific experience in Microsoft's data platform and Delta Lake architecture. + 10+ years of experience in data architecture and engineering. + Required 2+ years hands-on experience with Azure Databricks / ADF and Spark. + Required recent experience with Microsoft Fabric platform. **Required Skills** **Data Architecture:** + Design end-to-end data architecture leveraging Microsoft Fabric's capabilities. + Design data flows within the Microsoft Fabric environment. + Implement OneLake storage strategies. + Configure Synapse Analytics workspaces. + Establish Power BI integration patterns. **Integration Design:** + Architect data integration patterns with analytics using Azure Data Factory and Microsoft Fabric. + Implement medallion architecture (Bronze/Silver/Gold layers). + Ability to configure real-time data ingestion patterns. + Establish data quality frameworks. **Lakehouse Architecture:** + Implement modern data lakehouse architecture using Delta Lake, ensuring data reliability and performance. **Data Governance:** + Establish data governance frameworks incorporating Microsoft Purview for data quality, lineage, and compliance. **Microsoft Fabric Expertise:** + Data Integration: Combining and cleansing data from various sources. + Data Pipeline Management: Creating, orchestrating, and troubleshooting data pipelines. + Analytics Reporting: Building and delivering detailed reports and dashboards to derive meaningful insights from large datasets. + Data Visualization Techniques: Representing data graphically in impactful and informative ways. + Optimization and Security: Optimizing queries, improving performance, and securing data **Azure Databricks Experience:** + Apache Spark Proficiency: Utilizing Spark for large-scale data processing and analytics. + Data Engineering: Building and managing data pipelines, including ETL (Extract, Transform, Load) processes. + Delta Lake: Implementing Delta Lake for data versioning, ACID transactions, and schema enforcement. + Cluster Management: Configuring and managing Databricks clusters for optimized performance. (Ex: autoscaling and automatic termination) + Integration with Azure Services: Integrating Databricks with other Azure services like Azure Data Lake, Azure SQL Database, and Azure Synapse Analytics. + Data Governance: Implementing data governance practices using Unity Catalog and Microsoft Purview **Security Framework:** + Design and implement security patterns aligned with federal and state requirements for sensitive data handling. **Implement row-level security.** + Configure Microsoft Purview policies. + Establish data masking for sensitive information. + Design audit logging mechanisms. **Pipeline Development:** + Design scalable data pipelines using Azure Databricks for ETL/ELT processes and real-time data integration. **Performance Optimization:** + Implement performance tuning strategies for large-scale data processing and analytics workloads. + Optimize Spark configurations. + Implement partitioning strategies. + Design caching mechanisms. + Establish monitoring frameworks. **Life At Capgemini** Capgemini supports all aspects of your well-being throughout the changing stages of your life and career. For eligible employees, we offer: + Flexible work + Healthcare including dental, vision, mental health, and well-being programs + Financial well-being programs such as 401(k) and Employee Share Ownership Plan + Paid time off and paid holidays + Paid parental leave + Family building benefits like adoption assistance, surrogacy, and cryopreservation + Social well-being benefits like subsidized back-up child/elder care and tutoring + Mentoring, coaching and learning programs + Employee Resource Groups + Disaster Relief **Disclaimer** Capgemini is an Equal Opportunity Employer encouraging diversity in the workplace. All qualified applicants will receive consideration for employment without regard to race, national origin, gender identity/expression, age, religion, disability, sexual orientation, genetics, veteran status, marital status or any other characteristic protected by law. This is a general description of the Duties, Responsibilities and Qualifications required for this position. Physical, mental, sensory or environmental demands may be referenced in an attempt to communicate the manner in which this position traditionally is performed. Whenever necessary to provide individuals with disabilities an equal employment opportunity, Capgemini will consider reasonable accommodations that might involve varying job requirements and/or changing the way this job is performed, provided that such accommodations do not pose an undue hardship. Capgemini is committed to providing reasonable accommodations during our recruitment process. If you need assistance or accommodation, please reach out to your recruiting contact. Click the following link for more information on your rights as an Applicant http://www.capgemini.com/resources/equal-employment-opportunity-is-the-law Capgemini is a global business and technology transformation partner, helping organizations to accelerate their dual transition to a digital and sustainable world, while creating tangible impact for enterprises and society. It is a responsible and diverse group of 340,000 team members in more than 50 countries. With its strong over 55-year heritage, Capgemini is trusted by its clients to unlock the value of technology to address the entire breadth of their business needs. It delivers end-to-end services and solutions leveraging strengths from strategy and design to engineering, all fuelled by its market leading capabilities in AI, cloud and data, combined with its deep industry expertise and partner ecosystem. The Group reported 2023 global revenues of €22.5 billion. Ref. code: 162195 Posted on: Feb 4, 2025 Experience Level: Experienced Professionals Contract Type: Permanent Location: Bridgewater, US Brand: Capgemini Professional Community: Software Engineering Capgemini is an Equal Opportunity Employer encouraging diversity in the workplace. All qualified applicants will receive consideration for employment without regard to race, national origin, gender identity/expression, age, religion, disability, sexual orientation, genetics, veteran status, marital status or any other characteristic protected by law.