Bangalore, India
2 days ago
Principal Consultant- Data Engineer (Snowflake Python/Pyspark)

Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000 people across 30 countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people – we serve and transform leading enterprises, including the Fortune Global 500, with our deep business and industry knowledge, digital operations services, and expertise in data, technology, and AI.

Inviting applications for the role of Principal Consultant- Data Engineer (Snowflake Python/Pyspark)
In this role, the Snowflake Data Engineer is responsible for providing technical direction and lead a group of one or more developer to address a goal.


Job Description:
• Experience in IT industry
• Working experience with building productionized data ingestion and processing data pipelines in Snowflake
• Fully well-versed with data warehousing concepts.
• Expertise and excellent understanding of Snowflake features and integration of Snowflake with other data processing.
• Able to create the data pipeline for ETL by using Snowflake or Python
• Should have experience on Python programming and Pyspark for data analysis.
• Hands on experience in configuration, troubleshooting, testing and managing data platforms, on premises or in the cloud.
• Awareness on data visualisation tools and methodologies
• Work independently on business problems and generate meaningful insights.
• Snowflake SnowPro Core Certification is must.
• Python certification will be added an advantage but it’s good to have.
• Excellent presentation and communication skills, both written and verbal Ability to problem solve and architect in an environment with unclear requirements.


Roles and Responsibilities:
• Able to work on requirement gathering, analysis, designing, development, and deployment.
• Writing SQL queries against Snowflake, developing scripts to do Extract, Load, and Transform data.
• Good understanding on Data Warehouse concepts and Snowflake Architecture
• Hands-on experience with Snowflake utilities such as SnowSQL, SnowPipe, bulk copy, Snowpark, tables, Tasks, Streams, Time travel, Cloning, Optimizer, Metadata Manager, data sharing, stored procedures and UDFs, Snowsight.
• Should have good experience in Python/Pyspark.integration with Snowflake and cloud (AWS/Azure) with ability to leverage cloud services for data processing and storage.
• Proficiency in Python programming language, including knowledge of packages like pandas, NumPy etc , data types, variables, functions, loops, conditionals, and other Python-specific concepts.
• Knowledge of ETL (Extract, Transform, Load) processes and tools, and ability to design and develop efficient ETL jobs using Python/Pyspark.
• Ability to use Python and Pyspark for data cleaning, pre-processing, and transformation tasks, including handling missing values, outliers, and other data quality issues.
• Should have experience building data ingestion pipeline.
• Should have good experience in implementing CDC or SCD type 2
• Good to have exp with Airflow or other workflow management tools for scheduling and managing ETL jobs.
• Good to have experience in repository tools like Github/Gitlab, Azure repo


Qualifications we seek in you
Minimum qualifications

• B.E./ Masters in Computer Science, Information technology, or Computer engineering or any equivalent degree with good IT experience and relevant years of working experience as Snowflake Sr. Data Engineer.
• Skill Matrix:

• Snowflake, Python/Pysprak, AWS/Azure, ETL concepts, Airflow or any orchestration tools, Data Warehousing concepts

Genpact is an Equal Opportunity Employer and considers applicants for all positions without regard to race, color, religion or belief, sex, age, national origin, citizenship status, marital status, military/veteran status, genetic information, sexual orientation, gender identity, physical or mental disability or any other characteristic protected by applicable laws. Genpact is committed to creating a dynamic work environment that values diversity and inclusion, respect and integrity, customer focus, and innovation. Get to know us at genpact.com and on LinkedIn, X, YouTube, and Facebook.
Furthermore, please do note that Genpact does not charge fees to process job applications and applicants are not required to pay to participate in our hiring process in any other way. Examples of such scams include purchasing a 'starter kit,' paying to apply, or purchasing equipment or training.

Confirm your E-mail: Send Email
All Jobs from Genpact