Pune, IND
4 days ago
Lead Data Engineer - Vice President
**Job Summary:** We are seeking a skilled and experienced **Data Engineer** to join our team. The ideal candidate will have expertise in **Snowflake** or **Big Data platforms** and a strong background in **RDBMS skills** like **Oracle PL/SQL** . You will be responsible for designing, developing, and maintaining data pipelines, ensuring data quality, and optimizing database and data platform performance. This role requires a deep understanding of modern data engineering workflows, ETL processes, and database systems. **Key Responsibilities:** **Data Engineering** : + Design, develop, and maintain scalable and efficient data pipelines to support business needs. + Implement ETL/ELT processes to extract, transform, and load data from various sources into Snowflake, Big Data platforms, or RDBMS systems. + Optimize data workflows for performance, scalability, and reliability. **Snowflake or Big Data Platforms** : + **For Snowflake** : + Design and implement data models in Snowflake to support analytical and reporting needs. + Develop and optimize Snowflake queries, stored procedures, and user-defined functions. + Manage Snowflake data sharing, security, and access control. + **For Big Data Platforms** : + Work with Big Data technologies such as Hadoop, Spark, Hive, or HDFS to process and analyze large datasets. + Develop distributed data processing pipelines using Spark (PySpark) + Optimize Big Data workflows for performance and scalability. **RDBMS Skills (Oracle PL/SQL)** : + Write, debug, and optimize complex PL/SQL scripts, stored procedures, functions, and triggers. + Perform database performance tuning, query optimization, and troubleshooting in Oracle. + Design and implement database objects such as tables, views, indexes, and constraints. **Data Integration** : + Integrate data from multiple sources, including APIs, flat files, and third-party systems. + Collaborate with data analysts, data scientists, and business teams to understand data requirements. **Data Quality and Governance** : + Ensure data accuracy, consistency, and integrity across systems. + Implement data validation and error-handling mechanisms. **Collaboration and Documentation** : + Work closely with cross-functional teams to understand business requirements and translate them into technical solutions. + Document data pipelines, database designs, and processes for future reference. **Required Skills and Qualifications:** + **Technical Expertise** : + Expertise in **Snowflake** or **Big Data platforms** : + **Snowflake** : Hands-on experience with Snowflake data warehousing, data modeling, and query optimization. + **Big Data Platforms** : Experience with Hadoop, Spark (PySpark), Hive, or HDFS for distributed data processing. + Strong experience in **RDBMS skills** , particularly **Oracle PL/SQL** , including stored procedures, functions, triggers, and performance tuning. + Proficiency in SQL and database design principles. + Experience with ETL/ELT tools + **Programming Skills** : + Proficiency in scripting languages such as **Python and Shell scripting** for data processing and automation. + **Data Governance** : + Knowledge of data quality, data governance, and data security best practices. + **Soft Skills** : + Strong problem-solving and analytical skills. + Excellent communication and collaboration skills. + Ability to work in a fast-paced, dynamic environment. **Preferred Qualifications:** + Experience with **data visualization tools** (e.g., Tableau, Power BI). + Knowledge of **CI/CD pipelines** for database deployments or Big Data workflows. + Familiarity with **real-time data processing** tools (e.g., Kafka, Flink, or Storm). + Certification in Snowflake, Oracle databases, or Big Data technologies is a plus. + Knowledge of NO SQL ( either Mongo or Neo4J ) **Education:** + Bachelor’s degree/University degree or equivalent experience + Master’s degree preferred This job description provides a high-level review of the types of work performed. Other job-related duties may be assigned as required. ------------------------------------------------------ **Job Family Group:** Technology ------------------------------------------------------ **Job Family:** Applications Development ------------------------------------------------------ **Time Type:** Full time ------------------------------------------------------ **Most Relevant Skills** Please see the requirements listed above. ------------------------------------------------------ **Other Relevant Skills** For complementary skills, please see above and/or contact the recruiter. ------------------------------------------------------ _Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law._ _If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review_ _Accessibility at Citi (https://www.citigroup.com/citi/accessibility/application-accessibility.htm)_ _._ _View Citi’s_ _EEO Policy Statement (https://www.citigroup.com/global/eeo-aa-policy)_ _and the_ _Know Your Rights (https://www.eeoc.gov/sites/default/files/2023-06/22-088\_EEOC\_KnowYourRights6.12ScreenRdr.pdf)_ _poster._ Citi is an equal opportunity and affirmative action employer. Minority/Female/Veteran/Individuals with Disabilities/Sexual Orientation/Gender Identity.
Confirm your E-mail: Send Email
All Jobs from Citigroup