Job Description We are seeking a Senior Data Engineer to join our team and help build scalable, high-performance data solutions. The ideal candidate will have extensive experience in ETL development, data warehousing concepts, AWS cloud services, and Databricks, along with strong programming skills in Python or PySpark. This role requires a hands-on engineer who can design, implement, and optimize data pipelines to support our analytics and business intelligence needs. Key Responsibilities Design, develop, and maintain scalable ETL pipelines to process large datasets efficiently. Implement data warehousing solutions, ensuring performance, reliability, and scalability. Work with AWS services (S3, Glue, Redshift, Lambda, etc.) to develop cloud-based data solutions. Utilize Databricks to optimize data transformations, implement workflows, and improve query performance. Write efficient and maintainable code using Python or PySpark for data ingestion and transformation. Ensure data quality, governance, and security best practices are followed. Collaborate with data scientists, analysts, and software engineers to support data-driven decision-making. Optimize and troubleshoot data workflows for performance and cost efficiency. Automate and schedule data workflows using orchestration tools like Airflow. We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com .     To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ . Skills and Requirements 5+ years of experience in Data Engineering or related roles. Expertise in ETL development and data warehousing concepts (star schema, snowflake schema, indexing, partitioning). Strong experience with AWS (S3, Glue, Redshift, Lambda, Step Functions, etc.). Hands-on experience with Databricks for data processing and optimization. Proficiency in Python or PySpark for data transformations and automation. Strong knowledge of SQL for data extraction and performance tuning. Experience working with structured and semi-structured data formats (Parquet, JSON, Avro, etc.). Understanding of big data technologies like Spark and Delta Lake. Experience with CI/CD for data pipelines and version control (Git). Experience with Airflow, dbt, or other workflow orchestration tools.   Familiarity with machine learning data pipelines and model deployment.   Exposure to real-time data streaming using Kafka or Kinesis. Knowledge of data security and compliance best practices. null We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal employment opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment without regard to race, color, ethnicity, religion,sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military oruniformed service member status, or any other status or characteristic protected by applicable laws, regulations, andordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to HR@insightglobal.com.