Job Description . A skilled Data and Business Intelligence Solutions Engineer to design, develop, and maintain robust data pipelines and architectures that support seamless data flow and empower decision-making. The ideal candidate will collaborate with analysts and data scientists, ensure data quality, and optimize systems for evolving organizational needs. This role requires expertise in managing large datasets, cloud platforms, and big data technologies while adhering to best practices in security, compliance, and data engineering. Essential Duties and Responsibilities: The essential functions include, but are not limited to the following: Design, develop, and maintain scalable data pipelines to enable seamless data flow into data warehouses. Ensure the reliability and efficiency of data pipelines for real-time, batch and ad hoc data processing. Partner with data analysts and scientists to understand and meet data requirements for analysis and modeling. Translate organization needs into technical data solutions. Build and optimize data architectures for efficient storage and transfer of structured and unstructured data. Implement solutions that enhance data accessibility and performance. Perform data validation and cleansing to ensure accuracy, consistency, and reliability. Establish processes to identify and resolve data discrepancies. Monitor data pipelines and infrastructure for performance and availability. Diagnose and resolve issues promptly to minimize disruption. Adhere to data engineering best practices, including security, compliance, and governance standards. Ensure data systems comply with organizational and government regulatory requirements. Document data processes, workflows, and system designs to maintain a clear knowledge base. Provide regular updates and reports to stakeholders on system performance and improvements. Proactively enhance workflows, infrastructure, and technologies to meet evolving organization needs. Stay up-to-date with advancements in data engineering and big data technologies. Manage large datasets using cloud-based platforms (e.g., AWS, Azure, GCP) and big data tools (e.g., Hadoop, Spark). Optimize costs and performance for cloud-based data solutions. Minimum Qualifications (Knowledge, Skills, and Abilities) Eight (8) years experience in Data Analysis, Business intelligence, or a related role on programs and contracts of similar scope, type, and complexity is required. Takes initiative, detail-oriented, problem solver, willing to ask questions, clear communicator Proven experience in designing and maintaining data pipelines and architectures Hands-on experience with cloud-based platforms and big data technologies Strong background in data validation, cleansing, and quality assurance Proficiency in data processing tools and languages (e.g., SQL, Python, Apache Spark, or Kafka) Experience with ETL tools and processes Strong understanding of data warehousing concepts and platforms (e.g., Snowflake, Redshift, BigQuery) Familiarity with data governance, security, and compliance standards Excellent problem-solving and troubleshooting skills High emotional intelligence and sensitivity Excellent communication, interpersonal, and mentoring skills Able to analyze, think quickly and resolve conflict Able to adapt to a changing environment Skilled at supporting multiple clients at a time Self-motivated, and able to maintain a professional, positive, can-do attitude while staying focused in the middle of distraction AWS Certified Data Analytics Specialty, Google Cloud Data Engineer, or similar certifications Big data or database certifications such as Cloudera or Microsoft Azure Data Engineer Associate Bachelors degree in Computer Science, Data Engineering, Information Systems or related field The pay for this position ranges from $48-55/hr with a conversion salary of $115-120k depending on years of experience. We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com .     To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ . Skills and Requirements - 8 years of experience in data analysis and business intelligence - experience in SQL, Python and Apache - experience with ETL tools and processes null We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal employment opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment without regard to race, color, ethnicity, religion,sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military oruniformed service member status, or any other status or characteristic protected by applicable laws, regulations, andordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to HR@insightglobal.com.