Kforce has a client in Madison, WI that is seeking a Data Engineer who will play a crucial role in designing, implementing, and maintaining our data infrastructure. The Data Engineer will work with cutting-edge AWS technologies to build robust and scalable data pipelines, ensuring the integrity, quality, and availability of our data. Responsibilities: * Create and optimize ETL (Extract, Transform, Load) processes using AWS services such as Glue, S3, Lambda and Data Pipelines * Develop scalable data architectures that support our microservice-based data ecosystem * Utilize Terraform for infrastructure as code (IaC) to set up and manage resources * Implement best practices in data modeling, ensuring efficient data structures * Use PySpark and Python scripting for data transformation and enrichment * Work with Glue crawlers to discover and catalog data sources * Build and maintain Lambda functions for serverless data processing * Leverage Glue jobs for data transformation and orchestration * Utilize Glue catalog for metadata management * Implement logging, monitoring, and alerting using AWS CloudWatch and other relevant tools * Work with Delta Lake and Databricks for advanced analytics and data processing * Query data stored in S3 data lakes using AWS Athena * Interface with business stakeholders to gather requirements and deliver complete reporting solutions * Collaborate with cross-functional teams to ensure data consistency and accuracy * Stay updated with industry trends and emerging technologies related to data engineering * Identify opportunities for process optimization and automation