Maryland Heights, MO, USA
15 days ago
Data Engineer
Kforce is seeking a Data Engineer for a large enterprise client. This position will report to the St. Louis or Denver office working 4 days a week in office, 1 day remote. Overview: We are seeking a highly skilled and motivated Data Engineer to join our growing team. This role will focus on leveraging cutting-edge technologies to design and build scalable data solutions. The ideal candidate will have a strong background in cloud-driven environments, big data frameworks, and real-time data streaming technologies. Responsibilities: * Design, develop, and deploy Spark pipelines from scratch using Scala * Migrate and process data to the cloud, predominantly on AWS * Implement and optimize batch processing and real-time streaming solutions, transitioning to a fully real-time environment in AWS * Utilize Apache Kafka (or AWS Kinesis) for real-time data streaming * Work with AWS EMR for large-scale data processing * Develop and manage databases using DynamoDB and other big data tools such as Hive and HBase * Write and optimize SQL queries, including CTEs (Common Table Expressions) and window functions * Collaborate with cross-functional teams to ensure seamless data integration and delivery
Confirm your E-mail: Send Email