AWS-EMR PySpark Hadoop Developers
Kforce
Kforce's client, one of the world's largest financial institutions, is hiring an 6-person scrum team of AWS-EMR PySpark Hadoop Developers in Wilmington (DE), Plano (TX) & New York City (NY). This is an opportunity for quick fulltime employment with Client. Please note Lead, VP Titled, Hands-on Developer will need to be located in Plano, TX (Dallas) and will mentor a team of mobile application and full-stack developers, fostering collaboration and growth.
Responsibilities:
* Design and implement scalable and efficient data pipelines using AWS and Data Lakehouse Platform services
* Leverage AWS cloud services like S3, Kinesis, Redshift, EMR, Glue, Lambda, and others in combination with Data Lakehouse platform/Apache Spark Integration for advanced data processing and analytics
* Develop and maintain data lakes and data warehouses on AWS and Data Lakehouse Platform, ensuring data integrity and accessibility
* Optimize data storage and processing for performance and cost efficiency.
* Automate data workflows and ensure high data quality and reliability
* Monitor, troubleshoot, and resolve data pipeline issues
* Organizing and managing data within the environment, ensuring it is stored efficiently, securely, and in a manner that supports easy access and analysis
* Monitor the performance of data processes and queries and optimize efficiency and speed
* Ensure high standards of data quality and implement data governance practices
* Provide ongoing support for the platform, troubleshoot any issues that arise, and ensure high availability and reliability of data infrastructure
* Create documentation for the platform infrastructure and processes, and train other team members or users on the platform effectively
* Setup configure, implement, and maintain the data lake and respective tools
Confirm your E-mail: Send Email
All Jobs from Kforce