Durham, NC, USA
12 days ago
Data Engineer
Job Seekers, Please send resumes to resumes@hireitpeople.com

Top Skills:

Python, Database development, AWS

Detailed Job Description:

Experience in building data lake in AWS using technologies like ec2, s3, Lambda, API Gateway, Load Balancers, Auto scaling etc. Expertise in building data ingestion tools using technologies like Python to extract data from Relational Databases/Web Scraping/External APIs Experience in Snowflake or any MPP and columnar database on the Cloud. Experience in CI/CD release automation and deployment (Jenkins, Concourse, CloudFormation etc.) Experience and good understating of databases (Oracle, Netezza) and ETL tools Experience in scheduling tools like Autosys, Control - M, Airflow etc. Excellent programming skills SQL, PL/SQL, Python, shell etc. You enjoy learning new technologies, data analysis, identifying data patterns and trends and you can independently resolve technical challenges. Exposure to Big Data technologies (Hadoop, Spark, Hive, presto etc.) Exposure to streaming services like Kafka will be an advantage Good understanding of overall AWS security services like KMS, IAM, Security groups etc. At least 6 years of software development experience with at least 3 years working on Cloud/Big Data technologies BS in Computer Science or related degree, or equivalent experience
Confirm your E-mail: Send Email