JD – Data Engineer

Tools & Technologies

Primary: Python, SPSS , SQL (via DBeaver, SSMS) Others: AWS S3, Visual Studio Code

Key Responsibilities

Survey Data Management:Download completed survey data in SPSS format post-fieldwork closure.Execute SPSS syntax as required before initiating data processing.Data Preparation & Processing:Prepare Ad List files provided by the research team prior to data processing.Upload all relevant files into designated AWS S3 project folders.Develop and execute project-specific Python scripts to process data and ingest it into the database.Run update configurations post-processing to refresh dashboards and ensure unique IDs are correctly updated.Workflow Management:Manage separate workflows for media uploads using Python.Collaborate with Project Managers (PM) and Research Executives (RE) for custom updates, data QC, and dashboard pipeline setup.Data Engineering & Quality Control:Work closely with engineering teams to establish new dashboard data pipelines.Ensure data integrity and compliance with MR standards, including norms, data stacking, and weighting methodologies.

Required Skills & Qualifications

Technical Expertise:Strong proficiency in Python for data processing and automation.Experience with SPSS for survey data handling and syntax execution.Solid understanding of SQL for database operations.Familiarity with AWS S3 for file management and cloud workflows.Domain Knowledge:Background in Market Research data processing, including norms, data stacking, and weighting methodologies.Understanding of dashboard refresh logic and unique ID management.Soft Skills:Excellent problem-solving and analytical skills.Ability to collaborate effectively with cross-functional teams.Strong attention to detail and commitment to data quality.