Southfield, MI, USA
1 day ago
Data Pipeline Engineer

Overview:

This role is for the Data team in the ADAS/AD org. We manage the data collected by all Lucid cars. Our primary role is to enable the teams to train & refine their AI/ML models; and our scope extends to on-car programming, frontend, backend, data-pipelines, ML models, dashboards, and analytics.

Roles and responsibilities:

Devise, develop, and maintain Autonomous Driving data processing pipelines on the AWS cloud, Kubernetes clusters, and on-prem servers. Develop scalable microservices following industry standards and deploy on K8s cluster. Add support for logging, testing, and alarms to ensure maintainability. Work with structured data. Adopt the OLAP and OLTP databases that suite your application. Cleanup, parse, process, store, and dashboard unstructured data recorded from on-board vehicle sensors (e.g. Camera, Lidar, RADAR, GPS, and other timeseries data). Help us optimize the data storage, search, and data processing based on a diverse mix of storage solutions, caching techniques, and big data frameworks. Work with multiple cross-domain teams (e.g. Data Collection, Machine Learning, testing engineers, 3rd party data-annotation vendors etc.). Create or modify software solutions that fit their needs.

Qualifications:

Bachelor’s degree in Computer Science or related. 5 years of related experience or 3 years experience with masters degree. Ability to architect and deliver the software solutions from loosely described technical and non-technical requirements. Proficiency in Python and/or Golang. Experience working with Relational database, preferably PostgreSQL. Professional experience with AWS cloud and deploying to Kubernetes cluster. Experience with developing parallel-processing software, containerized applications, and backend microservices.

Preferred:

Ownership mindset with a proactive attitude Experience in building efficient and scalable distributed systems capable of handling many terabytes of data per day. Previous experience in the Autonomous Driving industry, specifically read/write/use the sensor data.
Confirm your E-mail: Send Email