Madison, WI, 53786, USA
4 days ago
Big Data Engineer
**Job ID Number** R4169 **Employment Type** Full time **Worksite Flexibility** Remote **Job Summary** We are looking for a motivated Big Data Engineer ready to take us to the next level! If you have a strong understanding of SaaS, IaaS, PaaS implementations, ETL/ELT Processes, and experience with data factory and databricks and are looking for your next career move, apply now. **Job Description** The **Big Data Engineer** is a vital member of a collaborative team, responsible for designing, engineering, maintaining, testing, evaluating, and implementing big data infrastructure, tools, projects, and solutions for the client. This role involves working closely with the team to leverage cutting-edge database technologies for the swift retrieval of results from vast datasets. The engineer will select and integrate big data frameworks and tools to meet specific needs and manage the entire lifecycle of large datasets to extract valuable insights. This will be a full-time **contract position and fully remote.** **What You’ll Do** + Design and implement scalable big data solutions tailored to client's needs + Maintain and enhance existing big data infrastructures to meet unique requirements + Test and evaluate new big data technologies and frameworks for compatibility with systems and goals + Collect, store, process, manage, analyze, and visualize large datasets to derive actionable insights + Collaborate with team members to integrate big data solutions with existing systems + Ensure data integrity and security across all platforms used within the client + Develop and optimize data pipelines for ETL/ELT processes specific to data needs + Document technical solutions and maintain comprehensive records in line with standards and protocols + Stay updated with the latest trends and advancements in big data technology relevant to strategic initiatives **What You'll Need** **Required** : + Thorough understanding of cloud computing technologies, including IaaS, PaaS, and SaaS implementations + Skilled in exploratory data analysis (EDA) to support ETL/ELT processes + Proficiency with Microsoft cloud products, including Azure and Fabric + Experience with tools such as Data Factory and Databricks + Ability to script in multiple languages, with a strong emphasis on Python and SQL **Preferred:** + Experience with data visualization tools + Proficiency with Excel and Power BI + Familiarity with Delta Lake + Knowledge of Lakehouse Medallion Architecture **Physical Demands** + Ability to safely and successfully perform the essential job functions consistent with the ADA and other federal, state, and local standards + Sedentary work that involves sitting or remaining stationary most of the time with occasional need to move around the office to attend meetings, etc. + Ability to conduct repetitive tasks on a computer, utilizing a mouse, keyboard, and monitor \#LI-KW1 **Reasonable Accommodation Statement** If you require a reasonable accommodation in completing this application, interviewing, completing any pre-employment testing, or otherwise participating in the employment selection process, please direct your inquiries to application.accommodations@cai.io or (888) 824 – 8111. **Equal Employment Opportunity Policy Statement** It is the policy of CAI not to discriminate against any employee or applicant due to race, color, religion, sex, sexual orientation, gender identity, national origin, age, marital status, genetic information, disability or being a protected veteran. It is also the policy of CAI to take affirmative action to employ and to advance in employment, all persons regardless of race, color, religion, sex, sexual orientation, gender identity, national origin, age, marital status, genetic information, disability or being a protected veteran, and to base all employment decisions only on valid job requirements. This policy shall apply to all employment actions, including but not limited to recruitment, hiring, upgrading, promotion, transfer, demotion, layoff, recall, termination, rates of pay or other forms of compensation and selection for training, including apprenticeship, at all levels of employment. Employees and applicants of CAI will not be subject to harassment due to race, color, religion, sex, sexual orientation, gender identity, national origin, age, marital status, genetic information, disability or being a protected veteran. Additionally, retaliation, including intimidation, threats, or coercion, because an employee or applicant has objected to discrimination, engaged or may engage in filing a complaint, assisted in a review, investigation, or hearing or have otherwise sought to obtain their legal rights under any Federal, State, or local EEO law is prohibited.
Confirm your E-mail: Send Email