General Motor

General Motor

Senior Data Engineer

Description

This is a Hybrid position within our DBTT Organization. The role will allow employees to work offsite but will also require onsite work based on business needs. The selected candidate will be expected to commute to the innovation center to which they are assigned as their primary GM facility. This position requires an employee to be onsite 2-3 times per week.

The Role:

We are seeking a Senior Data Engineer to join our team and contribute to the E2E (End to End) Data Quality Framework initiative within the FVD (Fix Vehicle Data) domain. The successful candidate will play a crucial role in addressing pain points related to data capture, data quality (completeness, accuracy, and consistency), and data lineage within the OnStar Transformation Fix Vehicle Data initiative. The candidate will work closely with cross- functional teams to ensure the delivery of high-quality vehicle data from the back office to various stages such as Vehicle Communication Services, Vehicle Data Factory, Vehicle External Data Consumption, Telematics 360, and outbound to Azure and customers.

What You'll Do:

  • Focus on addressing data capture issues before data collection and delivery.
  • Provide insights into potential data capture issues and facilitate proactive resolution.
  • Implement DQ rule engine solutions using Spark/Scala in Azure for real- time streaming and micro-batch processing.
  • Evaluate and assess the suitability of the Spark/Scala solution, considering factors such as scalability, ease of implementation.
  • Collaborate with the business partners to analyze their existing solution and enhance it to meet specific needs.
  • Build and maintain monitoring dashboards for tracking latency and ensuring efficient data transformation.
  • Develop a tool to trace data lineage throughout the data pipeline.
  • Enable visibility into source-to-target mapping throughout the data pipeline. .
  • Collaborate with cross-functional teams to ensure effective monitoring and notification mechanisms.
  • Your Skills & Abilities (Required Qualifications):

  • Bachelor's or Master's degree in Computer Science, Software Engineering, or a related field.
  • Strong experience as a Senior Developer with expertise in data quality frameworks and pipeline architectures.
  • Proficiency in programming languages such as Scala, Python, Java and SQL.
  • Hands-on experience with Spark and Scala for real-time streaming and micro-batch processing.
  • Knowledge of data governance, data cataloging, and data lineage concepts.
  • Experience with Azure (preferred) or AWS cloud platform for data processing and storage.
  • Excellent problem-solving skills and the ability to work in a fast-paced, collaborative environment.
  • Strong communication skills to effectively collaborate with cross- functional teams and stakeholders.
  • What Will Give You A Competitive Edge (Preferred Qualifications):

  • Azure Certification: AZ-204 Azure Developer Associate

  • Azure Certification: DP-203 Data Engineer Associate

  • Additional Description

    GM DOES NOT PROVIDE IMMIGRATION-RELATED SPONSORSHIP FOR THIS ROLE. DO NOT APPLY FOR THIS ROLE IF YOU WILL NEED GM IMMIGRATION SPONSORSHIP (e.g., H-1B, TN, STEM OPT, etc.) NOW OR IN THE FUTURE

    About GM

    Our vision is a world with Zero Crashes, Zero Emissions and Zero Congestion and we embrace the responsibility to lead the change that will make our world better, safer and more equitable for all.

    Why Join Us

    We aspire to be the most inclusive company in the world. We believe we all must make a choice every day – individually and collectively – to drive meaningful change through our words, our deeds and our culture. Our Work Appropriately philosophy supports our foundation of inclusion and provides employees the flexibility to work where they can have the greatest impact on achieving our goals, dependent on role needs. Every day, we want every employee, no matter their background, ethnicity, preferences, or location, to feel they belong to one General Motors team.

    Total Rewards Benefits Overview

    From day one, we're looking out for your well-being–at work and at home–so you can focus on realizing your ambitions. Learn how GM supports a rewarding career that rewards you personally by visiting Total Rewards resources.

    Diversity Information

    General Motors is committed to being a workplace that is not only free of discrimination, but one that genuinely fosters inclusion and belonging. We strongly believe that workforce diversity creates an environment in which our employees can thrive and develop better products for our customers. We understand and embrace the variety through which people gain experiences whether through professional, personal, educational, or volunteer opportunities. GM is proud to be an equal opportunity employer.

    We encourage interested candidates to review the key responsibilities and qualifications and apply for any positions that match your skills and capabilities.

    Equal Employment Opportunity Statements

    The policy of General Motors is to extend opportunities to qualified applicants and employees on an equal basis regardless of an individual's age, race, color, sex, religion, national origin, disability, sexual orientation, gender identity/expression or veteran status. Additionally, General Motors is committed to being an Equal Employment Opportunity (EEO) Employer and offers opportunities to all job seekers including individuals with disabilities. If you need a reasonable accommodation to assist with your job search or application for employment, email us at [email protected] or call us at 800-865-7580. In your email, please include a description of the specific accommodation you are requesting as well as the job title and requisition number of the position for which you are applying.

    Job details

    Title

    Senior Data Engineer

    Employer

    General Motor

    Location

    United States

    Published

    June 11, 2024

    Application deadline

    September 07, 2023

    Job type

    Senior

    Field

    Engineering

    About the employer

    We embrace the responsibility to lead the change that will make our world better, safer and more equitable for all. Our diverse team of 164,000 employees bring their collective passion for engineering, technology and design to deliver on our vision of a world with Zero Crashes, Zero Emissions and Zero Congestion.

    Together, we want to make electric vehicles for everyone and safely push transportation beyond our wildest imaginations with autonomous vehicles and advance hydrogen fuel cell technology. We are proud of our achievements so far, but there is more work to be done. Together, for everyone.

     

    Similar jobs

    Recent blogs