Staff, Data Platform Engineer

Rivian

11700

United States, California, Los Angeles, United States

Posted on: 2022-05-19

Category: emobility

Ready to make this your next chapter?

Let Rivian know you found them on WorkInGreen. It helps more companies post climate jobs here.

Expired

Employment type:

Full time

Experience required:

Intermediate

Salary

Salary not provided

About the company:

Doing something different is never easy. It requires courage, optimism and grit. Core to our mission is building a team of adventurous individuals determined to make a positive impact on the world. This means challenging ourselves constantly. Stretching beyond the bounds of conventional thinking. Reframing old problems. Seeking new solutions. And operating comfortably in a space of uncertainty. While our backgrounds are diverse, our team shares a love of the outdoors and a desire to protect it for future generations. Do you like doing the impossible? We’d love to hear from you.

Rivian is on a mission to keep the world adventurous forever. This goes for the emissions-free Electric Adventure Vehicles we build, and the curious, courageous souls we seek to attract.

As a company, we constantly challenge what’s possible, never simply accepting what has always been done. We reframe old problems, seek new solutions and operate comfortably in areas that are unknown. Our backgrounds are diverse, but our team shares a love of the outdoors and a desire to protect it for future generations.

The Information Technology org at Rivian is seeking a Staff Data Platform Engineer to join the Data Engineering team, reporting to the Senior Data Engineering Manager, IT Services.

We are looking for data engineers with strong software engineering backgrounds, a "platform engineering mindset" and deep passion for data. You will be a part of Rivian Enterprise Data Platform team whose goal is to enable timely, effective and safe sharing of data to multiple engineering, operations and business teams at Rivian for building world class data products.

Responsibilities:

You will choose the appropriate purpose built technology from a plethora of open source software and AWS offerings and be responsible for building massively scalable real-time as well as batch data ingestion and data processing pipelines to enable data analytics and data science use-cases in areas of digital commerce, service operations, charging, reliability, finance , capex, warranty, customer service and others.
Build ingestion pipelines using Kafka, Kinesis, lambdas, API Gateway , AWS Glue, Change Data Capture tools etc.
Build modular set of data services for data transformation and business logic processing using container microservices, Apache Spark on EMR, ETL technologies like AWS Glue, dbt, SQL and Python
Build automated unit and integration testing pipelines using frameworks like PySpark
Create and manage CICD pipelines with Gitlab CI and AWS Code Pipeline/CodeDeploy
Automate and schedule jobs using Managed Airflow
Building the ODS and reporting schema and load the data into AWS Redshift or Snowflake
Design and build data quality management services with Apache Deequ and data observability tools like Splunk, DataDog , CloudWatch
Provide a variety of query services with REST, Athena/Presto, server sent events
Configure and setup the enterprise data lineage and meta data management and data catalog support using tools like Collibra/Alation
Assist the data scientist within the data engineering team as well as other software engineering teams with data cleansing, wrangling and feature engineering
As a Staff data engineer, you will perform code reviews with peers, mentor junior engineers and ensure green builds for deployment. You will also be working with the lead architects as well as engineering , product and program management to contribute to a healthy backlog of technical epics

Qualifications:

At least 5+ years building data and analytics platforms using AWS Cloud , Python and SQL
Knowledge of AWS technologies specifically MSK, Kinesis, EMR, Athena, Glue, lambdas, API Gateway is a must
Knowledge of modern data tools like dbt (data build tool) and Airflow orchestration is highly desired
Ability to assist SQL analysts and Tableau developers in business teams in creating the right set of materialized views in a SQL data warehouse like Redshift/Snowflake
Knowledge of automation and CICD best practices
Familiarity with machine learning and data science ecosystems especially AWS Sagemaker and Databricks is highly preferred

Equal Opportunity

Rivian is an equal opportunity employer and complies with all applicable federal, state, and local fair employment practices laws. All qualified applicants will receive consideration for employment without regard to race, color, religion, national origin, ancestry, sex, sexual orientation, gender, gender expression, gender identity, genetic information or characteristics, physical or mental disability, marital/domestic partner status, age, military/veteran status, medical condition, or any other characteristic protected by law.

Rivian is committed to ensuring that our hiring process is accessible for persons with disabilities. If you have a disability or limitation, such as those covered by the Americans with Disabilities Act, that requires accommodations to assist you in the search and application process, please email us at [email protected].