Staff Data Engineer Job at Elastic, United States

ZWFrRDJMd0RLRnhzR1B1dG1UOEZ0VjYxSXc9PQ==
  • Elastic
  • United States

Job Description

What is The Role

We are seeking a Staff Data Engineer to join our Data Engineering & Architecture team. In this role, you will contribute to our mission of building a world-class Data Platform. Your work will directly impact our strategy by making it easier for internal customers to leverage data as a strategic asset. This position offers an excellent opportunity to help craft critical initiatives that support real business outcomes.

What You Will Be Doing



  • Assist in developing, implementing, and optimizing data pipelines using Apache Airflow for workflow orchestration.

  • Develop and maintain ETL/ELT processes using Apache Spark, Apache Iceberg, and dbt.

  • Implement real-time data streaming solutions using Apache Kafka and Apache Flink.

  • Use Terraform for infrastructure-as-code to deploy resources on Google Cloud Platform (GCP).

  • Document & Guide Users on Best Practices for using our platform.

  • Monitor and Audit the Data Platform to ensure policies and procedures are maintained.

  • Participate in code reviews to improve code quality and validate standard processes are met.

  • Process Access Requests ensuring all approval processes are followed.

What You Bring



  • Demonstrated interest in data engineering through personal projects, coursework, or contributions to open-source projects.

  • Strong Analytical and Problem Solving Skills.

  • Excellent Verbal and Written Communication Skills.

  • Eagerness to learn and stay updated with the latest data engineering trends.

  • Proficiency in programming languages, particularly Bash, Python, and SQL.

  • Knowledge of database systems, including OLAP, OLTP, Document, and Vector databases.

  • General understanding of data pipelines, ETL/ELT processes, data modeling, and data warehousing concepts.

  • Basic Knowledge of Git and DevOps practices.

  • Proficiency with data processing frameworks such as Kafka, Flink, and Spark.

  • Experience with Apache Iceberg and Data Lake houses

 

Job Tags

Full time,

Similar Jobs

United Parcel Service

Seasonal Warehouse Worker - Package Handler Job at United Parcel Service

Seasonal Warehouse Worker - Package Handler at United Parcel Service summary: Seasonal Warehouse Workers at UPS are responsible for loading and unloading packages from trailers and delivery trucks in a fast-paced environment. The role requires physical stamina, the ...

Hawaiian Airlines

Airport Ramp Agent - Lihue - Part-Time (5k Sign-On Bonus) Job at Hawaiian Airlines

 ...Ability to lift 70lbs. throughout your shift. Must be able to bend, stoop, squat, reach...  ...Flexible to work varied shifts including nights, weekends, and holidays. Ability to...  ...Handling Certification. Ability to obtain airport security clearance. Ability to... 

Compunnel, Inc.

Elastic Search Consultant Job at Compunnel, Inc.

Client: LTIM / NXP SemiconductorsGood to have skills AI-driven search experience with Amazon, Algolia, Bloomreach, Coveo, Elastic, LucidworksExperience configuring and maintaining SOLR or other search enginesExposure to web crawling tools (e.g., Nutch)Understanding... 

Bank of America

Credit Officer II-Global Corporate & Investment Banking Job at Bank of America

 ...Bank Of America Credit Risk Manager At Bank of America, we are guided by a common purpose to help make financial lives better through...  ...profitability to provide high quality credit approval to Corporate Banking, Investment Banking, Global Markets, and Treasury Exercises... 

TechDigital Corporation

Salesforce Solutions Architect Job at TechDigital Corporation

 ...Salesforce Solutions Architect We are seeking an experienced and highly skilled Salesforce Solutions Architect with a broad understanding of various systems to join our team. As a Salesforce Solutions Architect, you will be responsible for designing and implementing...