Staff Data Engineer Job at Elastic, United States

ZWFrRDJMd0RLRnhzR1B1dG1UOEZ0VjYxSXc9PQ==
  • Elastic
  • United States

Job Description

What is The Role

We are seeking a Staff Data Engineer to join our Data Engineering & Architecture team. In this role, you will contribute to our mission of building a world-class Data Platform. Your work will directly impact our strategy by making it easier for internal customers to leverage data as a strategic asset. This position offers an excellent opportunity to help craft critical initiatives that support real business outcomes.

What You Will Be Doing



  • Assist in developing, implementing, and optimizing data pipelines using Apache Airflow for workflow orchestration.

  • Develop and maintain ETL/ELT processes using Apache Spark, Apache Iceberg, and dbt.

  • Implement real-time data streaming solutions using Apache Kafka and Apache Flink.

  • Use Terraform for infrastructure-as-code to deploy resources on Google Cloud Platform (GCP).

  • Document & Guide Users on Best Practices for using our platform.

  • Monitor and Audit the Data Platform to ensure policies and procedures are maintained.

  • Participate in code reviews to improve code quality and validate standard processes are met.

  • Process Access Requests ensuring all approval processes are followed.

What You Bring



  • Demonstrated interest in data engineering through personal projects, coursework, or contributions to open-source projects.

  • Strong Analytical and Problem Solving Skills.

  • Excellent Verbal and Written Communication Skills.

  • Eagerness to learn and stay updated with the latest data engineering trends.

  • Proficiency in programming languages, particularly Bash, Python, and SQL.

  • Knowledge of database systems, including OLAP, OLTP, Document, and Vector databases.

  • General understanding of data pipelines, ETL/ELT processes, data modeling, and data warehousing concepts.

  • Basic Knowledge of Git and DevOps practices.

  • Proficiency with data processing frameworks such as Kafka, Flink, and Spark.

  • Experience with Apache Iceberg and Data Lake houses

 

Job Tags

Full time,

Similar Jobs

Coinbase

Senior Product Manager Crypto Trading Experiences (Boston) Job at Coinbase

 ...A global cryptocurrency exchange is seeking an experienced Product Manager to enhance user experiences for traders. The role involves leading product development, leveraging financial concepts, and collaborating across teams to achieve impactful outcomes. Ideal candidates... 

UNC Health

Financial Analyst Sr - UNCH Operational Finance Team Job at UNC Health

Description Become part of an inclusive organization with over 40,000 teammates, whose mission is to improve the health and well-being of the unique communities we serve. Summary : Plans, develops and coordinates the preparation of budgets, financial statements...

Optum

Clinical Therapist (Adult & Pediatric) - LCSW/LMFT/LPC - Hybrid WFH Job at Optum

 ...weekends or holidays. As part of this hybrid role, you will work remotely one or two days per week, depending on clinic need, with...  ...requirements for the state of Connecticut: - Licensed Clinical Social Worker (LCSW)- Licensed Professional Counselor (LPC)-... 

Experis

Complaint Investigations Tech Job at Experis

 ...clients. Summary The Complaint Investigations Tech is an entry-level laboratory role within the Complaint Investigations Lab. This...  ...High School Diploma or GED with technical experience Basic computer skills (Microsoft Office, internet-based systems) Maintain... 

Life Flight Network

Float Aircraft Mechanic II Job at Life Flight Network

 ...rewarding and fulfilling path, then look no further - Life Flight Network is the place where your aspirations will take flight! The Aircraft Mechanic II provides onsite maintenance support for Life Flight Network (LFN) aircrafts including management of base inventory,...