Staff Data Engineer Job at Elastic, United States

ZWFrRDJMd0RLRnhzR1B1dG1UOEZ0VjYxSXc9PQ==
  • Elastic
  • United States

Job Description

What is The Role

We are seeking a Staff Data Engineer to join our Data Engineering & Architecture team. In this role, you will contribute to our mission of building a world-class Data Platform. Your work will directly impact our strategy by making it easier for internal customers to leverage data as a strategic asset. This position offers an excellent opportunity to help craft critical initiatives that support real business outcomes.

What You Will Be Doing



  • Assist in developing, implementing, and optimizing data pipelines using Apache Airflow for workflow orchestration.

  • Develop and maintain ETL/ELT processes using Apache Spark, Apache Iceberg, and dbt.

  • Implement real-time data streaming solutions using Apache Kafka and Apache Flink.

  • Use Terraform for infrastructure-as-code to deploy resources on Google Cloud Platform (GCP).

  • Document & Guide Users on Best Practices for using our platform.

  • Monitor and Audit the Data Platform to ensure policies and procedures are maintained.

  • Participate in code reviews to improve code quality and validate standard processes are met.

  • Process Access Requests ensuring all approval processes are followed.

What You Bring



  • Demonstrated interest in data engineering through personal projects, coursework, or contributions to open-source projects.

  • Strong Analytical and Problem Solving Skills.

  • Excellent Verbal and Written Communication Skills.

  • Eagerness to learn and stay updated with the latest data engineering trends.

  • Proficiency in programming languages, particularly Bash, Python, and SQL.

  • Knowledge of database systems, including OLAP, OLTP, Document, and Vector databases.

  • General understanding of data pipelines, ETL/ELT processes, data modeling, and data warehousing concepts.

  • Basic Knowledge of Git and DevOps practices.

  • Proficiency with data processing frameworks such as Kafka, Flink, and Spark.

  • Experience with Apache Iceberg and Data Lake houses

 

Job Tags

Full time,

Similar Jobs

Moses-weitzman Health System

Dentist Meriden - 8 Hours Job at Moses-weitzman Health System

 ...emergency dental patients. Provides general dentistry services to target population according to the mission and goals of CHC. Assists...  ...precautions. 8 hour a week schedule, with some evening and weekend hours as needed. Additional time as needed to complete recordkeeping... 

Heal One World

Film Festival PR/Event Sponsorship/Creative Director Volunteers Job at Heal One World

 ...paid trip). Awareness Festival can be seen at We are ALL volunteers and need a couple of dedicated souls with a bit of spare time!...  ...Co-ordinate Music and Parties during festival Help with Press and Marketing Promote Monthly Screening Series of films... 

Smbc Global Foundation Inc

Associate, Infrastructure, Power & Energy Project Finance, North America Job at Smbc Global Foundation Inc

 ...Energy Project Finance, North America SMBC's Global Structured Finance...  ...Finance Group is a leading banking franchise providing advisory,...  ...will be sector-agnostic, working with bankers across all industry...  ...with an opportunity to work from home, as well as, from an SMBC... 

Link Up Overseas

Part-time Online Data Entry Clerk - Entry Level (Remote) Job at Link Up Overseas

 ...About the job Part-time Online Data Entry Clerk - Entry Level (Remote) This is your opportunity to begin a perdurable career with infinite...  .... Part time is offered - choose the days you prefer to work. Chance to be promoted Responsibilities Must have... 

BJC HealthCare

Nephrologist to Join Parkland Health Center in Farmington, MO Job at BJC HealthCare

Additional Information About the Role BJC Medical Group has a Nephrology opportunity to join our large multi-specialty clinic based at BJC Parkland Health Center in Farmington, MO, less than an hour from St. Louis. Practice Details: ~ Join a growing Nephrology...