Sr. Data Engineer who has built data pipelines and distributed systems

Description

We’re representing a senior engineer who has worked with environments requiring low latency, large scale data processing, and multi data center deployments.

Highlights

  • Early member of a platform engineering team and led the development of open-connect platform and platform api server
  • Designed and optimized streaming pipelines for latency-sensitive partners
  • Designed and deployed a classification pipeline and annotation UI for mass product categorization
  • Designed frameworks for distributed system testing and helped foster a TDD culture

Education

  • BS in Software Engineering

Technical Skills

  • Programming languages: Java, Go, Rust
  • Systems: Pulsar, Kafka, Hadoop, Flink, Presto, Druid, Airflow