Golang Data Engineer

Golang Data Engineer #2613

Position Summary:

Our partner is a quantitative trading organization where live market data, low-latency systems, and proprietary models directly drive capital allocation decisions. As the platform continues to scale, the team is adding a senior engineer to own the real-time streaming ingestion systems that power live trading. You’ll build production-grade Go services that consume live Web Socket feeds, process and time-slice high-throughput market data, and deliver reliable inputs to a C-based trading engine running on AWS. The focus is demanding and meaningful: streaming reliability, automated failover, observability, and production debugging in a latency-sensitive environment where performance and correctness directly impact outcomes. If you enjoy building systems where milliseconds matter and your work influences real capital in motion, this is engineering at its sharpest.

Experience and Education:

BS in Computer Science, Computer Engineering, Software Engineering or equivalent hands-on experience/field
Hands-on experience building production-grade distributed system for real-time or streaming environments
Strong production experience developing backend or systems services in Go
Experience implementing Web Socket-based live data ingestion
Experience deploying and operating services on AWS, specifically EC2 and S3
Experience building and deploying containerized services, ideally in Kubernetes environments
Experience supporting low-latency, high-availability systems where downtime or delay had direct business impact

Skills and Strengths:

Go
Real-time streaming systems
Web Sockets
Low-latency architecture
Production service development
AWS EC2
AWS S3
Kubernetes
Containerization
Monitoring
Observability
Prometheus
High-throughput data processing
Failover design
Distributed systems
Debugging live production systems
Time-series data handling
Data pipeline development
Concurrency patterns
Systems reliability engineering

Primary Job Responsibilities:

Rebuild and own the production-grade, real-time market data ingestion system end-to-end
Develop high-performance Go services that consume live market data over Web Sockets
Process and manage high-throughput streaming data across approximately 1,500 equities
Aggregate and time-slice streaming data for accurate downstream model consumption
Deliver structured, low-latency data feeds to a C-based trading engine running on AWS EC2
Design and implement automatic failover from live market feeds to delayed backup streams
Ensure data integrity and correctness during feed transitions and recovery scenarios
Maintain and validate the historical data ingestion pipeline sourcing from AWS S3
Instrument services with monitoring and observability to detect latency spikes, data gaps, and system degradation
Debug and resolve live production streaming failures with minimal business disruption
Optimize ingestion services for latency, throughput, and fault tolerance
Deploy and operate containerized services within cloud-native environments
Collaborate directly with technical leadership on architectural decisions and performance tradeoffs
Operate independently without daily direction, taking full ownership of reliability and delivery
Continuously improve system resilience to support live trading without manual intervention