Senior Data Engineer: Data Infrastructure job opportunity at Constructor.



bot
Constructor Senior Data Engineer: Data Infrastructure
Experience: 4+years
Pattern: remote
apply Apply Now
Salary:
Status:

Data Infrastructure

Copy Link Report
degreeBachelor's (B.Sc.)
United States Of America

We’re a passionate team who love solving problems and want to make our customers’ and coworkers’ lives better. We value empathy, openness, curiosity, continuous improvement, and are excited by metrics that matter. We believe that empowering everyone in a company to do what they do best can lead to great things. Handle ingestion of over 1 TB of compressed events daily and manage over 6 PB of #data in the data lake. __ Implement public-facing APIs for event ingestion (FastAPI) and real-time #analytics (ClickHouse, Cube). __ Manage data storage in appropriate formats (S3, ClickHouse, Delta). __ Facilitate data processing using technologies such as Python, Spark/Databricks, ClickHouse, AWS Lambda, and Kinesis. __ Include robust monitoring solutions (Prometheus, OpenTelemetry, PagerDuty, Sentry). __ Ensure #automated testing of pipelines and data quality. __ Provide cost observability and optimization capabilities. __ Offer tools for developers to develop, run, test, and schedule data pipelines, with support and documentation. __ Job scheduling and orchestration for data pipelines. __ Deployment and #management of BI tools. __ Real-time analytics infrastructure (ClickHouse, AWS Lambda, Cube.js, and related tooling). __ Real-time log ingestion and processing, including data compliance. __ Core data #services (Kubernetes, Ray, metadata services) and enterprise-wide observability solutions (ClickHouse and OpenTelemetry). __ Implement real-time, cross-regional event processing solutions ingesting data into multiple storage systems. __ Deploy OpenMetadata within Kubernetes for use by data pipelines. __ Design ClickHouse tables to store logs for company services and define interaction via Grafana.

Other Ai Matches

Senior Data Engineer: Data Infrastructure Applicants are expected to have a solid experience in handling Data Infrastructure related tasks