Key Expertise
Experience
10+ years
Timezone
CET (UTC +1)
Skills
Languages
Databases
Infrastructure
Frameworks
Integrations & Protocols
Overview
Mission-critical market data platform covering equities across dozens of global exchanges, FX, and fixed income, serving both internal quantitative trading desks. At this scale and in this context, reliability is not a quality attribute – it is the product. The system had to sustain consistent ingestion and low-latency access during peak trading hours across multiple time zones, with no tolerance for data gaps or processing delays that could affect trading decisions.
Achievements
Substantially reduced average processing time on the core ingestion pipelines, directly improving throughput for downstream trading systems. Delivered a custom streaming sink integration that cut both average and peak query latency by a significant margin – the peak reduction being the more operationally important figure, as it addressed the tail-latency spikes that affected time-sensitive analytics. Improved the startup behavior of the main streaming component, eliminating instability during high-load trading windows.
Responsibilities
- Owned end-to-end reliability of ETL processes ingesting global equities data and delivering analytics to internal trading systems – a zero-defect-tolerance environment with direct business exposure on failure.
- Built ingestion and analytics pipelines for FX and fixed income asset classes, expanding the platform's cross-asset coverage and enabling unified analytics across instrument types.
- Led a performance engineering initiative on the primary real-time streaming ingestion component, improving startup time and processing stability during peak load periods.
- Developed an ETL migration framework to automate transition from legacy warehouse infrastructure to a modern architecture, reducing per-pipeline development effort dramatically and accelerating onboarding of new engineers.
- Delivered storage format optimizations that reduced memory consumption during ETL execution; coordinated phased production rollouts with distributed teams across multiple time zones.
Technologies Used
Key Expertise
Experience
10+ years
Timezone
CET (UTC +1)
Skills
Languages
Databases
Infrastructure
Frameworks
Integrations & Protocols
This project was delivered by
Dmytro K.
More Projects by Dmytro K.
Cloud Data Platform for Neobank
Senior Data Engineer
End-to-end cloud data platform for a fast-growing neobank, with core event tables ingesting large volumes of data daily and hundreds of terabytes of cumulative data. The platform underpins reconciliation, partner integrations, and financial reporting – operating on a cloud-managed infrastructure where both reliability and regulatory compliance are non-negotiable. Given the nature of the business, any pipeline failure or data discrepancy carries direct financial and audit consequences.
Enterprise Data Warehouse Migration & Recommendation Systems
Senior Data Engineer
Data platform modernization for one of the largest US retail chains, spanning over a thousand physical stores and a major e-commerce operation. The scope covered legacy warehouse migration, recommendation pipeline rebuilding, and data governance implementation – all across a petabyte-scale environment without disrupting ongoing retail analytics.
Ready to Build Your AI Team?
Get matched with the right AI experts for your project. Book a free discovery call to discuss your requirements.
We respond within 24 hours.