Kubernetes Autoscaling & Capacity Optimization
Key Expertise
Experience
7+ years
Timezone
CET (GMT +1)
Overview
Built and maintained AWS EKS node provisioning with Karpenter by defining scalable, workload-aware node pools to automatically right-size capacity and improve cluster elasticity for data/compute services.
Achievements
Enabled faster scale-out and more cost-efficient Kubernetes compute by introducing Karpenter pools tuned for different workload profiles, while reducing EC2 spend via right-sizing and lifecycle optimization.
Responsibilities
- Designed Karpenter node pools and provisioning constraints to match workload requirements (CPU/memory, architecture, zones, taints/tolerations), improving scheduling reliability and reducing manual node management.
- Automated cluster capacity management by codifying pool policies (limits, consolidation/expiration, disruption controls) to support safe scaling and predictable operations.
- Optimized EC2 costs by selecting appropriate instance families/sizes, leveraging spot where suitable, and eliminating over-provisioned capacity through right-sizing and consolidation strategies.
- Standardized environment configuration for repeatable deployments across stages (e.g., QA/prod) through infrastructure-as-code practices.
Key Expertise
Experience
7+ years
Timezone
CET (GMT +1)
This project was delivered by
Veronika Y.
More Projects by Veronika Y.
URLs Scraping Pipeline
Data Engineer / Backend Engineer
Built an end-to-end URL scraping high-throughput platform to continuously discover, schedule, and scrape web pages at scale. The pipeline coordinates scraping demand, executes distributed scraping jobs, and emits structured outputs for downstream processing and monitoring.
Databricks Lakehouse Ingestion & Medallion Architecture
Data Engineer
Built and operated a Databricks Lakehouse ingestion and transformation framework on Delta Lake, implementing a Medallion Architecture (Bronze/Silver/Gold) to move data from raw landing through curated layers into analytics-ready datasets for reporting and KPI consumption.
Ready to Build Your AI Team?
Get matched with the right AI experts for your project. Book a free discovery call to discuss your requirements.
We respond within 24 hours.