-Rollout of architecture components and services of AWS and CDP for Big Data pipelines.
–Automation for creation and managing of CDP services/experiences with Ansible and Jenkins.
–Creation of AWS services and policies with Terraform.
–Periodic upgrades of the Kubernetes experiences and CDP services.
-Migration from Apache Hive tables to Apache Iceberg tables.
-Managing the CDP Kubernetes clusters with Grafana and Yunikorn on AWS EKS in production.
-MLOps/DataOps support for Cloudera CDF, CML, CDE, CDW and NiFi flows.
-Creation of Jenkins pipelines for emailing automation and server software updates.
-Configuration of logging for different AWS cluster services and on-premises servers using Splunk.