↓Skip to main content

Michael Ayoub

reachme@michael.ayoub.io - linkedin.com/in/michaelayoub - ayoub.io

Skills #

Cloud: Experience with both Azure: Event Hubs, Logic Apps, Stream Analytics, Azure Active Directory, and AWS: Managed Streaming for Kafka (MSK), CloudFormation (CF), Cloud Development Kit (CDK), Lambda, Fargate with Elastic Container Services (ECS)

Platform Administration: Elasticsearch with Logstash and Kibana (ELK), Kafka, Linux (Ubuntu and CentOS)

Data Engineering: Extracting data from APIs and databases; writing complex transformations in Python, Pandas, and SQL; building data pipelines with Logstash; executing multi-step data workflows with dependencies using Makefiles and Luigi; using dbt for analytics engineering in SQL Server; administering topics, partitions, and consumer groups in Kafka; administering Elasticsearch indices, nodes, and clusters

Development: Python, Ruby, Java, TypeScript, SQL (T-SQL on SQL Server)

Analysis: Experience in developing functional design documents; successful at bridging the gap between business and technical realms; preparing prototypes; user-centered design; lean product development.

Experience #

[March 2022 – Present] Engineer III for Mutual of Omaha (Omaha, Nebraska)

  • Mentoring and training new engineers
  • Building an enterprise event bus and event catalog using Spotify Backstage to show event schemas, producer/consumer authorization, and producer/consumer relationships
  • Built an analytics platform for Mulesoft using Typescript, AWS Lambda, Glue, Kinesis Streams and Firehose, and Athena

[July 2021 – March 2022] Senior Consultant for Object Partners (acquired by Improving) (Omaha, Nebraska)

  • Building Python APIs with FastAPI for exposing data in Snowflake, deployed to Azure Kubernetes Service.
  • Proof of concept with dbt for Snowflake ELT, paving the way for data engineers.
  • Building developer tools and writing documentation for using Apache Beam with Apache Flink on Kubernetes (Minikube and Azure Kubernetes Service).

[January 2021 – July 2021] Senior Technical Solution Architect (API / Event Driven Architecture) for Mutual of Omaha (Omaha, Nebraska)

  • Responsible for enabling developers to use services for implementing event driven architectures in public (AWS) and private clouds, like AWS Managed Streaming for Kafka (MSK), SNS/SQS, and EventBridge
  • Responsible for participating in third party SaaS and PaaS solution evaluation, feature comparisons, and requirements analysis
  • Automated generation and association of SASL/SCRAM principals in AWS Secrets Manager to AWS MSK clusters using Cloud Development Kit (CDK) and usage of those secrets in Fargate services
  • Built data analytics pipelines with Python, dbt, Ansible, and SQL Server for presenting MuleSoft Anypoint platform metrics, KPIs, and transaction logs for other developers
  • Proof of concept deployment of Spotify Backstage developer portal, including writing plugins in React and TypeScript pulling data from internal APIs to expose backend system information

[April 2020 – January 2021] Technical Solution Architect (API / Event Driven Architecture) for Mutual of Omaha (Omaha, Nebraska)

  • Responsible for enabling developers to implement event driven architecture in public (AWS) and private clouds
  • Enabled AWS Managed Streaming for Kafka (MSK) for developers using Cloud Development Kit (CDK) and TypeScript
  • Automated generation of key stores for client certificate authentication to Kafka using AWS Lambda and Java
  • Wrote documentation for onboarding development teams to Kafka

[October 2019 – April 2020] Senior Software Engineer (API / Event Driven Architecture) for Mutual of Omaha (Omaha, Nebraska)

  • Responsible for automating configuration of Apache Kafka clusters with Ansible, documenting best practices for integrating applications with Kafka, and being a North Star for internal teams on leveraging streaming data platforms.
  • Deployed Kafka to on-premise virtual machines using Ansible
  • Proof of concept evaluation of Apache Atlas as a catalog of events and streaming applications
  • Gained familiarity with MuleSoft Anypoint Platform

[September 2017 – October 2019] Information Security Analyst (Development and Automation) for Kiewit Technology Group (Omaha, Nebraska)

  • Responsible for architecting, building, and maintaining a SIEM (Security Information and Event Management) data platform from open source tools, including Elasticsearch, Logstash, and Kibana (ELK Stack), Kafka, TheHive, and ElastAlert
  • Driving implementation of Kappa Architecture streaming data solutions with Kafka Streams and KSQL across multiple teams, including a proof of concept building comprehensive joined views of objects in SAP based on change-data-capture (CDC) streams of SAP tables into Kafka
  • Deployed Logstash data pipelines to Docker Swarm, enabling scalable ingestion for peak activity (400+ GB/day, 370MM+ logs/day) and one-command packaging and deployment of new ETL containers, enabling our analysts to gain insights from data more quickly
  • Trained team members on JSON and using REST APIs from Python, cURL, and PowerShell
  • Deployed Traefik and OpenFaaS onto Docker Swarm, providing a flexible platform for service development
  • Developed Python services for data extraction from 3rd-party services including Office 365 Management API into Kafka, with scheduled execution on Docker Swarm
  • Developed complex ETL in Pandas to extract meaning from SAP Audit Logs, enabling real-time monitoring of SAP transaction code execution
  • Automated IR (Incident Response) case management in TheHive, including a custom ElastAlert connector that uses a version-controlled repository of Incident Response Plans
  • Developed Data Enrichment suites, including front-end tools for analyst maintenance of contextual data, a PostgreSQL DB + PostgREST API utilizing triggers in PostgreSQL for auditing of changes, and Ruby scripts for Logstash to enrich security logs with up-to-the-second intelligence
  • Proof of concept using Spark SQL and the Elasticsearch-Hadoop bridge to develop rich interactive analytics system for TheHive data

[October 2016 – September 2017] Business Analyst for Kiewit Technology Group (Omaha, Nebraska)

  • As a business analyst, responsible for working with domain experts to gather requirements, and lead testing efforts on new product development
  • Developed complex ETL (extract, transform, load) of $1B+ of SAP transactional data into Ariba Spend Analysis, using Python and T-SQL
  • Developed proof of concept apps for Microsoft Hololens using C# and Unity, including the MR (Mixed Reality) Sharing libraries for Hololens-to-Hololens networking and voice recognition

[November 2015 – October 2016] Systems Engineer for Kiewit Energy (Lusby, Maryland).

  • Responsible for material master data strategy for all engineered equipment on a $4B LNG plant expansion project, including organization, nomenclature, and tagging
  • Realized $1.1MM in efficiency gains by designing, developing, and deploying a new material management system handling over $12MM/year in transactions with complex cost accounting across engineering disciplines.
  • Reduced time-to-replenish by hours every day with a reporting application in Java that combined transactional data, SAP warehouse information, and a map of the warehouse to produce optimized pick tickets
  • Improved engineer efficiency by automating material data uploads

[August 2014 – November 2015] Business Analyst for Kiewit Technology Group (Omaha, Nebraska).

  • Started as an intern in August 2014. Hired full time in February 2015.
  • Responsible for writing functional specifications for SAP enhancements, writing and executing test plans, and facilitating UAT (user acceptance testing).
  • Reverse-engineered Windows Mobile 6.5 browser interface to SAP, and injected Javascript into final deployments to adapt the shortcut keys to our use cases and particular equipment

Education #

[2009-2014] Bachelor of Science, Mathematics at Florida State University. Minor in Computer Science.

[2009-2014] Bachelor of Arts, Philosophy at Florida State University. Minor in Russian.

↑