Adrij Shikhar

experience

• Senior Software Engineer / Hevo Data

  Jun 2022 — Present

  Bangalore

  Scalability and Performance

  • Architected for Scale: Led key initiatives that enabled the platform to support a 2500% increase in object handling, from 1,000 to 25,000 objects.
  • Optimized Data Ingestion: Achieved a 5x increase in data ingestion speed within the MySQL connector, significantly boosting system efficiency and throughput.
  • Database Interaction at Scale: Engineered a metadata system that scaled the ETL platform by 15x, allowing for massive improvements in core database interactions.
  • Source Object Generation: Optimized the source object generation flow, resulting in a 10x improvement in pipeline performance and enabling support for larger datasets.
  • Reduced Catalog Document Size: Drove efforts to reduce the catalog document size, leading to improved performance and scalability across the platform.

  CDC Framework Project

  • Ownership and Execution: Led the complete implementation of real-time CDC framework using Debezium Engine (open source) which significantly enhanced data synchronization and ensured seamless real-time updates.
  • Schema Catalog Service:
    • Designed and built a generic schema service from scratch to manage and validate data schemas in ETL pipelines, with seamless integration and testing using Debezium connectors.
    • Supported source-specific features, including handling unchanged toast datum from PostgreSQL and diverse data types from various data sources, ensuring flexibility across different ETL environments.
    • Implemented schema versioning, metadata management, and compatibility checks to maintain data quality, streamline data processing, and accommodate schema evolution.

  System Optimization and Security Enhancements

  • Standardized Error Handling: Spearheaded the initiative to create a unified standard for HTTP and gRPC request failures across the control plane, which improved user experience and reduced support overhead.
  • Enhanced Security and Governance: Implemented source/destination whitelisting and played a key role in the Connectors Flag GA for Hevo 1.0.
  • REST API Security Enhancements: Enhanced the REST API connector by implementing OAuth 2.0 authorization, improving security and user management.

  Feature Development and Integrations

  • Led the implementation of several new features including Session Logs, YML template support, advanced scheduler with Cron support, and Terraform integration.
  • Spearheaded the development and launch of the SurveyMonkey connector, contributing to the expansion of Hevo's connector ecosystem.

  Critical Customer Issue Resolution

  • Managed and resolved several complex customer issues for key clients, significantly improving customer satisfaction.

  Innovative System Enhancements

  • Real-time Logs Implementation: Implemented data governance tool to handle PII redaction in near real-time using AWS S3 and AWS Comprehend, ensuring data privacy and enhancing user experience.
  • Microservices and Task Execution: Worked on integrating a microservices architecture on AWS Fargate and implemented a Temporal-based task execution system, improving reliability and streamlining hierarchical DAG processes.

  Team Contribution and Documentation

  • Regularly contributed to improving documentation quality and conducted knowledge transfer sessions, fostering team collaboration.

• Software Development Intern / Hevo Data

  Sep 2021 — Oct 2021

  Bangalore

  • Added support for 'wal2json' output plugin for postgres replication.
  • Reduced WAL processing time taken by the platform, by 60%.
  • Implemented dynamic plugin selection using Guice dependency injection.
  • Implemented OAuth 2.0 feature for accessing protected Rest APIs
  • Tech Stack: Java, Postgres

• Software Development Intern / MTX Global

  Jun 2021 — Aug 2021

  Hyderabad

  • Worked on curating ETL data pipeline from concept to proof of concept.
  • Implemented on-demand data transformations using Apache Spark, and streaming the same using Apache Kafka onto Google Cloud Platform.
  • Containerized individual components of the pipeline for better development and deployment.
  • Solely configured and maintained pipeline on Google K8s Engine.
  • Orchestrated data visualization service to configure overlayed charts.
  • Tech Stack: Python, Apache Spark, Docker, Kubernetes, Google Cloud Platform

• Software Development Intern / Triomics

  Apr 2021 — May 2021

  Gurgaon

  • Collaborated with the core founding team on the initial stages of the platform.
  • Setup infrastructure for the applications, keeping scalability and security into account.
  • Developed management dashboard service for micro and macro level user access across the apps.
  • Customized D3 for visualization of data, fitting our use case.
  • Tech Stack: React, Django, Postgres

• Software Development Intern / Rephrase.ai

  Oct 2020 — Mar 2021

  Bangalore

  • Ensured stability of the product by integrating tests and error handling.
  • Optimized uploading and validating data from user's end.
  • Implemented Stripe, Sentry, Clickup for better development cycle.
  • Integrated continuous integration and ensured continuous delivery among various services.
  • Worked on graphene to optimize API performance.
  • Tech Stack: React, Django, GraphQL, ffmpeg

• Software Engineering Intern / Powerplay

  Apr 2020 — Jun 2020

  Bangalore

  • Implemented core features and structure from concept through deployment.
  • Introduced REST API's, server-side pagination and JWT based authentication system.
  • Standardized UI libraries by enclosing them in highly customizable wrapper for code reusability.
  • Assessed UX and UI designs for technical feasibility.
  • Developed standard and ad hoc report in table format.
  • Collaborated with product team members to implement new feature developments.
  • Tech Stack: React, NodeJS, MongoDB

• Developer / SDSLabs

  Jan 2019 — Jul 2020

  IIT Roorkee

  • Under the hood of the group, we promote technical culture on the campus by conducting hackathons, lecture series, and competitions.
  • Responsible for maintaining current applications and server management.
  • Mentored freshmen students in their projects for the Winter of Code program.

• Manager / Entrepreneurship Cell

  Feb 2019 — Feb 2020

  IIT Roorkee

  • Conducted meetings, hands-on workshops and events on various topics related to entrepreneurship and startups.
  • Participated in various case studies regarding SaaS.
  • Developed core pipeline and worked on optimizing user experience.
  • Spearheaded the development of user interface and the flow of login & registration forms.

• Web Developer / Cognizance

  Dec 2018 — Jan 2020

  IIT Roorkee

  • Been a part of a 3-tier team of 5+ executive members, associate members, and co-coordinators to establish web presence of Cognizance 2019 and 2020.
  • Contributed as a Manager Web in 2019 and 2020
  • Worked on designing the architecture and implementing core features of the progressive web app.
  • Ported the legacy code from webpack v2 to webpack v4 and restructured the node dependencies.

education

• Indian Institute of Technology, Roorkee

  Bachelor of Technology — Chemical Engineering

  Jul 2018 — Jun 2022

• Gulab Rai Montessori

  PCM with Computer Science

  Apr 2015 — Mar 2017

skills

achievements