Welcome to my portfolio! I'm a graduate from IIT Roorkee. While my academic journey began in the world of chemistry, I quickly discovered my true passion for software development during my freshman year.
Over the past years, I've been honing my skills and working on exciting projects. My time is now dedicated to reading, writing, and crafting software solutions that not only solve problems but also push the boundaries of innovation.
Explore my portfolio to see the fruits of my labor, from web applications to mobile apps and everything in between. I'm excited to share my journey and the projects that have shaped my development career. If you have any questions or would like to collaborate, don't hesitate to get in touch!
Let's embark on this coding adventure together!
Experience
-
Senior Software Engineer · Hevo Data↗
Jun 2022 — PresentLoad data from any source into your warehouse
Scalability and Performance
- Architected for Scale: Led key initiatives that enabled the platform to support a 2500% increase in object handling, from 1,000 to 25,000 objects.
- Optimized Data Ingestion: Achieved a 5x increase in data ingestion speed within the MySQL connector, significantly boosting system efficiency and throughput.
- Database Interaction at Scale: Engineered a metadata system that scaled the ETL platform by 15x, allowing for massive improvements in core database interactions.
- Source Object Generation: Optimized the source object generation flow, resulting in a 10x improvement in pipeline performance and enabling support for larger datasets.
- Reduced Catalog Document Size: Drove efforts to reduce the catalog document size, leading to improved performance and scalability across the platform.
CDC Framework Project
- Ownership and Execution: Led the complete implementation of real-time CDC framework using Debezium Engine (open source) which significantly enhanced data synchronization and ensured seamless real-time updates.
- Schema Catalog Service:
- Designed and built a generic schema service from scratch to manage and validate data schemas in ETL pipelines, with seamless integration and testing using Debezium connectors.
- Supported source-specific features, including handling unchanged toast datum from PostgreSQL and diverse data types from various data sources, ensuring flexibility across different ETL environments.
- Implemented schema versioning, metadata management, and compatibility checks to maintain data quality, streamline data processing, and accommodate schema evolution.
System Optimization and Security Enhancements
- Standardized Error Handling: Spearheaded the initiative to create a unified standard for HTTP and gRPC request failures across the control plane, which improved user experience and reduced support overhead.
- Enhanced Security and Governance: Implemented source/destination whitelisting and played a key role in the Connectors Flag GA for Hevo 1.0.
- REST API Security Enhancements: Enhanced the REST API connector by implementing OAuth 2.0 authorization, improving security and user management.
Feature Development and Integrations
- Led the implementation of several new features including Session Logs, YML template support, advanced scheduler with Cron support, and Terraform integration.
- Spearheaded the development and launch of the SurveyMonkey connector, contributing to the expansion of Hevo's connector ecosystem.
Critical Customer Issue Resolution
- Managed and resolved several complex customer issues for key clients, significantly improving customer satisfaction.
Innovative System Enhancements
- Real-time Logs Implementation: Implemented data governance tool to handle PII redaction in near real-time using AWS S3 and AWS Comprehend, ensuring data privacy and enhancing user experience.
- Microservices and Task Execution: Worked on integrating a microservices architecture on AWS Fargate and implemented a Temporal-based task execution system, improving reliability and streamlining hierarchical DAG processes.
Team Contribution and Documentation
- Regularly contributed to improving documentation quality and conducted knowledge transfer sessions, fostering team collaboration.
Projects
-
ScraperQL↗
Oct 2020Dgraph LabsDgraph Labs hosted the 'Hack and Slash GraphQL' hackathon to showcase the power of Slash GraphQL.
- Developed a web scraper using GraphQL to leverage the nesting power of it.
- You have a single query resolver called scrape that takes in a URL as a parameter and returns a generic defined entity such as an HtmlNode
-
Kill-Zee↗
Jan 2020Global Game Jam 2020A small tactical game in Lua to kill zombies and protect your tower before its too late.
Spearheaded and implemented the underlying core features and worked on performance optimization.
Education
Indian Institute of Technology, Roorkee
Chemical Engineering
Gulab Rai Montessori
Achievements
- 1st Place — CSAW Embedded Security Challenge 2020 — National level
- 3rd Place — CSAW Embedded Security Challenge 2020 — Globally
Interests
I try to make the most out of my time by exploring the latest technological advancements. Apart from being a tech enthusiast, I enjoy most of my time playing guitar. I have an OCD for music and love to have a sorted music library.
When forced indoors, I follow a number of sci-fi genre movies and television shows and a large amount of my free time exploring new advancements in every field. Some of my time is invested in learning how our brain functions.