Discovering and Mitigating Biases in CLIP-based Text-to-Image Generation
Discovered the queries for which the popular CLIP model biases the generated images in the text-to-image synthesis task and proposed several ways to mitigate the biases without retraining CLIP or the underlying generative model.
Tech Stack: Pytorch

Debiasing Image-to-Image Translation Models
Pretrained StyleGAN2 based networks show various biases in different image-to-image translation tasks (such as super-resolution, sketch-to-image, etc.). Mitigated this bias issue using contrastive learning and uniform sampling of minority attributes.
Tech Stack: Pytorch

Bias Detection in Image Search and Mitigation
Identified the bias issue in the image results for search queries, proposed a way to audit. In addition, proposed an attribute-controlled style-based generator to create new content to mitigate such biases and enrich user experience.
Tech Stack: Pytorch, Tensorflow

Dynamic Convolution
Built an adaptive convolution network which changes its kernel dynamically depending on the current input (~10% better recommendations).
Tech Stack: Pytorch

Intent Detection for Recommendation
Captured users’ hidden intents (i.e. explore, purchase) from their interactions by designing a hierarchical Transformer model. It first discovers these intents and then pays attention to them for next item prediction (improved personalized recommendations by 5%).
Tech Stack: Tensorflow

Lightweight Convolutional Network for Recommendation
Improved the scalability of sequential recommender methods by modelling a scalable depth-wise separable 1D convolution neural network (requires ~30% less memory).
Tech Stack: Tensorflow

Visual Commonsense Reasoning.
Enforced reasoning for ans. prediction on VCR by building a differentiable module which jointly trains ans. and rationale prediction (performed better in leaderboard).
Tech Stack: Pytorch

Rationale Generation
Tasked state-of-the-art Visual Question Answering model (ViLBERT) with rationale generation (using GPT-2) to interpret/justify answer prediction. It improves accuracy by 1.5% as well.
Tech Stack: Pytorch

Scalable Video Fingerprinting
Built a scalable, end-to-end pipeline using FAISS library that can trace a manipulated video in less than a second from a trusted database with millions of corpuses.
Tech Stack: Tensorflow

Distributed Algorithm Design
Extended both Spark and Hadoop for creating geo-distributed clusters in AWS and designed geo-distributed algorithms for higher dimension data.
Tech Stack: Java, Spark, Hadoop

Scalable Principal Component Analysis.
Improved the scalability of PCA for large datasets (up to 83× better performance) using sketching technique.
Tech Stack: Java, Scala, Spark

Fair Image Search Engine using CLIP
Built a search engine by calculating the cosine similarity scores between CLIP embedding of the text query and images in the database and sorting from highest to lowest to show the most relevant images on the top. Additionally, employed a diversity constraint using the embedding for different demographics.
Tech Stack: Pytorch

Image Colorization using Cycle Consistency Loss
Explored the potential of using Cycle Consistency Loss between grey and colored images in Generative Adversarial Networks for generating true and vivid colors for black & white images.
Tech Stack: Pytorch

Pragmatic Probabilistic Principal Component Analysis
Using sketching techniques, derived a warm initialization for Expectation Maximization (EM) algorithm of Probabilistic PCA (PPCA). This speeds up convergence up to 2.25×.
Tech Stack: Java, Spark

Digitor: A Digital Circuit Simulator
Developed a digital circuit simulator app where one can draw digital circuits and simulate its behavior. It can automatically derive the boolean expression from the circuit and minimize it (using Quine–McCluskey algorithm) to suggest a simplified implementation.
Tech Stack: Java