Hi :)

I am a PhD student in Computing at Imperial College London. My research interests include controllable generation, interpretability, and trustworthy AI.

My research focuses on understanding and mitigating risks in generative AI systems with the help of localisation methods to locate concept neurons and leveraging these to extract concept ontologies in generative models. I love studying models' internal representations of concepts and linking them to model behaviours, as this gives room for improving controllability. Around this, my work spans:

  1. Concept unlearning โ€” removing unsafe or unwanted concepts from text-to-image diffusion models, and auditing how well they are actually removed. (๐Ÿงน TRUST, Certified Unlearning, eval-unlearn)
  2. Bias mitigation โ€” aligning the internal concept ontology of generative models to reduce harmful bias without breaking generation. (โš–๏ธ CO-ALIGN)
  3. Privacy and attribute leakage โ€” identifying sensitive attributes that leak through text-to-image generation, and building defences. (๐Ÿ”’ Leaky Diffusion, Dementia Speech Alignment)
  4. Faithful reasoning and explanations โ€” argumentative LLMs whose verdicts are faithful by construction. (๐Ÿ’ฌ ITA, Sparsified QAEs)

I am motivated to work towards improving AI Safety, and therefore, I am actively involved in educating myself with emerging risks and defences. I recently completed an AI Safety Fellowship at LASR Labs. Previously, I completed my MRes in Artificial Intelligence and Machine Learning at Imperial College London, and my B.Tech in Computer Science and Engineering from IIT Guwahati. I also gained valuable industry experience as a Software Engineer at Microsoft.

I'm deeply interested in Mechanistic Interpretability, Explainable AI, and Reinforcement Learning. When I am not experimenting or judging papers ๐Ÿค“, I enjoy mentoring junior students, playing chess, running, and reading books.

News

  • Sep 2026Two papers accepted to NeurIPS 2026 (poster): CO-ALIGN and Neurosymbolic Learning for Inference-Time Argumentation! ๐ŸŽ‰
  • Sep 2026Released eval-unlearn, an open-source benchmark for concept unlearning in T2I diffusion models. ๐Ÿ“ฆ Docs
  • 2026TRUST (Selective Fine-Tuning for Concept Unlearning) accepted to ACM CCS 2026! ๐ŸŽ‰
  • 2026Serving as a reviewer for AAAI 2027. ๐Ÿ“
  • 2026Received the Gold Reviewer Award at ICML 2026. ๐Ÿ…
  • Jan 2026Started the AI Safety Research Fellowship at LASR Labs in London ๐Ÿ‡ฌ๐Ÿ‡ง.
  • Oct 2025Started my PhD in Computing at Imperial College London! ๐ŸŽ“

Professional Experience

AI Safety Research Fellow
LASR Labs (with Google DeepMind), London, United Kingdom
Jan 2026 โ€“ Apr 2026
Detecting Chain-of-Thought unfaithfulness in the activation space of reasoning LLMs.
PhD / MRes Researcher
Imperial College London, London, United Kingdom
Sep 2024 โ€“ Present
Bias mitigation, concept unlearning, and attribute leakage in text-to-image diffusion models.
Software Engineer
Microsoft, Bangalore, India
May 2024 โ€“ Sep 2024
AI-powered customer care and scalability migration for Dynamics 365 Omnichannel.
Research Intern
University of Pennsylvania, Remote
Nov 2022 โ€“ Sep 2024
Table-grounded QA generation via SQL pipelines and LLM few-shot prompting.
Software Engineer Intern
Microsoft, Bangalore, India
May 2023 โ€“ Jul 2023
BERT-based ICM auto-routing, improving efficiency from 53% to 93% across 98 teams.
Undergraduate Researcher
IIT Guwahati, Guwahati, India
May 2023 โ€“ Sep 2024
  • B.Tech thesis: built a diverse relation-extraction dataset via a 6-level relation hierarchy.
  • DDoS detection and prevention in D2D communications using Random Forest and ns-3.

Education

  • PhD in Computing
    Imperial College London
    2025 โ€“ Present
  • MRes in Artificial Intelligence and Machine Learning
    Imperial College London
    2024 โ€“ 2025
  • B.Tech in Computer Science and Engineering
    Indian Institute of Technology, Guwahati
    2020 โ€“ 2024

Selected Publications

Filter:

* denotes equal contribution

CO-ALIGN
CO-ALIGN: Efficient Bias Mitigation in Text-to-Image Diffusion Models using Concept Graphs
Mansi, Avinash Kori, Francesco Leofante
NeurIPS 2026 (Poster)

A bias mitigation approach that aligns the model's internal concept ontology across the text encoder and denoiser, improving fairness by 30% while reducing semantically incoherent outputs by 88% and preserving image quality.

Neurosymbolic Learning for Inference-Time Argumentation
Neurosymbolic Learning for Inference-Time Argumentation
Gabriel Freedman*, Adam Dejl*, Adam Gould*, Mansi*, Lihu Chen, Junqi Jiang, Francesca Toni
NeurIPS 2026 (Poster)

ITA is a trainable neurosymbolic framework for true/false/uncertain claim verification. A formal argumentation semantics guides LLMs to generate and score arguments, then computes the verdict from them, so predictions are faithful by construction to explicit, inspectable arguments.

Certifying Concept Unlearning
Certifying Concept Unlearning in Text-to-Image Diffusion Models
Mansi, Luca Marzari, Francesco Leofante
Preprint 2026

A certification framework that derives high-confidence upper bounds on residual concept leakage after unlearning. Certified bounds exceed attack success rates by 16.2% on average, showing that attack-based evaluations underestimate leakage.

eval-unlearn
eval-unlearn: Benchmarking unlearning in Text-to-Image Diffusion Models
Mansi, Nikhil Raghavan, Zixia Huang, Kai Sheng Ong, Ji Shen Lim, Brandon Siao Xiang Ling, Francesco Leofante
Preprint 2026

An open-source Python library that benchmarks twelve concept unlearning techniques with nine evaluation metrics under one reproducible framework, plus a public HuggingFace leaderboard.

TRUST
Selective Fine-Tuning for Targeted and Robust Concept Unlearning
Mansi, Avinash Kori, Francesca Toni, Soteris Demetriou
ACM CCS 2026

TRUST dynamically estimates target concept neurons and unlearns them via selective fine-tuning with Hessian-based regularization. It is robust to adversarial prompts, preserves generation quality (โˆ†FID = 0.02), and runs significantly faster than prior methods.

Dementia Speech Alignment
Understanding Dementia Speech Alignment with Diffusion-Based Image Generation
Mansi*, Anastasios Lepipas*, Soteris Demetriou, Dominika C Woszczyk, Yiying Guan
INTERSPEECH 2025 (Oral)

We investigate how text-to-image generation can inadvertently reveal markers of cognitive decline from dementia speech, with implications for privacy in healthcare applications.

Leaky Diffusion
Leaky Diffusion: Attribute Leakage in Text-Guided Image Generation
Anastasios Lepipas, Marios Charalambides, Jiani Liu, Yiying Guan, Dominika C Woszczyk, Mansi, Thanh Hai Le, Soteris Demetriou
PoPETS 2025

We analyze attribute leakage paths in text-guided diffusion models and introduce a new authorship identification attack, highlighting privacy risks in current generative AI systems.

AmalREC
AmalREC: A Dataset for Relation Extraction and Classification Leveraging Amalgamation of Large Language Models
Mansi, Pranshu Pandya, Mahek Bhavesh Vora, Soumya Bharadwaj, Ashish Anand
Preprint 2024

A relation extraction dataset built by combining LLM-based and template-based generation over a 6-level relation hierarchy, with an analysis of bias and noise across relation buckets.

Sparsification and argumentative explanations
On the Impact of Sparsification on Quantitative Argumentative Explanations in Neural Networks
Daniel Peacock, Mansi, Nico Potyka, Francesca Toni, Xiang Yin
3rd International Workshop on Argumentation for eXplainable AI

We study how sparsification affects the quality and interpretability of quantitative argumentative explanations of neural networks.

Teaching Activities

Causality and Explanation in AI
Teaching Assistant, Imperial College London
Coursework and tutorial preparation.
Generative AI
Teaching Assistant, Imperial College London
Natural Language Processing
Teaching Assistant, Imperial College London
Machine Learning
Teaching Assistant, Imperial College London
Calculus and Linear Algebra
Tutor, Imperial College London

Academic Service

AAAI
Reviewer
2027
NeurIPS
Reviewer
2026
ICML
Reviewer (Gold Reviewer Award)
2026
ICLR
Reviewer
2026

Projects

Lost Child Found Application
May 2022
Flutter Android app using a face recognition REST API to help find lost children. Play Store ยท GitHub
Using AED to estimate Annotator Count
Sep 2022 โ€“ Nov 2022
Pipeline to estimate annotator counts for classification tasks using AED with DistilBERT. Report ยท GitHub
Raman โ€” The Vision Bot
Apr 2022 โ€“ May 2022
CNN-based hand-gesture recognition integrated with OpenCV and Arduino for a rock-paper-scissors game. GitHub
Live Location Tracking App
Jul 2021 โ€“ Aug 2021
Flutter app to share and monitor live locations with Google Maps API and safety alerts. GitHub
Other Projects
NanoC Compiler โ€” compiler in Flex/Bison with MIPS codegen ยท xv6 OS โ€” scheduling, locks, lazy allocation ยท ns-3 Simulation โ€” TCP over wired/wireless analysis ยท Mini Shell โ€” custom shell with pipes and utilities

Achievements

  • Departmental PhD Scholarship, Imperial College London.
  • 3rd prize at Imperial Computing Conference for work on attribute leakage.
  • India Future Leaders and Anne Seagrim Scholarships.
  • Grace Hopper Celebration Scholarship 2024 & 2025.
  • Microsoft Engage mentee; received full-time role offer.
  • Barclays Global Student Discovery Program: top 10 sophomores.
  • KVPY National Research Fellowship (AIR 219).
  • JEE Main: AIR 1 in Physics; AIR 439 overall.
  • JEE Advanced: AIR 1450.
  • ICPC: AIR 93.
  • Flipkart Grid 4.0: Top 3% among 50k+ teams.
  • National Standard Examination in Physics: top 1% nationwide.
  • Regional Mathematics Olympiad qualifier (top 5%).
  • Technothlon Silver Medalist (AIR 239).

Extracurricular

  • Poster designer โ€” examples.
  • Football โ€” Silver medal in Spardha inter-hostel championship.