Aayush Kumar

Aayush Kumar
Aayush Kumar
Research Fellow @ Microsoft PROSE (2024 - Present)
B.Tech CSE @ Indian Institute of Technology Kanpur (2020-2024)

About

I'm a Research Fellow at the PROSE team at Microsoft, where I work on agentic AI tools for software and spreadsheet development, guided by Dr. Emerson Murphy-Hill, as well as Dr. Gustavo Soares and Dr. Sumit Gulwani. By studying interactions with such tools, I aim to understand how we can improve them to make simple and effective tools for users. I completed my bachelor's degree in Computer Science and Engineering at Indian Institute of Technology Kanpur, where I was fortunate to be advised by Prof. Sruti Ragavan. During this time, I investigated the opportunities and challenges of using LLMs for programming education.

My research interests lie at the intersection of human-AI interactions, software engineering, and programming education. I am particularly interested in exploring human-AI collaborations that improve upon the individual capabilities of both humans and AI and enrich the skill sets of users.

Publications and Pre-prints

Why AI Agents Still Need You: Findings from Developer-Agent Collaborations
in the Wild

Aayush Kumar, Yasharth Bajpai, Sumit Gulwani, Gustavo Soares, Emerson Murphy-Hill

ASE 2025 (To appear)

An empirical study to understand the strategies developers use when collaborating with AI agents on real-world tasks and the challenges to effective collaborations.

TableTalk: Scaffolding Spreadsheet Development with a Language Agent

Jenny T. Liang, Aayush Kumar, Yasharth Bajpai, Sumit Gulwani, Vu Le, Chris Parnin, Arjun Radhakrishna, Ashish Tiwari, Emerson Murphy-Hill, Guastavo Soares

ToCHI 2025

Developing and evaluating a multi-agentic AI tool that assists end-users in creating new spreadsheets.

To Google or To ChatGPT? A Comparison of CS2 Students' Information Gathering Approaches and Outcomes

Aayush Kumar, Daniel Prol, Amin Alipour, Sruti Srinivasa Ragavan

arXiv Pre-print

A mixed methods study comparing how CS2 students learn programming concepts using LLMs versus traditional online methods, examining information gathering approaches and outcomes across both scenarios.

TEN: Table Explicitization, Neurosymbolically

Nikita Mehrotra, Aayush Kumar, Sumit Gulwani, Arjun Radhakrishna, Ashish Tiwari

arXiv Pre-print

Defining and evaluating with real users a novel approach to extract tables from semi-structured input text utilizing both neurosymbolic methods as well as LLMs.

Trust in Generative AI among Students: An Exploratory Study

Matin Amoozadeh, David Daniels, Daye Nam, Aayush Kumar, Stella Chen, Michael Hilton, Sruti Srinivasa Ragavan, Mohammad Amin Alipour

SIGCSE 2024

A survey-based study examining how trust in GenAI and the factors affecting this trust influence students' adoption of GenAI and their performance in CS courses.

End-user Programming is WEIRD: How, Why and What to Do About It

Harshit Goel, Aayush Kumar, Sruti Srinivasa Ragavan

VL/HCC 2023

An analysis of the participant recruitment biases in end-user programming research and recommendations for more inclusive approaches.

Selected Projects

SoulFull

Course Project

Designed a high-fidelity prototype for an app that supports people struggling with binge eating by applying fundamental interaction design principles.

Intersectionality in Oversampling on Social Attributes

Semester Project, ML4ED Lab, EPFL

Built on the paper by Cock et al. to analyze the impact of intersectionality on different oversampling strategies for a behavioural predictive model in education.

(For Fun!) Bandersnatch

A choose-your-own-adventure style interactive game written in C++ (name inspired from a Netflix Show).

Contact