I am a research associate at Adobe MDSR Labs and a PhD student in the Computer Science Department at the University at Buffalo and IIIT Delhi, advised by Prof. David Doermann and Dr. Rajiv Ratn Shah respectively. My work explores Large Language and Vision Models, reasoning, and planning through external and internal agents.
My research interests lie at the intersection of human behavior and machine learning. With billions of individuals shaping our world, each life leaves a unique trajectory influenced and defined by "decisions" and randomness ultimately shaping our preferences or "behavior" towards things, people, or even ourselves. A list of works related to behavior in the wild by me and my team can be found at Behavior in the Wild.
I obtained my Bachelor's degree in Computer Science with a minor in Data Science from BITS Pilani, where I completed my thesis on digital content creation at Adobe. During this time, I also worked as a research intern at MIDAS Lab under the guidance of Dr. Rajiv Ratn Shah.
I am an avid chess player and enjoy collecting my thoughts, blueprints, and research ideas in my blog (coming soon). Also, check out the work of my frequent collaborators Harini and Yaman!
"I couldn't help wondering was my beloved game of chess over --- It turned that the world still wanted a human champion"
News
- 2025-01 Behavior-LLaVA and Transsuasion are accepted to ICLR'25.
- 2025-01 Started PhD at Buffalo University and IIIT Delhi, advised by Prof. David Doermann and Dr. Rajiv Ratn Shah, funded by Adobe.
- 2024-10 Long-Term Ad Memorability: Understanding & Generating Memorable Ads, is accepted to WACV'2025.
- 2024-10 Released PersuasionArena, a large-scale automated leaderboard of LLMs' persuasion capabilities.
- 2024-10 Patent on "Digital content analysis" is granted.
- 2024-05 Released BehaviorLLaVA, training VLMs on human behavior improves performance on close to 50 tasks.
- 2024-04 Adobe Caption Writer is released, a tool to generate social media captions in a click.
- 2024-03 Patent on "Content analytics as part of content creation" is granted.
- 2024-01 LCBM is accepted (Spotlight!) at ICLR'2024.
- 2023-04 Our research on AES Systems is published in Journal of Dialogue & Discourse.
- 2022-08 Graduated from BITS Pilani with a Bachelor's degree in Computer Science.
- 2022-07 Joined Adobe as a research associate, working on multi-modal foundation models
- 2022-06 MINIMAL is accepted at AAAI'2022.
Research
Somesh Singh*, Harini S I*, Yaman K Singla*, Veeky Baths, Rajiv Ratn Shah, Changyou Chen, Balaji Krishnamurthy
ICLR'25
Somesh Singh*, Yaman K Singla*, Harini SI*, Balaji Krishnamurthy
ICLR'25
Harini SI*, Somesh Singh*, Yaman K Singla*, Aanisha Bhattacharyya, Veeky Baths, Changyou Chen, Rajiv Ratn Shah, Balaji Krishnamurthy
WACV'25
Ashmit Khandelwal, Aditya Agrawal, Aanisha Bhattacharyya, Yaman Kumar, Somesh Singh, Uttaran Bhattacharya, Ishita Dasgupta, Stefano Petrangeli, Rajiv Ratn Shah, Changyou Chen, Balaji Krishnamurthy
ICLR'24
Yaman K Singla*, Swapnil Parekh*, Somesh Singh*, Junyi Jessy Li, Rajiv Ratn Shah, Changyou Chen
Journal of Dialogue & Discourse
Yaman K Singla*, Somesh Singh*, Swapnil Parekh*, Balaji Krishnamurthy, Rajiv Ratn Shah, Changyou Chen
AAAI'22
Awards
PI: Aatmaprem Arya Employee: Somesh Singh
CIQ