Somesh Singh

I am a research associate at Adobe and a PhD student in the Computer Science Department at the University at Buffalo and IIIT Delhi, advised by Prof. David Doermann and Dr. Rajiv Ratn Shah respectively. My work explores Large Language and Vision Models, reasoning, and planning through external and internal agents. My PhD is generously funded by Adobe.

My research interests lie at the intersection of human behavior and machine learning. With billions of individuals shaping our world, each life leaves a unique trajectory influenced and defined by "decisions" and randomness ultimately shaping our preferences or "behavior" towards things, people, or even ourselves. A list of works related to behavior in the wild by me and my team can be found at Behavior in the Wild.

I obtained my Bachelor's degree in Computer Science with a minor in Data Science from BITS Pilani, where I completed my thesis on digital content creation at Adobe. During this time, I also worked as a research intern at MIDAS Lab under the guidance of Dr. Rajiv Ratn Shah.

I am an avid chess player and enjoy collecting my thoughts, blueprints, and research ideas in my blog (coming soon). Also, check out the work of my frequent collaborators Harini and Yaman!

Google Scholar  /  GitHub  /  Twitter  /  LinkedIn

Loading quote...

News
  • 2025-01 Started PhD at Buffalo University and IIIT Delhi, advised by Prof. David Doermann and Dr. Rajiv Ratn Shah, funded by Adobe.
  • 2024-10 Long-Term Ad Memorability: Understanding & Generating Memorable Ads, is accepted to WACV'2025.
  • 2024-10 Released PersuasionArena, a large-scale automated leaderboard of LLMs' persuasion capabilities.
  • 2024-10 Patent on "Digital content analysis" is granted.
  • 2024-05 Released BehaviorLLaVA, training VLMs on human behavior improves performance on close to 50 tasks.
  • 2024-04 Adobe Caption Writer is released, a tool to generate social media captions in a click.
  • 2024-03 Patent on "Content analytics as part of content creation" is granted.
  • 2024-01 LCBM is accepted (Spotlight!) at ICLR'2024.
  • 2023-04 Our research on AES Systems is published in Journal of Dialogue & Discourse.
  • 2022-08 Graduated from BITS Pilani with a Bachelor's degree in Computer Science.
  • 2022-07 Joined Adobe as a research associate, working on multi-modal foundation models
  • 2022-06 MINIMAL is accepted at AAAI'2022.
Awards