Agentic Research at Harvard


Intro

From May 8th to Aug 17th 2026 I was research fellow at Harvard Engineering School hosted by Prof. Flavio du Pin Calmon. I will be returning to Harvard in September for the Fall, if the CPT process doesn’t screw me up.

I would like to thank Dr. Flavio du Pin Calmon and Dr. Sajani Vithana for mentorship. I would also like to thank all my ASU collaborators, Dr. Lalitha Sankar, Dr. Oliver Kosut and Dr. Atefah Gilani for our discussions.

The research

I will have a detailed website for our work during this period soon and we are submitting to a conference (double blind), so I won’t go into details. Essentially I worked on the problem of “covert agentic communication”, where we wish to embed hidden messages into LLM generated text in “inference-time” without encoder and decoer sharing prompt or model weights. This is often referred to as “black-box” steganography. This is the same setting as the LLM watermarking problem recently got internet attention because of a post by anthropic. The main difference is that we attempt to embed multiple bits instead of a one-bit watermark, for which the “rate” of embedding is an additional metric of concern.

Such a problem has been studied under multi-bit watermarking for past year but we have been able to improve the performance of embedding by essentially two orders of magnitude, compared to the latest baseline, via information-theoretic feedback coding. On C4 dataset (across three open-weight models) with average 50 tokens, and 8-bit payload, we were able to reduce to the error from around 15% (most competitive baseline) to essentially error-free. We constructed a two-way communication protocol that identifies a new LLM security threat, that human actors may leverage independently deployed LLM agents to embed hidden messages with high rate and reliability.

The stay

I was residing on the Allston side of the campus, with a daily 4min-5min compute to work and overall I find the environment very enjoyable (pictures under media section of my website). The building I work at is the new SEAS building, which is quite empty during summer. However, my stay coincided with the world cup and the building has a massive screen broadcasting live matches, which no doubt brighten the days during some of Boston’s capiricious weather. In addition, though I didn’t have much chance to enjoy the city, I was able to meet friends of new and old. In particular, I went to see the world cup final at a bar with my friend, which is probably the highlight of my stay non-academic wise.




Enjoy Reading This Article?

Here are some more articles you might like to read next:

  • December 2024 Kansai/Kyushu/Hokkaido Travel Blog
  • General Update
  • Ibusuki and the setting sun in Kashima
  • The importance of decentralized ego
  • Yorushika Song List