{"id":8,"date":"2021-09-01T14:29:35","date_gmt":"2021-09-01T18:29:35","guid":{"rendered":"https:\/\/sites.temple.edu\/sancharibiswas\/?page_id=8"},"modified":"2026-10-20T11:59:20","modified_gmt":"2026-10-20T15:59:20","slug":"research","status":"publish","type":"page","link":"https:\/\/sites.temple.edu\/sancharibiswas\/research\/","title":{"rendered":"Research"},"content":{"rendered":"
\n

My research focuses on making large language model systems more trustworthy, with an emphasis on retrieval-augmented generation (RAG). I study how to test these systems for hallucination, how to evaluate the benchmarks used to measure them, and how to apply this work in high-stakes settings such as healthcare.<\/p>\n

Research Interests<\/h2>\n
<\/div>\n
\n

Trustworthy Retrieval-Augmented Generation<\/h3>\n

Methods for detecting and measuring hallucination in RAG systems, and for judging whether a system’s answers are faithful to the evidence it retrieves.<\/p>\n<\/p><\/div>\n

\n

Benchmark Evaluation and Auditing<\/h3>\n

Examining the quality, coverage and realism of the benchmarks used to evaluate language models, so that reported results reflect how systems behave in practice.<\/p>\n

Related: A Graph-Based Audit Framework for Healthcare Prompt-Response Benchmarks<\/a> (HealthCom 2026)<\/p>\n<\/p><\/div>\n

\n

Language Models for Healthcare and Public Health<\/h3>\n

Applying language models, prompt engineering and structured representations to health-related text, with attention to safety and reliability.<\/p>\n

Related: Structured Insight Generation from Mental Health Counseling Reviews<\/a> (AAAI’25 Workshop)<\/p>\n<\/p><\/div>\n

\n

Knowledge Graphs and Structured Representations<\/h3>\n

Using graph-based structure to organize, compare and audit prompts, questions and system behavior.<\/p>\n

Earlier work: Design and Implementation of a Strong Representation System for Network Policies<\/a> (ICCCN’22)<\/p>\n<\/p><\/div>\n

Current Directions<\/h2>\n
<\/div>\n

I am currently working on evaluation methods that make RAG benchmarks more representative of real user questions, particularly in medical settings, and on ways to keep such benchmarks efficient to run without losing the signal they provide.<\/p>\n

Collaboration<\/h2>\n
<\/div>\n

I am happy to discuss collaborations or questions about this work. See my publications<\/a> for papers and links.<\/p>\n<\/div>\n","protected":false},"excerpt":{"rendered":"

My research focuses on making large language model systems more trustworthy, with an emphasis on retrieval-augmented generation (RAG). I study how to test these systems for hallucination, how to evaluate the benchmarks used to measure them, and how to apply this work in high-stakes settings such as healthcare. Research Interests Trustworthy Retrieval-Augmented Generation Methods for […]<\/p>\n","protected":false},"author":29048,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-8","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/sites.temple.edu\/sancharibiswas\/wp-json\/wp\/v2\/pages\/8","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/sites.temple.edu\/sancharibiswas\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/sites.temple.edu\/sancharibiswas\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/sites.temple.edu\/sancharibiswas\/wp-json\/wp\/v2\/users\/29048"}],"replies":[{"embeddable":true,"href":"https:\/\/sites.temple.edu\/sancharibiswas\/wp-json\/wp\/v2\/comments?post=8"}],"version-history":[{"count":6,"href":"https:\/\/sites.temple.edu\/sancharibiswas\/wp-json\/wp\/v2\/pages\/8\/revisions"}],"predecessor-version":[{"id":242,"href":"https:\/\/sites.temple.edu\/sancharibiswas\/wp-json\/wp\/v2\/pages\/8\/revisions\/242"}],"wp:attachment":[{"href":"https:\/\/sites.temple.edu\/sancharibiswas\/wp-json\/wp\/v2\/media?parent=8"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}