ChatBS: An Exploratory Sandbox for Bridging Large Language Models with the Open Web
Loading...
Authors
Erickson, John S.
Santos, Henrique
McCusker, Jamie
Shirai, Sola
Hendler, James A.
McGuinness, Deborah L.
Issue Date
2024-06-17
Type
Technical Report
Language
Keywords
Alternative Title
Abstract
The recent widespread public availability of generative large language models (LLMs) has drawn much attention from the academic community to run experiments in order to learn more about their strengths and drawbacks. From prompt engineering and fine-tuning to fact-checking and task-solving, researchers have pursued several approaches to try to take advantage of these tools. As some of the most powerful LLMs are ``closed'' and only accessible through web APIs with prior authorization, combining LLMs with the open web is still a challenge. In this evolving landscape, tools that can facilitate the exploration of the capabilities and limitations of LLMs are desirable, especially when connecting with traditional web features such as search and structured data. This article presents ChatBS, a web-based exploratory sandbox for LLMs, working as a front-end for prompting LLMs with user inputs. It provides features such as entity resolution from open knowledge graphs, web search using LLM outputs, as well as popular prompting techniques (e.g. multiple submissions, ``step-by-step''). ChatBS has been extensively used in Rensselaer Polytechnic Institute's Data INCITE courses and research, serving as key tool for utilizing LLMs outputs at scale in these contexts.
Description
Full Citation
John S. Erickson, Henrique Santos, Jamie P. McCusker, Sola Shirai, Deborah L. McGuinness and James A. Hendler. 2024. ChatBS: An Exploratory Sandbox for Bridging Large Language Models with the Open Web. A Tetherless World Constellation Technical Report.
Publisher
TWC RPI