Silly Tavern (ST) is an AI chat platform that allows users to create and chat with AI-generated characters. Follow setup instructions for Windows/MacOS on the github page above. After installing and running the App: 1) Under the API Connections tab (plug icon), select Chat Completion, and put in the URL listed below. (Under Custom API Key, it will say Missing key, but this is okay) 2) Under AI Response Configuration (settings icon), disable streaming.
http://127.0.0.1:4315/v1