ChatTD ๐ฌ 2.0.0 (big update / new features)
Added 2024-03-24 19:50:50 +0000 UTCI have been wanting to make UI for this operator and build out more features with the image models to allow for better template building and conversation sharing. This one has a ton of new tricks I've found for UI and tool building. Available for dotexplorer tier for now! Interested to see what/how you build + experiment + use the operator for ! ๐ฅ
More info / features:
Multi-API Support ! ๐คน
- over 120 models available in total !
- openrouter.ai, OpenAI, Groq, and LM Studio (lm studio for local inference)
- Easy API server selection, API key entry, and model choice
- "Find API Key" button for quick access to API service websites
- Stores api keys via local file within Pythonvenv folder
New fancy TD UI ! ๐๏ธ
Stream toggle ๐
- Enables per token response streaming, allowing the message to come back in chunks, instead of the entire message when finished.
- 'Interrupt Stream' toggle stops stream early
Multimodal Image Integration ๐ผ๏ธ๐
- Include images in the conversation, supporting multiple per message
- Drag and drop images onto the operator or specify TOP reference
- 'Include Chat Images' toggle allows for all images in conversation to be included (or not).
- ( Vision models only. Will get error back if model doesn't accept or may ignore.
Automatic Conversation Management ๐
- Saves in json within folder structure
- Create, save, and load conversations using dropdown menu
Other features:- Parameter UI reorganized / cleaned ๐งน
- 'Stop Phrases', 'Seed', 'Frequency Penalty', 'Presence Penalty' in Settings 2 page.
- Callbacks - onGenerate, onDone, and onError ๐คณ
- Easy Python environment setup (must have python 3.11 installed) ๐
- Monitors token count and cost (estimated / only for non streaming responses)
- Extension class for extended control / functionality ๐ฌ
plus more !
Comments
Fantastic work as always! Would it be compatible with Ollama API?
Ucodia
2024-07-01 21:51:07 +0000 UTCI recorded a intro vido. will post today if I have time to trim it !
dotsimulate
2024-03-27 19:14:17 +0000 UTCAny instructions ? TOX file ?
Comercial Aurolights
2024-03-27 17:57:10 +0000 UTCPlease, after I clicked "start stream", a terminal window popped up reporting the error "Traceback (most recent call last): File "D:\AIGC\TDAIGC\streamdiffusionTD\main_ndi.py", line 26, in Importing receive_images from utils.viewer ModuleNotFoundError: No module named 'utils'" how to solve?
ๅ ๅๆพ
2024-03-27 11:35:58 +0000 UTCThis is huge, really gotta wrap my mind around a way to utilize this. Thanks for everything you're doing for the community.
Christian Mu
2024-03-25 18:58:22 +0000 UTC