How to Use Kobold AI on Janitor AI？Including Get the Kobold AI API URL
Introduction
This guide will specifically focus on KoboldAI United for JanitorAI, however the same steps should work for sites such as VenusChub and other, similar AI chatting websites.
What is Kobold AI？
KoboldAI is an AI-assisted writing tool that provides a browser-based front-end for interacting with multiple local and remote AI models. It offers a variety of features such as Memory, Author’s Note, World Info, Save & Load, adjustable AI settings, and formatting options. It also allows users to import existing AI Dungeon adventures. KoboldAI can be used in various modes, including Novel mode, Adventure mode, and Chatbot mode, offering flexibility for different types of interactions.
Why Should you use Kobold AI on Janitor AI?
While the specific reasons for using Kobold AI in Janitor AI are not explicitly mentioned in the provided links, Kobold AI’s wide range of features and flexibility could potentially make it a good choice. Its ability to interact with multiple AI models, adjust settings, and switch between different modes could provide a robust and versatile tool for use within Janitor AI. For instance, Kobold AI could be used to generate text, analyze sentiment, or perform other AI-related tasks within Janitor AI. Experience Candy AI more advanced text functions and sentiment analysis.
Learn more Janitor AI
How to Use Kobold AI on Janitor AI?
There are many ways to obtain the Janitor AI API key, but it seems that the Kobold AI API is the safest. If you are unsure how to proceed, please follow the steps below.
Step 1:
Head to this site
Click the green button called “code,” then select Download ZIP.
Step 2:
Follow this step by step. It is also provided on the github site. Do not forget to run install_requirements as Administrator. It is an essential step, as KoboldAI will need access to important parts of your system to run.
Do not close the installer until it asks you to press a key, or you will mess up the process.
Step 3:
Select the windowsbatch file “play” and open KoboldAI. Assuming everything went right, it should look something like this:
Step 4:
A page should have automatically opened on your browser. It is set to “Read Only,” meaning you can not use it to chat right now. To fix this, we will need to install Pygmalion 6B. This can be found following these steps:
- Press AI
- Chat Models
- Pygmalion 6B
DO NOT INSTALL PYGMALION 6B YET, CHECK YOUR GPU FIRST, STEP 5
It should look something like this:
Step 5:
This step is equally important. Note the ‘layers’ that you have to allocate. Pygmalion 6B uses 16GB Vram, but my GPU does not have 16GB Vram available. This is how I know I need to allocate some to my CPU. Never allocate any to your disk, leave it at zero.
If you do not know how to check your Vram, have no fear, neither did I. Follow these steps:
- On the Windows search bar, type Settings.
- Click Display.
- Click Advanced Display.
- Click Display Adapter Properties for Display 1.
- Next to Dedicated Video Memory, you’ll be told how much VRAM your graphics card has.
If this does not work for you/you cannot find it, follow these steps instead:
- On the Windows search bar, type dxdiag.
- Wait for it to open then click either Display 1 or Display 2 to view your other GPU.
- Under Display Memory, you’ll be able to see how much dedicated VRAM the GPU has.
You should see something like this:
Now mine is Dutch, but you can see the Vram. I have 12129 MB, which is 12 GB, so I therefore know I do not have enough Vram to put everything on my GPU. That is why I moved some to my CPU. I put 22 layers on my GPU and 6 on my CPU, and this is what worked for me. However, you might have to figure out what works for you.
This is definitely not easy to run for your PC, if you do not have a good PC, do not do this. KoboldAI offers services to ‘rent’ a GPU, or you can ask a friend to run a server.
Step 6:
Assuming you allocated all your layers, wait for Pygmalion 6B to be implemented. This can take a long time, but your KoboldAI window should show the progress. After you are done waiting, once again do not close the window before it’s done, the browser’s info should have changed from Read Only to something like this:
Remember, you need to reload Pygmalion every time you start the server up. Without it, the characters will not be able to generate a response.
Step 7:Find KoboldAI api Url
Close down KoboldAI’s window. I personally prefer to keep the browser running to see if everything is connected and right. It is time to start up the batchfile “remote-play.” This is where you find the link that you put into JanitorAI.
It should look something like this. Note the green lines, that’s where the link is in. I use UI 1. The link is randomly generated every time upon start-up.
Step 8:Setting the KoboldAI API URL on Janitor AI
Type the link into the KoboldAI API URL box, and press save settings.
Step 9:tarting chat
You should be connected! Have fun typing away, you heathen!
Original reference:ChipmunkUnique7988@Reddit
If you find Kobold AI API difficult to use, you can always try Janitor AI Alternatives with the same NSFW chat but no need to set up API yourself, like Pephop AI.
conclusion
This article details the detailed guide of KoboldAI API in janitor, which seems a bit difficult for AI beginners. The good news is that janitor AI is developing its own large model Janitor LLM, and janitor’s own api will be available later.