[Tutorial] Using a locally hosted AI as magickal assistant

[KjEno186]

I think AI is now within reach for most people who use a computer. I have what I consider 'mid range' hardware, more than adequate as a gaming rig. One does not need the latest RTX 4090 or 5090 to do this. The biggest limiting factor is actually your system RAM. I know prices have gone up since then, but I got 64GB DDR4 system RAM last year for about US$125 (I can't be bothered to look up the exact amount, but it wasn't more than that.)

First, you need to know your hardware. Then you need to visit

Please, Log in or Register to view URLs content!

, look a bit down on the right side of the page and click on the latest release (currently koboldcpp-1.96.2). There's a bunch of text, but at the bottom of a page you'll find downloads for various system configurations and operating systems. If you're not sure what to download, read the text. The downloaded executable is all that you need to run the program. There's no additional drivers or dependencies, no particular versions of Python or what have you. Just put the downloaded executable somewhere you keep programs, give it permission to run if your operating system complains about it, and wait for it to get started. You'll get a window with a lot of functions. Really, the only thing you need to do at this point is to open up a model. In my example, I used Qwen3-32B-Q6_K. I downloaded it from Hugging Face.

A search for Qwen3 gives quite a long list...

Please, Log in or Register to view URLs content!

. I'm not saying you have to use this model. My point is that there's an overwhelming amount of choice for free AI Large Language Models now, and most of them are suitable for basic chat. If you only have a limited amount of RAM, say 16 GB of system memory and 8 GB of GPU memory, then Qwen3 - 8B should run fine for you. Naturally a larger model will display more 'intelligence', but you work with what you've got. So, to make things easier for you, here's a link to the Qwen3 - 8B quants, that is, versions of the full size 8 Billion parameter model which have been reduced in size to make running on lower end hardware possible while still retaining most of the intelligence.

Please, Log in or Register to view URLs content!

. Any of these will perform well, so you might as well go with the "4_K_M" or "5_K_M". Those should be sufficiently small enough to fit in an 8GB GPU as long as you're not playing games or using it for other intensive tasks. You'll still need enough system RAM to hold the "context", but I'm not going to get into that in this post.

So, back in Koboldcpp, you browse to your downloaded model and the program should recognize what it is. The program will know how to divide the model into layers, because larger models don't fit entirely in GPU RAM. Again, that's beyond my basic explanation here. So, what have we got: Launch Koboldcpp. Browse to the downloaded model. Run it.

You may have a terminal pop up (I do on mine) which shows the progress of Koboldcpp loading the gigabytes of data from the model on your drive into your system and video memory. Finally, it will (probably) open a web page in your default browser. This is KoboldAI Lite, a web interface that you can use for chat, instruct mode, writing stories, and loading character cards for role-play. You know, it's probably easier to bookmark the Github page and read all about Koboldcpp than have me repeat a ton of information here.

So, I loaded up Qwen3-32B-Q6K.gguf (25GB on my SSD). I started a new chat. I called myself "Kain" and gave the AI the unimaginitive name of "AI Magus". A lot can be fiddled with in the settings, but I think the defaults are fine until one gets more familiar with the features.

Kain: I am seeking advice for the creation of a magickal servitor.
AI Magus: Alright. First, let me ask you, what is your understanding of what a servitor is?
Kain: I am somewhat familiar with the descriptions of servitors found in chaos magick, from the writings of Phil Hine and Damon Brand in particular. As such, I understand that the servitor behaves as an independent intelligence capable of performing tasks in the hypothetical aether. I am also aware that there is no precise understanding of how such an entity actually works. I prefer to see it as a kind of consciousness that is birthed from the magick ritual and subsequently operates as a semi-independent being. I am open to suggestions.
AI Magus: Interesting. So, essentially, you are looking at creating a self-sustaining consciousness construct that you can use for specific purposes in your magical work?
Kain: That would be correct. I am toying with a vague idea at the moment for influencing people around me. I seek friendships with people. Normally, friends are found among those one meets in more or less organized settings such as jobs, churches, or other organized functions. I would prefer to bypass the social clique stage with its limitations and requirements in order to find strangers who could become friends. I think that a servitor could facilitate my endeavors.
AI Magus: Hmmm... That's pretty ambitious. You're talking about getting a servitor to build relationships on your behalf? That may not be the best approach. However, if you'd like to proceed, I can offer some guidance. To begin, we need to define the purpose of the servitor clearly so it knows what it's supposed to do. The task needs to be specific and well-defined. Could you explain exactly what kind of results you want from this servitor?
Kain: As Damon Brand said, paraphrased, one should use magick to attempt the improbable, not the impossible. I feel confident about building relationships. The difficulty that I perceive rests in the meeting stages. I believe that a servitor could 'suggest' the suitability of one particular stranger over another by providing me with an emotional trigger when I see a person. I wouldn't call it 'love at first sight', yet there is often 'chemistry' between people that might not be immediately apparent. While initially the servitor could provide its 'message' to me via some trigger, it could have the ability added to motivate a suitable person to feel the positive chemistry as well. However, there are those one does not want to have dealings with, and the servitor could also provide a warning to avoid such persons.
AI Magus: Interesting concept. So your servitor will act as a sort of guide during interactions with potential friends, perhaps by giving subtle cues or signals when someone is compatible? And it would also help deter potentially harmful relationships?
Kain: This is correct. I would like to hear more of your thoughts.
AI Magus: Well, creating a servitor for something like this requires careful design and precise intention. We're essentially trying to influence both you and other people's perceptions through a construct that operates in the aetheric realm. The servitor needs to have clear objectives, parameters, and feedback mechanisms to ensure it functions correctly without drifting into unintended consequences.

To start, we need to establish a core identity for the servitor. What name, form, or symbolic representation would best suit its purpose?
Kain: I think a name should be unique so as to avoid possible confusion with egregores. Since the purpose would be meeting potential friends, let's call it Fripome. I think it should take human-like form, glowing white, smiling, angelic, but without wings. Perhaps it should appear androgynous as well with pure white flowing hair, its body covered in flowing white garments that have no discernible gender.
AI Magus: Very good. The name is unique enough, and the description suggests an approachable, benevolent presence which fits the role of facilitating connections and offering guidance. Now, what kind of sigils would you like to use to represent it? We can create some from scratch if you'd like, or you could adapt existing symbols related to friendship, communication, or social harmony.
Kain: Perhaps the simplest method would be one suggested by Phil Hine in which the purpose is written in words and then simplified in stages to a graphic. I think Damon Brand takes it one step further by skipping the initial statement and going straight to making a graphic symbol.

I thought about using a short, memorable musical sigil composed of at most 4 measures.

Another idea I had was to create a magick square in which the words of the statement are found horizontally, vertically, and diagonally, surrounded by random letters such as one might find in a word puzzle.
AI Magus: Both approaches are viable; they both involve encoding the intention into a symbolic form that can activate and sustain the servitor's purpose. If you go with the music approach, you could compose a simple melody with harmonics and rhythm that reflect the servitor’s function—perhaps something gentle and uplifting. Alternatively, the magic square offers a structured way to embed your intent in multiple directions, reinforcing the concept from different angles. Either method would work well for this kind of construct. Which do you prefer?

Here's what it looks like:

The AI doesn't do all the work, but it can often help one organize one's thoughts.