I built a tool to help with community support. Then I kept building.
I spend a good part of my day working with the community at Copilot...
For further actions, you may consider blocking this person and/or reporting abuse
Thanks for sharing. How difficult is it to connect to Discord and start replying to support queries? My support lives in Discord, and we are a very small team but it tends to be time consuming, if I have to find the answers in the source code.
I designed it so it's only one click to connect to your Discord. This authenticates, then you choose the server you want the answerLoops bot added to, then choose the channels you want it to listen, and respond in. I'd love to get your feedback if you try it out.
I just found this, and I'm intrigued. I'm curious, If you’ve connected an AI assistant to your docs, how do you check that it’s finding the right information?
Hey James, one important detail is adding the correct info to your KB. How I validate is that I start with questions people have actually asked and check which articles come back, not just whether the generated answer sounds right. I want to make sure it's accurate.
In answerLoops, the Knowledge coverage tab runs the same lookup as the website widget, so I can see the matching articles or spot a question with no coverage. Then I review the generated reply separately: did it use that information correctly and actually answer the question?
If something’s missing, I can add the answer directly to the KB and try the question again.
Ok, so on the platform, someone can manually add to the Knowledge Source, then?
That's correct, you can manually add to the KB, so let's say someone on your team is the Product Expert, you can add notes from a meeting notetaker or just type them out, etc. Here's the docs reference: answerloops.com/docs/product/knowl...
I've been needing something like this for a while. Really appreciate the share.
I'm always worries of AI slop so when you fix an incorrect AI answer, do you have a way to make that correction useful for the next person?
Hey Luis, in AnswerLoops, automatic replies are off by default, and that's by design. I’d start by reviewing drafts against the KB and seeing how they handle actual community questions before enabling them for an integration or GitHub repo. The important part is trusting that the answer is going to be correct and accurate.
For knowledge-based replies, one agent writes the draft and a second assesses its confidence and whether it fully answers the question. The default threshold is 0.8, and both conditions have to pass. Otherwise, the draft gets escalated for human review.
That score isn’t a guarantee of correctness. I’d use the Knowledge coverage tab to check what the agent can retrieve, fix missing information, and review the resulting answers before trusting it with more automatic replies.
Ok, it sounds like it's worth giving it a shot. Can I self host it?
Yep, and bring your own LLM, even local models.
What about local LLMs - Do you support those, and if so, is it recommended?
Yes, you can use local LLMs with answerLoops. I would just do your research because the answer quality might vary if you're using a small light weight model.
Nice one, I'm definitely checking this out. I would also love to contribute.