Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Changing configuration of scanners after initializing with loading models #154

Open
nashugame opened this issue Jun 20, 2024 · 1 comment

Comments

@nashugame
Copy link

Hi Guys, I am trying to LLM guard in our group enterprise's solution. The problem we are facing we want to make different paramters of input scanners to changed as per user request dynamically, one way to do it will reinitialize scanner on each user request which will reload the models (associated with different scanner config). But this is not going to scale up.
I am looking at something wherein we can initialize scanner only once (load model once with default config) and dynamically change the config of these scanners as per user's request. I want to know if it's at all possible to achieve this and how?

@asofter
Copy link
Collaborator

asofter commented Jun 20, 2024

Hey @nashugame , thanks for reaching out. We have received such requests multiple times. However, it will require refactoring of all scanners which we are planning eventually but it's not a priority at a given moment. Yet, we'd be happy to accept Pull Requests with suggestions on how to achieve this.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants