You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hi Guys, I am trying to LLM guard in our group enterprise's solution. The problem we are facing we want to make different paramters of input scanners to changed as per user request dynamically, one way to do it will reinitialize scanner on each user request which will reload the models (associated with different scanner config). But this is not going to scale up.
I am looking at something wherein we can initialize scanner only once (load model once with default config) and dynamically change the config of these scanners as per user's request. I want to know if it's at all possible to achieve this and how?
The text was updated successfully, but these errors were encountered:
Hey @nashugame , thanks for reaching out. We have received such requests multiple times. However, it will require refactoring of all scanners which we are planning eventually but it's not a priority at a given moment. Yet, we'd be happy to accept Pull Requests with suggestions on how to achieve this.
Hi Guys, I am trying to LLM guard in our group enterprise's solution. The problem we are facing we want to make different paramters of input scanners to changed as per user request dynamically, one way to do it will reinitialize scanner on each user request which will reload the models (associated with different scanner config). But this is not going to scale up.
I am looking at something wherein we can initialize scanner only once (load model once with default config) and dynamically change the config of these scanners as per user's request. I want to know if it's at all possible to achieve this and how?
The text was updated successfully, but these errors were encountered: