Skip to content

g29times/llm-web

Repository files navigation

A safetensor format RAG System with WebUI

Using:
vLLM + LlamaIndex + Streamlit

Layer:
streamlit-rounds call ->
restllm call ->
llamaindex-rag call ->
vLLM

Use: pip install streamlit
streamlit run .\streamlit.py

About

web server for llm

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages