Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug]: Internal Server Error, 'NoneType' object is not iterable #7695

Open
enricolucakindle opened this issue Jan 11, 2025 · 0 comments
Open
Labels
bug Something isn't working

Comments

@enricolucakindle
Copy link

What happened?

I set up LiteLLM using the coolify service.

First of all, i had to remove from the config:

service_callback: ["prometheus_system"] success_callback: # - "langfuse" - "prometheus" failure_callback: # - "langfuse" - "prometheus"'

otherwise it would log that this is an enterprise feature.

After login or when reloading the page /ui/?userID=default_user_id&page=api-keys

i receive the following error

{"error":{"message":"Internal Server Error, 'NoneType' object is not iterable","type":"internal_server_error","param":"None","code":"500"}}

Relevant log output

2025-01-11T20:08:20.576003802Z /usr/local/lib/python3.11/site-packages/pydantic/_internal/_fields.py:160: UserWarning: Field "model_max_budget" has conflict with protected namespace "model_".
2025-01-11T20:08:20.576159356Z 
2025-01-11T20:08:20.576167823Z You may be able to resolve this warning by setting `model_config['protected_namespaces'] = ()`.
2025-01-11T20:08:20.576173777Z   warnings.warn(
2025-01-11T20:08:20.583474899Z /usr/local/lib/python3.11/site-packages/pydantic/_internal/_fields.py:160: UserWarning: Field "model_id" has conflict with protected namespace "model_".
2025-01-11T20:08:20.583531934Z 
2025-01-11T20:08:20.583539177Z You may be able to resolve this warning by setting `model_config['protected_namespaces'] = ()`.
2025-01-11T20:08:20.583545305Z   warnings.warn(
2025-01-11T20:08:20.583551459Z /usr/local/lib/python3.11/site-packages/pydantic/_internal/_fields.py:160: UserWarning: Field "model_name" has conflict with protected namespace "model_".
2025-01-11T20:08:20.583557972Z 
2025-01-11T20:08:20.583564267Z You may be able to resolve this warning by setting `model_config['protected_namespaces'] = ()`.
2025-01-11T20:08:20.583572615Z   warnings.warn(
2025-01-11T20:08:20.583737430Z /usr/local/lib/python3.11/site-packages/pydantic/_internal/_fields.py:160: UserWarning: Field "model_info" has conflict with protected namespace "model_".
2025-01-11T20:08:20.583771861Z 
2025-01-11T20:08:20.583778984Z You may be able to resolve this warning by setting `model_config['protected_namespaces'] = ()`.
2025-01-11T20:08:20.583784931Z   warnings.warn(
2025-01-11T20:08:20.588325781Z /usr/local/lib/python3.11/site-packages/pydantic/_internal/_fields.py:160: UserWarning: Field "model_spend" has conflict with protected namespace "model_".
2025-01-11T20:08:20.588399352Z 
2025-01-11T20:08:20.588407648Z You may be able to resolve this warning by setting `model_config['protected_namespaces'] = ()`.
2025-01-11T20:08:20.588415179Z   warnings.warn(
2025-01-11T20:08:20.591894629Z /usr/local/lib/python3.11/site-packages/pydantic/_internal/_fields.py:160: UserWarning: Field "model_aliases" has conflict with protected namespace "model_".
2025-01-11T20:08:20.591987557Z 
2025-01-11T20:08:20.591995570Z You may be able to resolve this warning by setting `model_config['protected_namespaces'] = ()`.
2025-01-11T20:08:20.592003803Z   warnings.warn(
2025-01-11T20:08:20.636071043Z /usr/local/lib/python3.11/site-packages/pydantic/_internal/_fields.py:160: UserWarning: Field "model_group" has conflict with protected namespace "model_".
2025-01-11T20:08:20.636160182Z 
2025-01-11T20:08:20.636204093Z You may be able to resolve this warning by setting `model_config['protected_namespaces'] = ()`.
2025-01-11T20:08:20.636215541Z   warnings.warn(
2025-01-11T20:08:22.796090032Z Prisma schema loaded from schema.prisma
2025-01-11T20:08:22.803299989Z Datasource "client": PostgreSQL database "litellm", schema "public" at "postgres:5432"
2025-01-11T20:08:23.625087429Z 
2025-01-11T20:08:23.625134506Z 🚀  Your database is now in sync with your Prisma schema. Done in 617ms
2025-01-11T20:08:23.625850016Z 
2025-01-11T20:08:23.629945255Z Running generate... (Use --skip-generate to skip the generators)
2025-01-11T20:08:27.815386978Z KAKRunning generate... - Prisma Client Python (v0.11.0)
2025-01-11T20:08:28.086914887Z 
2025-01-11T20:08:28.086965754Z Some types are disabled by default due to being incompatible with Mypy, it is highly recommended
2025-01-11T20:08:28.086981290Z to use Pyright instead and configure Prisma Python to use recursive types. To re-enable certain types:
2025-01-11T20:08:28.086986025Z 
2025-01-11T20:08:28.086989719Z generator client {
2025-01-11T20:08:28.086993467Z   provider             = "prisma-client-py"
2025-01-11T20:08:28.086997348Z   recursive_type_depth = -1
2025-01-11T20:08:28.087001125Z }
2025-01-11T20:08:28.087004829Z 
2025-01-11T20:08:28.087008530Z If you need to use Mypy, you can also disable this message by explicitly setting the default value:
2025-01-11T20:08:28.087012230Z 
2025-01-11T20:08:28.087015844Z generator client {
2025-01-11T20:08:28.087019460Z   provider             = "prisma-client-py"
2025-01-11T20:08:28.087023243Z   recursive_type_depth = 5
2025-01-11T20:08:28.087026807Z }
2025-01-11T20:08:28.087030441Z 
2025-01-11T20:08:28.087034029Z For more information see: https://prisma-client-py.readthedocs.io/en/stable/reference/limitations/#default-type-limitations
2025-01-11T20:08:28.087037924Z 
2025-01-11T20:08:28.087041967Z 
2025-01-11T20:08:28.933747569Z KAK✔ Generated Prisma Client Python (v0.11.0) to ./../../prisma in 1.12s
2025-01-11T20:08:28.933982742Z 
2025-01-11T20:13:10.592989699Z {"message": "litellm.proxy.proxy_server.user_info(): Exception occured - 'NoneType' object is not iterable", "level": "ERROR", "timestamp": "2025-01-11T20:13:10.589180", "stacktrace": "Traceback (most recent call last):\n  File \"/usr/local/lib/python3.11/site-packages/litellm/proxy/management_endpoints/internal_user_endpoints.py\", line 308, in user_info\n    return await _get_user_info_for_proxy_admin()\n           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n  File \"/usr/local/lib/python3.11/site-packages/litellm/proxy/management_endpoints/internal_user_endpoints.py\", line 431, in _get_user_info_for_proxy_admin\n    for key in _keys_in_db:\nTypeError: 'NoneType' object is not iterable"}
2025-01-11T20:14:17.689034738Z {"message": "litellm.proxy.proxy_server.user_info(): Exception occured - 'NoneType' object is not iterable", "level": "ERROR", "timestamp": "2025-01-11T20:14:17.686841", "stacktrace": "Traceback (most recent call last):\n  File \"/usr/local/lib/python3.11/site-packages/litellm/proxy/management_endpoints/internal_user_endpoints.py\", line 308, in user_info\n    return await _get_user_info_for_proxy_admin()\n           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n  File \"/usr/local/lib/python3.11/site-packages/litellm/proxy/management_endpoints/internal_user_endpoints.py\", line 431, in _get_user_info_for_proxy_admin\n    for key in _keys_in_db:\nTypeError: 'NoneType' object is not iterable"}
2025-01-11T20:14:23.180509700Z {"message": "litellm.proxy.proxy_server.user_info(): Exception occured - 'NoneType' object is not iterable", "level": "ERROR", "timestamp": "2025-01-11T20:14:23.179687", "stacktrace": "Traceback (most recent call last):\n  File \"/usr/local/lib/python3.11/site-packages/litellm/proxy/management_endpoints/internal_user_endpoints.py\", line 308, in user_info\n    return await _get_user_info_for_proxy_admin()\n           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n  File \"/usr/local/lib/python3.11/site-packages/litellm/proxy/management_endpoints/internal_user_endpoints.py\", line 431, in _get_user_info_for_proxy_admin\n    for key in _keys_in_db:\nTypeError: 'NoneType' object is not iterable"}
2025-01-11T20:14:37.367931604Z {"message": "litellm.proxy.proxy_server.user_info(): Exception occured - 'NoneType' object is not iterable", "level": "ERROR", "timestamp": "2025-01-11T20:14:37.367140", "stacktrace": "Traceback (most recent call last):\n  File \"/usr/local/lib/python3.11/site-packages/litellm/proxy/management_endpoints/internal_user_endpoints.py\", line 308, in user_info\n    return await _get_user_info_for_proxy_admin()\n           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n  File \"/usr/local/lib/python3.11/site-packages/litellm/proxy/management_endpoints/internal_user_endpoints.py\", line 431, in _get_user_info_for_proxy_admin\n    for key in _keys_in_db:\nTypeError: 'NoneType' object is not iterable"}
2025-01-11T20:14:46.962502241Z {"message": "litellm.proxy.proxy_server.user_info(): Exception occured - 'NoneType' object is not iterable", "level": "ERROR", "timestamp": "2025-01-11T20:14:46.961734", "stacktrace": "Traceback (most recent call last):\n  File \"/usr/local/lib/python3.11/site-packages/litellm/proxy/management_endpoints/internal_user_endpoints.py\", line 308, in user_info\n    return await _get_user_info_for_proxy_admin()\n           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n  File \"/usr/local/lib/python3.11/site-packages/litellm/proxy/management_endpoints/internal_user_endpoints.py\", line 431, in _get_user_info_for_proxy_admin\n    for key in _keys_in_db:\nTypeError: 'NoneType' object is not iterable"}
2025-01-11T20:14:54.147430737Z {"message": "litellm.proxy.proxy_server.user_info(): Exception occured - 'NoneType' object is not iterable", "level": "ERROR", "timestamp": "2025-01-11T20:14:54.145656", "stacktrace": "Traceback (most recent call last):\n  File \"/usr/local/lib/python3.11/site-packages/litellm/proxy/management_endpoints/internal_user_endpoints.py\", line 308, in user_info\n    return await _get_user_info_for_proxy_admin()\n           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n  File \"/usr/local/lib/python3.11/site-packages/litellm/proxy/management_endpoints/internal_user_endpoints.py\", line 431, in _get_user_info_for_proxy_admin\n    for key in _keys_in_db:\nTypeError: 'NoneType' object is not iterable"}
2025-01-11T20:18:15.200670058Z {"message": "litellm.proxy.proxy_server.user_info(): Exception occured - 'NoneType' object is not iterable", "level": "ERROR", "timestamp": "2025-01-11T20:18:15.197119", "stacktrace": "Traceback (most recent call last):\n  File \"/usr/local/lib/python3.11/site-packages/litellm/proxy/management_endpoints/internal_user_endpoints.py\", line 308, in user_info\n    return await _get_user_info_for_proxy_admin()\n           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n  File \"/usr/local/lib/python3.11/site-packages/litellm/proxy/management_endpoints/internal_user_endpoints.py\", line 431, in _get_user_info_for_proxy_admin\n    for key in _keys_in_db:\nTypeError: 'NoneType' object is not iterable"}

Are you a ML Ops Team?

No

What LiteLLM version are you on ?

main-v1.57.8

Twitter / LinkedIn details

No response

@enricolucakindle enricolucakindle added the bug Something isn't working label Jan 11, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant