Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Virtual memory pointing value of namespace rather than pod #2421

Closed
human-77 opened this issue Nov 24, 2024 · 5 comments
Closed

Virtual memory pointing value of namespace rather than pod #2421

human-77 opened this issue Nov 24, 2024 · 5 comments
Labels
bug Something isn't working triage Issues and PRs that are needed triage

Comments

@human-77
Copy link

human-77 commented Nov 24, 2024

Description

I was creating some dashboards to monitor an instance of frontend running on a pod when I found this bizarre value for the virtual memory

# HELP frontend_process_virtual_memory_bytes Virtual memory size in bytes.
# TYPE frontend_process_virtual_memory_bytes gauge
frontend_process_virtual_memory_bytes 33012293632

Using kubectl describe ns my-namespace I got:

limits.memory                     9829Mi  30Gi
requests.cpu                      1800m   10
requests.ephemeral-storage        0       10Gi
requests.memory                   2560Mi  30Gi
requests.storage                  0       30Gi

In other words, despite running on a pod, the virtual memory is pointing the virtual memory of the WHOLE NAMESPACE

Link to the page

private site

Steps to reproduce

We are running it on a cloud using helm charts. I believe that you can simply run the pod on a namespace meant for multiple pods and the error should happen.

App version

v1.36.0

Browser

Doesn't matter in this case.

Operating system

Ubuntu docker image

Additional information

No response

@human-77 human-77 added bug Something isn't working triage Issues and PRs that are needed triage labels Nov 24, 2024
@tom2drum
Copy link
Collaborator

Hi @human-77. We use the standard prom-client library to obtain this metric. I believe a bug lies on their side, specifically in the area where the metrics are collected. In our app, we simply call the collectDefaultMetrics method from the library.

@human-77
Copy link
Author

So what should I do?

Do I open a issue there or there is already something about the issue?

@tom2drum
Copy link
Collaborator

Yes, I suggest to open a discussion/issue in the prom-client repo.

@human-77
Copy link
Author

Thank for the help!

@human-77
Copy link
Author

For anyone with the same problem, I opened a new issue HERE.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working triage Issues and PRs that are needed triage
Projects
None yet
Development

No branches or pull requests

2 participants