Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

写入一些图之后,偶尔会出现KvException: Cannot allocate memory报错 #310

Closed
weester-yan opened this issue Oct 24, 2023 · 7 comments

Comments

@weester-yan
Copy link

使用tugraph3.4.0版本的容器,长期使用写入多份图数据后,可能会在某一次写入图时,报错
v9ZEP5CoLD

猜测可能是系统资源问题,但实际上资源比较充足:
8gPM47tMXb

写入tugraph的操作是使用的python的client:
TuGraphClient

当前临时解决方法是,将挂载的数据目录切换成新的空目录(相当于清理了之前的所有图数据),就可以正常写入了
image

环境:

  • OS: Ubuntu 18.04
  • docker:20.10.19
  • tugraph: 3.4.0
@knightast
Copy link
Contributor

knightast commented Oct 24, 2023

看起来像是那里内存泄露了,3.6.0整体修过一遍 链接

方便复现么,升到最新的试试?现在版本已经到4.0.1了 链接

@knightast
Copy link
Contributor

试下64个子图是否会出错

@knightast
Copy link
Contributor

在最新4.0.1的master上,尝试在UT,在多次lgraph_import时偶现过一次kv:execption,就再也没有复现过
Screenshot 2023-11-06 at 18 04 37

你那边还能复现么?有没存在多个正在访问的lgraph_server?

@knightast
Copy link
Contributor

大致弄清楚了,每开一个子图,会mmap一个1TB大小的db文件,mmap总空间是有限制的,所以一个开100多个db就会报错,如果其他地方也有比较多的mmap,那么会提前报错。

后续的方案应该是默认db的mmap大小可配,如果都是小图,就配的小点,能用更多的图。

@knightast
Copy link
Contributor

linux的mmap总共最大值的一个典型数是128TB,不同os可能不同,在tugraph里配置为最大的db_size,可后期修改。

注:修改的时候会重启单个db。

@qishipengqsp
Copy link
Collaborator

该问题已修复。将关闭此Issue,如有问题请重开

@qishipengqsp
Copy link
Collaborator

The issue is closed due to inactivity. Please feel free to create a new one if you have more questions. And please star this repo if you find it useful! Thanks!
此issue由于长期不活跃被关闭。如有任何问题,可另开 issue 并提供更多信息。如果这个项目帮助到你,可以在仓库右上角 star 一下,感谢你的支持!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants