[Bug] task_group_inl.h:91] _rq is full, capacity=4096

[luo985]

Search before asking

• I had searched in the issues and found no similar issues.

Version

2.1.6

What's Wrong?

通过http方式（StreamLoad）实时导入在线日志数据到doris，不定时出现导入很慢（持续几十秒）。这段时间对应的be节点/metrics接口也没反应。
be的WARNING日志中有持续出现 task_group_inl.h:91] _rq is full, capacity=4096 错误，不确定有没有关联关系

What You Expected?

解决不定时导入慢的问题

How to Reproduce?

No response

Anything Else?

No response

Are you willing to submit PR?

• Yes I am willing to submit a PR!

Code of Conduct

• I agree to follow this project's Code of Conduct

[arstercz]

I had the same issue , version-2.1.5. this error means too many bthreads, from:

https://github.com/apache/brpc/blob/4c33f886756689d6ae90905c5f0cc6fef97e90cf/src/bthread/task_group_inl.h#L91

inline void TaskGroup::push_rq(bthread_t tid) {
    while (!_rq.push(tid)) {
        // Created too many bthreads: a promising approach is to insert the
        // task into another TaskGroup, but we don't use it because:
        // * There're already many bthreads to run, inserting the bthread
        //   into other TaskGroup does not help.
        // * Insertions into other TaskGroups perform worse when all workers
        //   are busy at creating bthreads (proved by test_input_messenger in
        //   brpc)
        flush_nosignal_tasks();
        LOG_EVERY_SECOND(ERROR) << "_rq is full, capacity=" << _rq.capacity();
        // TODO(gejun): May cause deadlock when all workers are spinning here.
        // A better solution is to pop and run existing bthreads, however which
        // make set_remained()-callbacks do context switches and need extensive
        // reviews on related code.
        ::usleep(1000);
    }
}