Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

New feature: Local distribution capability #129

Merged
merged 8 commits into from
Oct 30, 2024
Merged

New feature: Local distribution capability #129

merged 8 commits into from
Oct 30, 2024
+836 −16

Commits on Oct 30, 2024

  1. change codes for develop 

    update Makefile for c_engine test codes

complete test/c_module

configure test/cpp_builder

Added untracked files

add test code about data splitting

add Makefile for bmf/sdk/cpp_sdk/test

update Makefile and task.cpp

refactor code for multi node test

1.add future that bmf::builder::Graph::Decode and Encode function can set schedule through initing 2.optimize the code of test/multi_node for test

Supplement the last unsubmitted code

delete useless code

add feature that support output stream push data to multi downstream node

add feature that InputStreamManager can handle multi inputs from multi upstreams

optimize code

fix bug that two node's OSM use one static variable

add develop doc

update

fix bug that drop some frame from InputStream

fix bug that encoder couldn't handle multi video inputstreams

add pictures that missing

update doc_dev/README.md

1.add assemble_module 2.complete function for interl node init

1.complete assemble_module 2.update doc_dev/README.md

optimizer graph config if there is multi-thread node

1.Improve the optimizer processing of node multi-thread parameters 2.Implement data assemble in assemble_module 3.Implement OutputStreamManager's parent and subclass methods separately

Fixed the bug that the number of distributed node threads cannot exceed 3

1. Added split module and improved optimizer

1. Add split and aggregation modules to the engine 2. Delete some useless implementations

remove useless files

remove useless files

revert some unnecessary changes

* rename test/multi_node to test/distributed_node
* update enhance_demo.py
* update enhance_module.py
* update test_video_c_module.py

resolve conflict

restore builder.cpp and builder.hpp and cmakelist

restore input_stream_manager and builder.cpp
    @JackLau1222
    JackLau1222 committed Oct 30, 2024
    Configuration menu
    Copy the full SHA
    7665431 View commit details
    Browse the repository at this point in the history

  2. resolve conversation 

    * rename paramater "thread" to "dist_nums"
* optimize process_distributed_node()
    @JackLau1222
    JackLau1222 committed Oct 30, 2024
    Configuration menu
    Copy the full SHA
    d3355f2 View commit details
    Browse the repository at this point in the history

  3. optimize code 

    * remove SplitOutputStreamManager
* optimize distributed node test case
    @JackLau1222
    JackLau1222 committed Oct 30, 2024
    Configuration menu
    Copy the full SHA
    93675c0 View commit details
    Browse the repository at this point in the history

  4. delete useless code

    @JackLau1222
    JackLau1222 committed Oct 30, 2024
    Configuration menu
    Copy the full SHA
    d6bd621 View commit details
    Browse the repository at this point in the history

  5. Deleted output_manager related methods and modified some comments

    @JackLau1222
    JackLau1222 committed Oct 30, 2024
    Configuration menu
    Copy the full SHA
    f5b70ca View commit details
    Browse the repository at this point in the history

  6. add queue_map_ for split_module to generate extra eof_packet

    @JackLau1222
    JackLau1222 committed Oct 30, 2024
    Configuration menu
    Copy the full SHA
    203e8f6 View commit details
    Browse the repository at this point in the history

  7. * modify the implementation of split_module 

    * improve the code of optimizer
* change the BMFLOG_NODE type of split and assemble module
    @JackLau1222
    JackLau1222 committed Oct 30, 2024
    Configuration menu
    Copy the full SHA
    c9b99e1 View commit details
    Browse the repository at this point in the history

  8. * use std::queue to replace SafeQueue in queue_map_ 

    * adjust some code lines in optimizer.cpp
    @JackLau1222
    JackLau1222 committed Oct 30, 2024
    Configuration menu
    Copy the full SHA
    edfba84 View commit details
    Browse the repository at this point in the history