Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Support for Selective Playback of Topics with Mixed Serialization Formats in MCAP Files #1847

Open
jespersmith opened this issue Oct 31, 2024 · 2 comments
Labels
enhancement New feature or request help wanted Extra attention is needed

Comments

@jespersmith
Copy link

Summary

When logging data with a custom logger, I store both ROS2 data and additional custom data in MCAP files. Currently, attempting to play back these files with ros2 bag play results in an error due to mixed serialization formats. It would be useful if we could selectively play back compatible topics without encountering this issue.

Current Behavior

Attempting playback with ros2 bag play returns the error:

"Topics with different RMW serialization formats have been found. All topics must have the same serialization format."

Even if specific topics are specified with the --topics flag, ros2 bag play checks all topics, rather than just those specified.

Desired Behavior

  1. Ignore topics with unknown serialization formats: ros2 bag play should play back topics with compatible formats (like cdr) and skip topics with unknown formats.
  2. Selective topic playback: When specific topics are listed with the --topics flag, only these topics should be validated and played back, ignoring the others.

Completion Criteria

  • The solution should allow for playback of compatible topics without errors.
  • Topics specified with --topics should be the only ones validated for serialization format.

Suggested Implementation

  1. Option 1: Update mcap_storage.cpp to generate metadata only for topics with "known" formats, ensuring playback compatibility.

    • Note: This approach may need updates if new formats are introduced in the future.
  2. Option 2: Modify the behavior of the --topics flag in ros2 bag play to validate only the specified topics.

Testing

  1. Generate an MCAP file with a mix of valid cdr messages and messages in an unknown format.
  2. Confirm that ros2 bag play:
    • Ignores unknown formats and plays compatible data.
    • Plays only specified topics when using the --topics flag, without checking non-specified topics.
@jespersmith jespersmith added the enhancement New feature or request label Oct 31, 2024
@fujitatomoya
Copy link
Contributor

IMO this sounds reasonable and more reliable behavior.

Ignore topics with unknown serialization formats: ros2 bag play should play back topics with compatible formats (like cdr) and skip topics with unknown formats.

probably it should not ignore, but it can print the warning that this topic data is unknown serialization formats or something like that.

@MichaelOrlov
Copy link
Contributor

I agree that it is nice to have feature/behavior.
As regards the implementation proposal. It should be generic and not specific to some storage plugin.
Therefore only option 2 is valid in this case.

  1. Option 2: Modify the behavior of the --topics flag in ros2 bag play to validate only the specified topics.

PRs are welcome.

@MichaelOrlov MichaelOrlov added the help wanted Extra attention is needed label Oct 31, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request help wanted Extra attention is needed
Projects
None yet
Development

No branches or pull requests

3 participants