Real click not working when scrolling is used

[AsimAM]

I am testing a video where the click on the middle of the scrubber bar is meant to be clicked by .realClick({ position: 'center' }); and test that the current time of the video has elapsed a certain amount.

However, with the inclusion of this.focusRef.current.scrollTop = 0; which scrolls the entire component, the test becomes flaky and 30-40/100 times the scrubber bar is focused but can't click be on.

Tried with:
Chrome 89
Node 12.20.1
cypress 6.8.0
cypress-real-events 1.3.0
yarn