[Backport 2.x] Change RemoteSegmentStoreDirectory init at given timestamp to ignore pinned timestamp setting

[Backport 2.x] Change RemoteSegmentStoreDirectory init at given timestamp to ignore pinned timestamp setting #35504