working with community python fsspec filesystem

[DeoLeung]

I encounter duckdb.duckdb.Error: AttributeError: 'int' object has no attribute 'timestamp' when using ossfs.AioOSSFilesystem

it took me quite some time to figure out what happend :(
I originally thought that was my excel file containing timestamp, not I figured out that ossfs's modified return an int instead of datetime

a quick work around will be

from datetime import datetime
from fsspec.asyn import sync_wrapper
import ossfs

class AioOSSFileSystem(ossfs.AioOSSFileSystem):

  async def _modified(self, path: str):
    """Return the modified timestamp of a file as a datetime.datetime"""
    bucket_name, obj_name = self.split_path(path)
    if not obj_name or await self._isdir(path):
      raise NotImplementedError("bucket has no modified timestamp")
    object_meta = await self._call_oss("get_object_meta",
                                       obj_name,
                                       bucket=bucket_name)
    return datetime.strptime(
        object_meta.headers["Last-Modified"],
        "%a, %d %b %Y %H:%M:%S %Z",
    )

  modified = sync_wrapper(_modified)

[Mause]

You should probably raise this as a bug in the ossfs repo?

[DeoLeung]

the repo seems a bit out of maintenance, will report to them later :)