Databricks-sqlalchemy-Use System tables to fetch metadata

[SomanathSankara]

Current Databricks Sql Alchemy uses describe command/show schema/table to get metadata
Can we use system tables to get metadata

[kravets-levko]

Hi @SomanathSankara! Sorry, but I don't think I understand what the question is. Can you please elaborate it a bit?

[SomanathSankara]

hi @kravets-levko correct my understanding.
Currently sqlalchemy (databricks ) package is using show table comand , show columns command to get table ,column details.
Cant we use UC system table(information schema) to fetch these details which will be faster

[susodapop]

Adding some signal here: yes the system tables can be used to reflect the database schema. This would require Unity Catalog on the target instance, so it would be good to maintain a fallback to the existing SHOW TABLES behavior. But there's no technical limitation of SQLAlchemy that blocks this manner of implementation.