I would use an orchestrator like Apache Airflow th...
# general
d
I would use an orchestrator like Apache Airflow that periodically (e.g. every hour) extracts data from TimescaleDB, converts it to parquet and writes it to the data lake. I quickly checked what's in the TimescaleDB and Azure docs and they have two articles about integrating Azure with TimescaleDB: Quickstart: Use Azure Data Studio to connect and query Managed Service for TimescaleDB on Azure: https://learn.microsoft.com/en-us/azure-data-studio/quickstart-timescaledb Connect to Timescale using Azure Data Studio: https://docs.timescale.com/use-timescale/latest/integrations/query-admin/azure-data-studio/