Skip to content
This repository has been archived by the owner on Apr 11, 2024. It is now read-only.

Latest commit

 

History

History
47 lines (35 loc) · 4.54 KB

File metadata and controls

47 lines (35 loc) · 4.54 KB

Changelog

0.1.0

Features

  • Add UniversalTransferOperator that allows data transfers between supported source and target Datasets in Apache Airflow. The supported datasets are: File and Table. It offers a consistent agnostic interface, simplifying the users' experience, so they do not need to use specific providers or operators for transfers. #1492 , #1619
  • Add transfer support for the following databases:
Databases Transfer Mode supported Pull Request
SQLite non-native, third-party #1731
Google BigQuery non-native, third-party #1732
Snowflake non-native, third-party #1735
  • Add transfer support for the following filesystems:
File stores Transfer Mode supported Pull Request
Amazon S3 non-native, third-party #1492, #1621
Local non-native, third-party #1735
Google GCS non-native, third-party #1492, #1621
SFTP non-native #1725, #1866

Docs

  • Add Sphinx documentation and update the Readme.md #1844 , #29

Misc

  • Add the GitHub workflow to build docs, run pre-commit checks and run all tests as part of CI. #2 , #30 , #1844
  • Add Makefile to build and test locally. #1492 , #5