Skip to content
This repository has been archived by the owner on Apr 11, 2024. It is now read-only.

0.1.0

Latest
Compare
Choose a tag to compare
@sunank200 sunank200 released this 28 Mar 16:28

Features

  • Add UniversalTransferOperator that allows data transfers between supported source and target Datasets in Apache Airflow. The supported datasets are: File and Table. It offers a consistent agnostic interface, simplifying the users' experience, so they do not need to use specific providers or operators for transfers. #1492, #1619
  • Add transfer support for the following databases:
Databases Transfer Mode supported Pull Request
SQLite non-native, third-party #1731
Google BigQuery non-native, third-party #1732
Snowflake non-native, third-party #1735
  • Add transfer support for the following filesystems:
File stores Transfer Mode supported Pull Request
Amazon S3 non-native, third-party #1492, #1621
Local non-native, third-party #1735
Google GCS non-native, third-party #1492, #1621
SFTP non-native #1725, #1866

Docs

  • Add Sphinx documentation and update the Readme.md #1844, #29

Misc

  • Add the GitHub workflow to build docs, run pre-commit checks and run all tests as part of CI. #2, #30, #1844
  • Add Makefile to build and test locally. #1492, #5