-
Notifications
You must be signed in to change notification settings - Fork 2.9k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
feat(ingest): support view lineage for all sqlalchemy sources #9039
Merged
hsheth2
merged 9 commits into
datahub-project:master
from
mayurinehate:master+ing-200-view-lineage-for-sql-sources
Oct 26, 2023
Merged
feat(ingest): support view lineage for all sqlalchemy sources #9039
hsheth2
merged 9 commits into
datahub-project:master
from
mayurinehate:master+ing-200-view-lineage-for-sql-sources
Oct 26, 2023
Commits on Oct 19, 2023
-
feat(ingest): support view lineage for all sqlalchemy sources
Additional Changes: 1. Support incremental lineage for all sqlalchemy sources 2. Keep column level lineage enabled and incremental lineage disabled by default 3. Monkey-patch hive dialect to extract hive view definitions to extract lineage 4. Fix incremental_lineage_helper for empty upstreams Pending Followup Changes: 1. Support postgres-like partial view definitions
Configuration menu - View commit details
-
Copy full SHA for 75f63a2 - Browse repository at this point
Copy the full SHA 75f63a2View commit details
Commits on Oct 20, 2023
-
revert incremental lineage helper refractor to source.py
- primarily to reduce adverse effect on other sources, such as dbt which have their own flavour of incremental lineage implementation
Configuration menu - View commit details
-
Copy full SHA for 93b7ba1 - Browse repository at this point
Copy the full SHA 93b7ba1View commit details
Commits on Oct 23, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 7c18697 - Browse repository at this point
Copy the full SHA 7c18697View commit details
Commits on Oct 25, 2023
-
Configuration menu - View commit details
-
Copy full SHA for bf4ecb5 - Browse repository at this point
Copy the full SHA bf4ecb5View commit details
Commits on Oct 26, 2023
-
feat(ingest): support view lineage extraction for postgres, trino
fallback to native postgres view lineage extraction for failed views
Configuration menu - View commit details
-
Copy full SHA for b74e794 - Browse repository at this point
Copy the full SHA b74e794View commit details -
Configuration menu - View commit details
-
Copy full SHA for 337ca34 - Browse repository at this point
Copy the full SHA 337ca34View commit details -
Configuration menu - View commit details
-
Copy full SHA for e60a7f4 - Browse repository at this point
Copy the full SHA e60a7f4View commit details -
Configuration menu - View commit details
-
Copy full SHA for 1fe4b02 - Browse repository at this point
Copy the full SHA 1fe4b02View commit details -
Configuration menu - View commit details
-
Copy full SHA for c5ca9b2 - Browse repository at this point
Copy the full SHA c5ca9b2View commit details
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.