Skip to content

[HUDI-9270]Support displaying complete dag for update statement in spark web ui #13110

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 2 commits into from
Apr 10, 2025

Conversation

wangyinsheng
Copy link
Contributor

Change Logs

Support displaying complete dag for update statement in spark web ui

Implement steps

  • resolve input plan while analyzing UpdateTable and then convert UpdateTable to UpdateHoodieTableCommand.
  • make UpdateHoodieTableCommand extends DataWritingCommand

Before:
image

After:
image

Impact

None

Risk level (write none, low medium or high below)

None

Documentation Update

None

Contributor's checklist

  • Read through contributor's guide
  • Change Logs and Impact were stated clearly
  • Adequate tests were added if applicable
  • CI passed

@github-actions github-actions bot added the size:S PR with lines of changes in (10, 100] label Apr 8, 2025
@wangyinsheng wangyinsheng changed the title [HUDI-9270]Support displaying complete dag for update statement in spark web ui [WIP][HUDI-9270]Support displaying complete dag for update statement in spark web ui Apr 8, 2025
@wangyinsheng wangyinsheng changed the title [WIP][HUDI-9270]Support displaying complete dag for update statement in spark web ui [HUDI-9270]Support displaying complete dag for update statement in spark web ui Apr 9, 2025
@wangyinsheng
Copy link
Contributor Author

@hudi-bot run azure

@hudi-bot
Copy link

hudi-bot commented Apr 9, 2025

CI report:

Bot commands @hudi-bot supports the following commands:
  • @hudi-bot run azure re-run the last Azure build

@wangyinsheng
Copy link
Contributor Author

@danny0405 PTAL

@danny0405 danny0405 merged commit 2d28e90 into apache:master Apr 10, 2025
61 checks passed
voonhous pushed a commit to voonhous/hudi that referenced this pull request Apr 15, 2025
…park web ui (apache#13110)

* [HUDI-9270]Support displaying complete dag for update statement in spark web ui

* fix ut

---------

Co-authored-by: wangyinsheng <wangyinsheng@jd.com>
(cherry picked from commit 2d28e90)
voonhous pushed a commit to voonhous/hudi that referenced this pull request Apr 16, 2025
…park web ui (apache#13110)

* [HUDI-9270]Support displaying complete dag for update statement in spark web ui

* fix ut

---------

Co-authored-by: wangyinsheng <wangyinsheng@jd.com>
(cherry picked from commit 2d28e90)
voonhous pushed a commit to voonhous/hudi that referenced this pull request Apr 16, 2025
…park web ui (apache#13110)

* [HUDI-9270]Support displaying complete dag for update statement in spark web ui

* fix ut

---------

Co-authored-by: wangyinsheng <wangyinsheng@jd.com>
(cherry picked from commit 2d28e90)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
release-1.0.2 size:S PR with lines of changes in (10, 100]
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants