Skip to content

Spark 3.2: Reports bytesWritten and recordsWritten to metrics#4030

Merged
rdblue merged 1 commit into
apache:masterfrom
izchen:Spark_output_metrics_3_2
Feb 2, 2022
Merged

Spark 3.2: Reports bytesWritten and recordsWritten to metrics#4030
rdblue merged 1 commit into
apache:masterfrom
izchen:Spark_output_metrics_3_2

Conversation

@izchen
Copy link
Copy Markdown
Contributor

@izchen izchen commented Feb 2, 2022

Port of #4020 to v3.2.

output_metrics_3_2_1

output_metrics_3_2_2

@github-actions github-actions Bot added the spark label Feb 2, 2022
@izchen
Copy link
Copy Markdown
Contributor Author

izchen commented Feb 2, 2022

cc @rdblue

@rdblue rdblue merged commit ffd8787 into apache:master Feb 2, 2022
@rdblue
Copy link
Copy Markdown
Contributor

rdblue commented Feb 2, 2022

Thanks for porting this, @izchen! Great to have these working.

@izchen izchen deleted the Spark_output_metrics_3_2 branch February 2, 2022 17:00
sunchao pushed a commit to sunchao/iceberg that referenced this pull request May 9, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants