Are you experiencing slowness with your jobs or your jobs getting stuck in Cloud Dataflow ?
Slow/Stuck Dataflow jobs can be caused by a number of factors, but they can be investigated and solved with a handful of steps! Check out this video to learn the common reasons for Dataflow jobs getting slow or stuck along with steps to troubleshoot and resolve them.
Chapters:
0:00 – Intro
0:20 – How to identify if Dataflow job is slow or stuck
0:45 – How to use Cloud Logging for troubleshooting slow/stuck jobs
1:15 – Troubleshoot and resolve slow/stuck jobs due to workers taking long processing time
1:50 – Troubleshoot and resolve slow/stuck jobs if processing is stuck in Write Files
2:22 – Troubleshoot and resolve slow/stuck jobs due to hot key issues
3:40 – Troubleshoot and resolve slow/stuck jobs caused due to OOM errors
5:28- Troubleshooting Guide
Troubleshoot common Dataflow errors → https://goo.gle/3RmysCu
Subscribe to Google Cloud Tech → https://goo.gle/GoogleCloudTech
Duration: 00:05:43
Publisher: Google Cloud
You can watch this video also at the source.
