The progress of batches get stuck when uploading large data using bulk api.

[praulkar]

This has happened to me 4/4 times I've tried to upload large set of data using Bulk API (parallel mode) with a batch size of 10k. The last data load was 47k with batch size of 5k.

As you can see, it creates 10 batches and runs perfectly till batch hits around 40%-50% of processed records. Thats when the progress gets stuck and it stays like that eternally. I've waited for more than an hour after noticing on the Salesforce side that the batch had completed.

The thing thats kind of alarming is that that is happening consistently. Not sure if its just my experience of any limitation that I may have missed. But the thing is I'm not able to download the results file at all in all 4 cases (except the last batch of last load which was 2k records)

Uploading the image of the 4th execution (loading 47k records).

Please let me know in case I missed something.

Appreciate the work you guys are doing.

[paustint]

@praulkar
Can you open the javascript console and see if there are any errors there? (assuming you can load again or if you have not refreshed the page since the error)

Go to Salesforce > Setup > Bulk Load Jobs (or some similar name)
you should see all your jobs there - can you see if Salesforce shows errors on their side or what the sate is there compared to what is shown in Jetstream?
The bulk upload sends all the data to SFDC and then SFDC handles it from there - so even if it is "stuck" SFDC should keep going to completion unless there is a fatal error there.

It might be possible there is something in your data which is causing the issue - this seems likely if it is failing on both bulk and batch uploads.

[paustint]

@praulkar - I was able to load 72K without any issues - so there must be something else going on in your case.

EDIT: I looked in the logs and it appears that SFDC may have been returning an unexpected response. When trying to get the status of the job, SFDC did not return a valid response (304 not modified) - this is odd an unexpected. I will try to investigate this more

Here is a screenshot with some information.

1. In the browser network tab do you see an errors (any requests show up in red)
2. In the browser network tab, look at response (as shown in screenshot) do any errors show up there?

[praulkar]

Aah interesting.

For me, there were no errors when I looked at the job details in Salesforce end as all the batches completed successfully. Just that the jetstream app got stuck consistently around 40-50% records processed. I did not look at the console.

Let me try again once and get back to you.