Batch processing large data sets - scotteuser

Learn how to leverage Drupal's batch processing in a variety of ways. We will start with the basics of triggering a batch from a form. We will learn how to utilise the same code with hook update batches, via drush, via views, and even how it could be added on to a migration.

Details

This session is on how to handle batch processing for large amounts of data. You will learn how to structure your code in such a way to build your long-running task for use across the range of batch processing that Drupal Core offers. For instance, you can run a batch process

Via an admin form
On node save
View Views Bulk Operations
Off the back of a migration
Using a drush command
In an update or deploy hook

Coding together

There will be lots of code examples and talking through the code so that you can understand the logic behind it in order to be able to adapt it for your purposes and debug it easier.

We will use a real life example connecting to an external API to pull in data when triggered by an editor and on sync.