Job Scheduler

Scheduled Jobs

Because we rely on WQS as the ultimate source of truth about these institutions, we regularly repeat our queries to refresh our information. There is a WikidataQueryJob class in jobs/ that performs this work. The ‘sparql-client’ library is used to parse the request and negotiate with WQS. In production, we schedule this work to take place at night, when server loads are lower, and only refresh our data once per day.

The job scheduler can be combined with Rake tasks as a means of executing batch operations and other special tasks that would normally require server access or other privileges not available in production environments. See the lib/tasks folder for example tasks, and the scheduler config file for their automated use.