Skip to content
This repository has been archived by the owner on Mar 24, 2021. It is now read-only.

Calculate per-day asset request stats from akamai logs and post to backdrop.

License

Notifications You must be signed in to change notification settings

alphagov/backdrop-asset-request-collector

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

24 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Backdrop asset request collector

This collector processes akamai log files to extract successful http requests for assets. By 'asset' we mean any attachment file. Something is identified as an attachment by the file extension of the file in the URL (the Content-Type header is not recorded in the akamai logs).

Akamai logs contain the following fields:

  • date: YYYY-MM-DD
  • time: HH:MM:SS
  • cs-ip: nn.nn.nn.nn
  • cs-method: {GET|POST|...}
  • cs-uri: /www-origin.production.alphagov.co.uk/government/world/organisations
  • sc-status: 200 (numerical HTTP status code [1][ref1])
  • sc-bytes: 12870 (number of bytes)
  • time-taken: 20 (time in milli seconds)
  • cs(Referer): "" (double quoted referer url)
  • cs(User-Agent): "" (double quoted user agent string)
  • cs(Cookie): "" (double quoted cookie string)
  • x-wafinfo: "" (double quoted waf status string)

The prefixes 'cs' and 'sc' refer to data flow from client->server and server->client respectively.

Of the above fields, we're interested in date, cs-method, cs-uri, sc-status.

References

  1. [ref1] Akamai Control code reference
  2. Akamai Log Delivery Service User Guide

About

Calculate per-day asset request stats from akamai logs and post to backdrop.

Topics

Resources

License

Code of conduct

Security policy

Stars

Watchers

Forks

Packages

No packages published