-
Notifications
You must be signed in to change notification settings - Fork 32
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
0514 ml usage tags #516
Open
glenrobson
wants to merge
17
commits into
master
Choose a base branch
from
0514-ml-usage-tags
base: master
Could not load branches
Branch not found: {{ refName }}
Loading
Could not load tags
Nothing to show
Loading
Are you sure you want to change the base?
Some commits from the old base branch may be removed from the timeline,
and old review comments may become outdated.
Open
0514 ml usage tags #516
Changes from all commits
Commits
Show all changes
17 commits
Select commit
Hold shift + click to select a range
aa5c1a0
Create index.md
alliomeria 647f7e1
Create manifest.json
alliomeria 6241c45
Update recipe folder to include issue number
alliomeria e0adaf2
Update manifest.json
alliomeria d166158
Update manifest.json
alliomeria 77074aa
Update index.md
alliomeria 507c140
Update index.md
alliomeria b1fcc6a
Update index.md
alliomeria 19ebd3a
Update manifest.json
alliomeria 5c93302
Update manifest.json
alliomeria 6ddfc4e
Update manifest.json
alliomeria eff85e4
Update index.md
alliomeria a5bb159
Update preview.yml
alliomeria 5b34696
Update preview.yml
alliomeria 191ec32
Update preview.yml
alliomeria 4253edc
Update index.md
alliomeria ae28788
Update index.md
alliomeria File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,117 @@ | ||
--- | ||
title: IIIF ML/AI Usage Tags Recipe | ||
id: | ||
layout: recipe | ||
tags: [rights, requiredStatement] | ||
summary: "Ethical ML/AI Use Tags for IIIF Manifests" | ||
viewers: | ||
- Mirador | ||
- UV | ||
topic: note | ||
property: rights, requiredStatement | ||
--- | ||
|
||
## Use Case | ||
|
||
Similar to the initiatives crafted by other communities of practice in efforts to limit the scraping of images and text using “noai” and “noimageai” meta HTML tags, users of the IIIF APIs may consider implementing a set of tags/statements in their IIIF manifests to help better regulate ML/AI content scraping and non-consented or attributed use of IIIF powered content in ML/AI applications. | ||
|
||
## Implementation Notes | ||
|
||
Use of these standardized ML/AI Usage tags/statements in IIIF Manifests will always need to be paired with sophisticated, up-to-date DevOps and data security practices within the context of a repository environment. | ||
|
||
Recommendation is to use a single applicable tag/statement, based on the particular concerns associated with an asset's use in ML/AI applications. | ||
|
||
### Using `rights` statement URIs sourced from Wikidata | ||
|
||
The examples shown here reference the Wikidata URIs for the different statements. As described in the [IIIF Presentation 3.0 `rights` property](https://iiif.io/api/presentation/3.0/#rights), URIs should be sourced from Creative Commons or RightsStatements.org. For URIs that do not reference either of these sources, the [`extensions`](https://iiif.io/api/presentation/3.0/#46-linked-data-context-and-extensions) mechanism using a source found in one of the [IIIF Registry of Known Extensions](https://iiif.io/api/registry/) can also be used. Wikidata is included in the [Profiles Registry](https://iiif.io/api/registry/profiles/). | ||
|
||
Please see the [goals statement on Stable URIs Development and Maintenance in the Ethical ML/AI Usage Tags Project Repository](https://github.com/alliomeria/ethical_ml_usage_tags/blob/main/README.md#stable-uris-development-and-maintenance) for information about the longer term plans regarding related URIs. When those stable URIs are finalized, a proposal will be made to add to the [Rights Registry](https://iiif.io/api/registry/rights/). | ||
|
||
Aside from providing a link reference which typically leads to a static webpage that describes a license/statement in greater detail, a machineable outcome of the usage of Creative Commons or RightsStatement.org URIs within the `rights` property is the display of the corresponding license/statement icon or badge within one of the standard IIIF viewers (as shown in the example below). In the future, there may be ways to extend the machineable outcomes associated with these ML/AI Usage tags/statements (or other `rights` values) in ways that direct responses to machine-mediated interactions. | ||
|
||
#### For machines, within [`rights`](https://iiif.io/api/presentation/3.0/#rights) | ||
|
||
* No AI | ||
|
||
```JSON | ||
{ "rights": "https://www.wikidata.org/wiki/Q127515163" } | ||
``` | ||
|
||
* No Image AI | ||
|
||
```JSON | ||
{ "rights": "https://www.wikidata.org/wiki/Q127516405" } | ||
``` | ||
|
||
* Regulated ML/AI Use Permitted - Attribution Required | ||
|
||
```JSON | ||
{ "rights": "https://www.wikidata.org/wiki/Q127516763" } | ||
``` | ||
|
||
* Regulated ML/AI Use Permitted - Consent Required | ||
|
||
```JSON | ||
{ "rights": "https://www.wikidata.org/wiki/Q127518037" } | ||
``` | ||
|
||
#### For humans (public display), within [`requiredStatement`](https://iiif.io/api/presentation/3.0/#requiredstatement) | ||
|
||
```JSON | ||
{ | ||
"requiredStatement": { | ||
"label": { "en": [ "No AI" ] }, | ||
"value": { "en": [ "Material related to this Digital Object should not be used for AI or ML training datasets." ] } | ||
} | ||
} | ||
``` | ||
```JSON | ||
{ | ||
"requiredStatement": { | ||
"label": { "en": [ "No Image AI" ] }, | ||
"value": { "en": [ "Image-based material related to this Digital Object should not be used for AI or ML training datasets." ] } | ||
} | ||
} | ||
``` | ||
```JSON | ||
{ | ||
"requiredStatement": { | ||
"label": { "en": [ "Regulated ML/AI Use Permitted - Attribution Required" ] }, | ||
"value": { "en": [ "material related to this Digital Object may be used for AI or ML training datasets, as long as Standard Attribution of source Digital Object Title and URL is maintained and referenced publicly for the ML/AI dataset." ] } | ||
} | ||
} | ||
``` | ||
```JSON | ||
{ | ||
"requiredStatement": { | ||
"label": { "en": [ "Regulated ML/AI Use Permitted - Consent Required" ] }, | ||
"value": { "en": [ "Material related to this Digital Object may be used for AI or ML training datasets, if Prior Written Consent is obtained from the Source Holding Institution and Standard Attribution is maintained and referenced publicly." ] } | ||
} | ||
} | ||
``` | ||
|
||
#### Additional Considerations | ||
|
||
* Simple use cases (apply per manifest) versus complex uses casses (apply per item/canvas) | ||
|
||
* IIIF is an API based framework, geared to machine mediated interactions but: **IIIF resources are for humans** | ||
|
||
* As we, professionally and personally, decide to use or integrate ML/AI tools into our repositories, we need to keep in mind our curatorial legacies and the complex nature of our own content. | ||
|
||
* ML/AI technology will continue to shift over time and require diligent application and monitoring, for the rest of our professional lives. | ||
|
||
## Restrictions | ||
|
||
No known restrictions. | ||
|
||
## Example | ||
|
||
The [IIIF 3.0 Specs](https://iiif.io/api/presentation/3.0/) restrict `rights` to a single value string format, and `requiredStatement` to a single value JSON Object. The example shown below uses a singe applicable ML/AI Usage statement Wikidata URI in `rights`, paired with a set of two human-readable `value` statements (one for ML/AI usage and one for a standard Creative Commons reference) in `requiredStatement` (structured as a single JSON object). | ||
|
||
{% include manifest_links.html manifest="manifest.json" %} | ||
|
||
{% include jsonviewer.html src="manifest.json" config='data-line="15-28"' %} | ||
|
||
## Related Recipes | ||
|
||
* [Rights][0008] for demonstrating use of `rights` and `requiredStatement` |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,67 @@ | ||
{ | ||
"@context": [ | ||
"http://iiif.io/api/presentation/3/context.json" | ||
], | ||
"id": "{{ id.url }}", | ||
"type": "Manifest", | ||
"label": { | ||
"en": [ | ||
"Picture of Göttingen taken during the 2019 IIIF Conference" | ||
] | ||
}, | ||
"summary": { | ||
"en": [ | ||
"<p>Picture taken by the <a href=\"https://github.com/glenrobson\">IIIF Technical Coordinator</a></p>" | ||
] | ||
}, | ||
"rights": "https://www.wikidata.org/wiki/Q127518037", | ||
"requiredStatement": { | ||
"label": { | ||
"en": [ | ||
"Regulated ML/AI Use Permitted - Consent Required" | ||
] | ||
}, | ||
"value": { | ||
"en": [ | ||
"Material related to this Digital Object may be used for AI or ML training datasets, if Prior Written Consent is obtained from the Source Holding Institution and Standard Attribution is maintained and referenced publicly.", | ||
"Attribution: <span>Glen Robson, IIIF Technical Coordinator. <a href=\"https://creativecommons.org/licenses/by-sa/3.0\">CC BY-SA 3.0</a> <a href=\"https://creativecommons.org/licenses/by-sa/3.0\" title=\"CC BY-SA 3.0\"><img src=\"https://licensebuttons.net/l/by-sa/3.0/88x31.png\"/></a></span>" | ||
] | ||
} | ||
}, | ||
"items": [ | ||
{ | ||
"id": "{{ id.path }}/canvas/p1", | ||
"type": "Canvas", | ||
"height": 3024, | ||
"width": 4032, | ||
"items": [ | ||
{ | ||
"id": "{{ id.path }}/page/p1/1", | ||
"type": "AnnotationPage", | ||
"items": [ | ||
{ | ||
"id": "{{ id.path }}/annotation/p0001-image", | ||
"type": "Annotation", | ||
"motivation": "painting", | ||
"body": { | ||
"id": "https://iiif.io/api/image/3.0/example/reference/918ecd18c2592080851777620de9bcb5-gottingen/full/max/0/default.jpg", | ||
"type": "Image", | ||
"format": "image/jpeg", | ||
"height": 3024, | ||
"width": 4032, | ||
"service": [ | ||
{ | ||
"id": "https://iiif.io/api/image/3.0/example/reference/918ecd18c2592080851777620de9bcb5-gottingen", | ||
"profile": "level1", | ||
"type": "ImageService3" | ||
} | ||
] | ||
}, | ||
"target": "{{ id.path }}/canvas/p1" | ||
} | ||
] | ||
} | ||
] | ||
} | ||
] | ||
} |
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Cool!