AI4Trust Data Collectors

This repository contains a set of components to collect data from social media.

Folders

iceberg-config: Configuration files for configuring Kafka Connect, Nessie and Iceberg.
youtube-collector: This repository contains a pipeline to collect metadata, comments, thumbnails, transcription and search of YouTube videos by receiving a Video_ID.
news-collector This repository contains a pipeline to collect news articles.

Name		Name	Last commit message	Last commit date
Latest commit History 62 Commits
doc		doc
iceberg-config		iceberg-config
imgs		imgs
news-collector		news-collector
youtube-collector		youtube-collector
.gitignore		.gitignore
README.md		README.md