Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Web Scraping via Firebase functions #7

Open
yevkim opened this issue Aug 11, 2024 · 1 comment
Open

Web Scraping via Firebase functions #7

yevkim opened this issue Aug 11, 2024 · 1 comment
Assignees

Comments

@yevkim
Copy link
Collaborator

yevkim commented Aug 11, 2024

Refer to notebooks/master_webscraping
Expected design to run on a schedule based on schemes cases master dataset

Outcome
Update the scraped text in dataset
Provide a report for broken links

@yevkim
Copy link
Collaborator Author

yevkim commented Oct 26, 2024

Create branch from stg
Move the code to firebase function structure
Logic to work with firebase database schemes collection to read links / update scraped text
Connection firebase scheduler

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants