Skip to content

An experiment of crawling web pages with Go and asking Chat GPT for a summary of each page after collecting some initial data, and then merging the results with Google Analytics data.

Notifications You must be signed in to change notification settings

jmbarne3/go-web-crawler

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

7 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Go Web Crawler

This project attempts to crawl a list of provided domains, merge the title, h1 and h2 values with a provided analytics export from Google Analytics, along with a generated summarization of each page from Open AI's text-davinci-003 completion model.

About

An experiment of crawling web pages with Go and asking Chat GPT for a summary of each page after collecting some initial data, and then merging the results with Google Analytics data.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages