Skip to content

Save information about your GitHub starred repos into Google Sheets, Zinc, and SQLite!

License

Notifications You must be signed in to change notification settings

bbkane/starghaze

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

72 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

stargaze

Save information about your GitHub starred repos into Google Sheets, Zinc, and SQLite!

Thanks to https://github.com/yks0000/starred-repo-toc for the inspiration!

GraphQL and Google Sheets auth notes at ./dev_notes.md

Install

scoop bucket add bbkane https://github.com/bbkane/scoop-bucket
scoop install bbkane/starghaze
  • Download Mac/Linux/Windows executable: GitHub releases
  • Go: go install go.bbkane.com/starghaze@latest
  • Build with goreleaser after cloning: goreleaser --snapshot --skip-publish --rm-dist

Download GitHub Stars

Download Star Info

GITHUB_TOKEN=my_github_token starghaze download \
    --include-readmes true \
    --output stars.jsonl

Google Sheets

Format Downloaded Stars as CSV

starghaze format \
    --format csv \
    --include-readmes false \
    --output stars.csv

Upload CSV to Google Sheets

GOOGLE_APPLICATION_CREDENTIALS=/path/to/keys.json starghaze gsheets upload \
    --csv-path stars.csv \
    --sheet-id 0 \
    --spreadsheet-id 15AXUtql31P62zxvEnqxNnb8ZcCWnBUYpROAsrtAhOV0 \
    --timeout 30s

Analyze Away!

Click here to see My GitHub Stars Google Sheet

star-count-over-time.png

Save Stars to Zinc

Format Downloaded Stars as Zinc

starghaze format \
    --include-readmes true \
    --format zinc \
    --output stars.zinc \
    --zinc-index-name starghaze

Upload to Zinc

Using default settings - See Zinc repo for more details.

curl http://localhost:4080/api/_bulk -i -u admin:Complexpass#123 --data-binary "@stars.zinc"

Search!

starghaze-zinc.png

SQLite

Format Downloaded Stars to SQLite (with full text search)

starghaze format \
    --format sqlite \
    --include-readmes true \
    --sqlite-dsn starghaze.db

Query!

For example, find the top 10 languages (as measured by number of repos) in the starred collection.

$ sqlite3 starghaze.db '
SELECT
    l.Name ,
    COUNT(lr.Language_id) as Repo_Count
FROM
    Language_Repo lr JOIN Language l ON lr.Language_id = l.id
GROUP BY Language_id
ORDER BY Repo_Count DESC
LIMIT 10
'
-- Loading resources from /Users/bbkane/.sqliterc
┌────────────┬────────────┐
│    Name    │ Repo_Count │
├────────────┼────────────┤
│ Shell      │ 939        │
│ JavaScript │ 617        │
│ HTML       │ 598        │
│ Python     │ 540        │
│ Makefile   │ 519        │
│ CSS        │ 432        │
│ Dockerfile │ 403        │
│ Go         │ 367        │
│ C          │ 305        │
│ C++        │ 230        │
└────────────┴────────────┘