Move Scraper Code out of Repo

sandboxnu · Nov 1, 2023 · 44c9a3e · 44c9a3e
1 parent 57af9f6
commit 44c9a3e
Show file tree

Hide file tree

Showing 28 changed files with 7 additions and 10,486 deletions.
diff --git a/README.md b/README.md
@@ -49,6 +49,4 @@ The workspaces within this monorepo are:
 
 3. **api-client:** A typescript client responsible for providing a streamlined and typed interface to interact with our API. The frontend uses this client to send request to our API.
 
-4. **scrapers-v2**: A typescript web scraper repsonsible for scraping [Northeastern's course catalog website](https://catalog.northeastern.edu/undergraduate/) for the latest graduation requirements for majors at Northeastern.
-
-5. **common**: All common types and logic used by our frontend, api and scrapers.
+4. **common**: All common types and logic used by our frontend, api and scrapers.
diff --git a/packages/scrapers-v2/package.json b/packages/scrapers-v2/package.json
diff --git a/packages/scrapers-v2/src/classify/README.md b/packages/scrapers-v2/src/classify/README.md
diff --git a/packages/scrapers-v2/src/classify/classify.ts b/packages/scrapers-v2/src/classify/classify.ts
diff --git a/packages/scrapers-v2/src/classify/types.ts b/packages/scrapers-v2/src/classify/types.ts
diff --git a/packages/scrapers-v2/src/constants.ts b/packages/scrapers-v2/src/constants.ts
diff --git a/packages/scrapers-v2/src/main.ts b/packages/scrapers-v2/src/main.ts
diff --git a/packages/scrapers-v2/src/runtime/README.md b/packages/scrapers-v2/src/runtime/README.md
diff --git a/packages/scrapers-v2/src/runtime/axios.ts b/packages/scrapers-v2/src/runtime/axios.ts