-
Notifications
You must be signed in to change notification settings - Fork 36
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
fix(readme) update directory structure to avoid confusion of week-05 …
…meeting notes.
- Loading branch information
1 parent
de304d1
commit e8733ae
Showing
4 changed files
with
126 additions
and
118 deletions.
There are no files selected for viewing
110 changes: 55 additions & 55 deletions
110
docs/2024/scheduler/updates/2024-06-07.md → ...cheduler/updates/Discussion/2024-06-07.md
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1,56 +1,56 @@ | ||
--- | ||
title: OVERHAULING SCHEDULER DESIGN (Discussion) | ||
author: Aaditya Singh | ||
--- | ||
<!-- | ||
SPDX-License-Identifier: CC-BY-SA-4.0 | ||
SPDX-FileCopyrightText: 2024 Aaditya Singh <singh.aaditya889@gmail.com> | ||
--> | ||
|
||
# Meeting 8 | ||
|
||
*(June 07, 2024)* | ||
|
||
## Attendees | ||
|
||
- [Katharina Ettinger](https://github.com/EttingerK) | ||
- [Shaheem Azmal M MD](https://github.com/shaheemazmalmmd) | ||
- [Gaurav Mishra](https://github.com/GMishx) | ||
- [Kaushlendra Pratap](https://github.com/Kaushl2208) | ||
- [Avinal](https://github.com/avinal) | ||
- [Aaditya Singh](https://github.com/Aaditya-Singh78) | ||
|
||
## Discussion | ||
|
||
**Contributors**: | ||
|
||
- [Aaditya Singh](https://github.com/Aaditya-Singh78): Discussing integration and implementation strategies for the new scheduler design. | ||
|
||
![architecture-version: 02](../asset/arch_ver.02.png) | ||
|
||
It consists of a sophisticated job scheduling system that leverages Go's powerful concurrency features to efficiently manage tasks across two *primary queues*: | ||
|
||
1. Dependent Queue | ||
2. Independent Queue | ||
|
||
Each queue is managed by a dedicated Global Go-Routine, which orchestrates the distribution and execution of tasks among multiple subordinate Go-Routines. These Go-Routines operate in parallel, each managing its own set of threads to ensure tasks are executed concurrently, *maximising throughput* & *minimising response time*. | ||
|
||
**Key Components:** | ||
|
||
- *Database*: Central storage for all job-related data, ensuring durability and consistency across job executions. | ||
|
||
- *Dependent Queue*: Manages jobs that depend on the completion of other jobs, ensuring correct execution order. | ||
|
||
- *Independent Queue*: Handles jobs that can be executed independently, allowing for simultaneous processing and improved efficiency. | ||
|
||
- *Logging*: Each thread incorporates logging to track job execution, facilitating debugging and system monitoring. | ||
|
||
- *Termination*: Ensures all tasks are either completed or properly terminated before system shutdown, maintaining system integrity. | ||
|
||
**Mentors**: | ||
|
||
- [Shaheem Azmal M MD](https://github.com/shaheemazmalmmd): Questioned whether priority can be implemented in both dependent and independent queues effectively. | ||
|
||
- [Gaurav Mishra](https://github.com/GMishx): Highlighted considerations for ensuring mutual exclusivity either across dependent or independent queues, with a focus on execution rules and limitations. | ||
|
||
--- | ||
title: week-05 | ||
author: Aaditya Singh | ||
--- | ||
<!-- | ||
SPDX-License-Identifier: CC-BY-SA-4.0 | ||
SPDX-FileCopyrightText: 2024 Aaditya Singh <singh.aaditya889@gmail.com> | ||
--> | ||
|
||
# Meeting 8 | ||
|
||
*(June 07, 2024)* | ||
|
||
## Attendees | ||
|
||
- [Katharina Ettinger](https://github.com/EttingerK) | ||
- [Shaheem Azmal M MD](https://github.com/shaheemazmalmmd) | ||
- [Gaurav Mishra](https://github.com/GMishx) | ||
- [Kaushlendra Pratap](https://github.com/Kaushl2208) | ||
- [Avinal](https://github.com/avinal) | ||
- [Aaditya Singh](https://github.com/Aaditya-Singh78) | ||
|
||
## Discussion | ||
|
||
**Contributors**: | ||
|
||
- [Aaditya Singh](https://github.com/Aaditya-Singh78): Discussing integration and implementation strategies for the new scheduler design. | ||
|
||
![architecture-version: 02](../../asset/arch_ver.02.png) | ||
|
||
It consists of a sophisticated job scheduling system that leverages Go's powerful concurrency features to efficiently manage tasks across two *primary queues*: | ||
|
||
1. Dependent Queue | ||
2. Independent Queue | ||
|
||
Each queue is managed by a dedicated Global Go-Routine, which orchestrates the distribution and execution of tasks among multiple subordinate Go-Routines. These Go-Routines operate in parallel, each managing its own set of threads to ensure tasks are executed concurrently, *maximising throughput* & *minimising response time*. | ||
|
||
**Key Components:** | ||
|
||
- *Database*: Central storage for all job-related data, ensuring durability and consistency across job executions. | ||
|
||
- *Dependent Queue*: Manages jobs that depend on the completion of other jobs, ensuring correct execution order. | ||
|
||
- *Independent Queue*: Handles jobs that can be executed independently, allowing for simultaneous processing and improved efficiency. | ||
|
||
- *Logging*: Each thread incorporates logging to track job execution, facilitating debugging and system monitoring. | ||
|
||
- *Termination*: Ensures all tasks are either completed or properly terminated before system shutdown, maintaining system integrity. | ||
|
||
**Mentors**: | ||
|
||
- [Shaheem Azmal M MD](https://github.com/shaheemazmalmmd): Questioned whether priority can be implemented in both dependent and independent queues effectively. | ||
|
||
- [Gaurav Mishra](https://github.com/GMishx): Highlighted considerations for ensuring mutual exclusivity either across dependent or independent queues, with a focus on execution rules and limitations. | ||
|
||
- [Kaushlendra Pratap](https://github.com/Kaushl2208): Inquired about how goroutines can achieve both concurrency and parallelism, and whether they should operate synchronously or asynchronously. |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,4 @@ | ||
{ | ||
"label": "Discussion", | ||
"position": 4 | ||
} |
126 changes: 63 additions & 63 deletions
126
docs/2024/scheduler/updates/2024-06-06.md → ...4/scheduler/updates/General/2024-06-06.md
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1,63 +1,63 @@ | ||
--- | ||
title: Weekly Updates (Community Bonding) | ||
author: Aaditya Singh | ||
--- | ||
<!-- | ||
SPDX-License-Identifier: CC-BY-SA-4.0 | ||
SPDX-FileCopyrightText: 2024 Aaditya Singh <singh.aaditya889@gmail.com> | ||
--> | ||
|
||
# Meeting 7 | ||
|
||
*(June 06, 2024)* | ||
|
||
## Attendees | ||
|
||
- [Katharina Ettinger](https://github.com/EttingerK) | ||
- [Shaheem Azmal M MD](https://github.com/shaheemazmalmmd) | ||
- [Kaushlendra Pratap](https://github.com/Kaushl2208) | ||
- [Ayush Bhardwaj](https://github.com/hastagAB) | ||
- [Abdelrahman Jamal](https://github.com/Hero2323) | ||
- [Aaditya Singh](https://github.com/Aaditya-Singh78) | ||
- [Akash Sah](https://github.com/Akashsah2003) | ||
- [Divij Sharma](https://github.com/dvjsharma) | ||
- [Rajul Jha](https://github.com/rajuljha) | ||
- [Avinal Kumar](https://github.com/avinal) | ||
- [Vasudev Maduri](https://github.com/vasudevmaduri) | ||
- [Shreya Gautam](https://github.com/ShreyaGautamm) | ||
|
||
## Missed | ||
|
||
- [Samuel Dushimimana](https://github.com/dushimsam) | ||
- [Gaurav Mishra](https://github.com/GMishx) | ||
- [Soham Banerjee](https://github.com/soham4abc) | ||
- [Shreya Singh](https://github.com/SinghShreya05) | ||
- [Abhishek Kumar](https://github.com/abhi-kumar17871) | ||
- [Valens Niyonsenga](https://github.com/valens200) | ||
- [Anupam Ghosh](https://github.com/ag4ums) | ||
- [Sahil Jha](mailto:sjha200000@gmail.com) | ||
|
||
## General Discussion | ||
|
||
**Mentors:** | ||
|
||
- [Shaheem Azmal M MD](https://github.com/shaheemazmalmmd): Provided general updates about the project. | ||
- [Avinal Kumar](https://github.com/avinal): Suggested using a tool like [LanguageTool](https://languagetool.org) for creating GSoC documentation. | ||
|
||
**Contributors**: | ||
|
||
- [Abdelrahman Jamal](https://github.com/Hero2323): Demonstrated a short demo on current work involving parsing comment text of a file from FOSSology, prompting it to multiple LLM's for license name recognition. Mentioned the need to clean up and reorder the data. | ||
|
||
- [Shreya Gautam](https://github.com/ShreyaGautamm): Presented a PPT on the end-to-end flow and code of the Safaa project, currently working on scripts to extract data from FOSSology. | ||
|
||
- [Aaditya Singh](https://github.com/Aaditya-Singh78): Discussed rewriting the scheduler code from C to Go based on last meeting with mentors, raised a PR for the same. Exploring different approaches to complete this task. | ||
|
||
- [Abhishek Kumar](https://github.com/abhi-kumar17871): Was absent. | ||
|
||
- [Akash Sah](https://github.com/Akashsah2003): Discussed with mentors about using JSON format to convert the license expression and store it in a database, currently working on creating a UI for the same. | ||
|
||
- [Divij Sharma](https://github.com/dvjsharma): Completed implementation of OAuth via API; currently looking into upgrading API from V1 to V2. | ||
|
||
- [Rajul Jha](https://github.com/rajuljha): Discussed pulling line numbers of findings and integration challenges, was able to fetch keyword information but faced issues with copyright. | ||
|
||
- [Valens Niyonsenga](https://github.com/valens200): Was absent. | ||
--- | ||
title: week-05 | ||
author: Aaditya Singh | ||
--- | ||
<!-- | ||
SPDX-License-Identifier: CC-BY-SA-4.0 | ||
SPDX-FileCopyrightText: 2024 Aaditya Singh <singh.aaditya889@gmail.com> | ||
--> | ||
|
||
# Meeting 7 | ||
|
||
*(June 06, 2024)* | ||
|
||
## Attendees | ||
|
||
- [Katharina Ettinger](https://github.com/EttingerK) | ||
- [Shaheem Azmal M MD](https://github.com/shaheemazmalmmd) | ||
- [Kaushlendra Pratap](https://github.com/Kaushl2208) | ||
- [Ayush Bhardwaj](https://github.com/hastagAB) | ||
- [Abdelrahman Jamal](https://github.com/Hero2323) | ||
- [Aaditya Singh](https://github.com/Aaditya-Singh78) | ||
- [Akash Sah](https://github.com/Akashsah2003) | ||
- [Divij Sharma](https://github.com/dvjsharma) | ||
- [Rajul Jha](https://github.com/rajuljha) | ||
- [Avinal Kumar](https://github.com/avinal) | ||
- [Vasudev Maduri](https://github.com/vasudevmaduri) | ||
- [Shreya Gautam](https://github.com/ShreyaGautamm) | ||
|
||
## Missed | ||
|
||
- [Samuel Dushimimana](https://github.com/dushimsam) | ||
- [Gaurav Mishra](https://github.com/GMishx) | ||
- [Soham Banerjee](https://github.com/soham4abc) | ||
- [Shreya Singh](https://github.com/SinghShreya05) | ||
- [Abhishek Kumar](https://github.com/abhi-kumar17871) | ||
- [Valens Niyonsenga](https://github.com/valens200) | ||
- [Anupam Ghosh](https://github.com/ag4ums) | ||
- [Sahil Jha](mailto:sjha200000@gmail.com) | ||
|
||
## General Discussion | ||
|
||
**Mentors:** | ||
|
||
- [Shaheem Azmal M MD](https://github.com/shaheemazmalmmd): Provided general updates about the project. | ||
- [Avinal Kumar](https://github.com/avinal): Suggested using a tool like [LanguageTool](https://languagetool.org) for creating GSoC documentation. | ||
|
||
**Contributors**: | ||
|
||
- [Abdelrahman Jamal](https://github.com/Hero2323): Demonstrated a short demo on current work involving parsing comment text of a file from FOSSology, prompting it to multiple LLM's for license name recognition. Mentioned the need to clean up and reorder the data. | ||
|
||
- [Shreya Gautam](https://github.com/ShreyaGautamm): Presented a PPT on the end-to-end flow and code of the Safaa project, currently working on scripts to extract data from FOSSology. | ||
|
||
- [Aaditya Singh](https://github.com/Aaditya-Singh78): Discussed rewriting the scheduler code from C to Go based on last meeting with mentors, raised a PR for the same. Exploring different approaches to complete this task. | ||
|
||
- [Abhishek Kumar](https://github.com/abhi-kumar17871): Was absent. | ||
|
||
- [Akash Sah](https://github.com/Akashsah2003): Discussed with mentors about using JSON format to convert the license expression and store it in a database, currently working on creating a UI for the same. | ||
|
||
- [Divij Sharma](https://github.com/dvjsharma): Completed implementation of OAuth via API; currently looking into upgrading API from V1 to V2. | ||
|
||
- [Rajul Jha](https://github.com/rajuljha): Discussed pulling line numbers of findings and integration challenges, was able to fetch keyword information but faced issues with copyright. | ||
|
||
- [Valens Niyonsenga](https://github.com/valens200): Was absent. |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,4 @@ | ||
{ | ||
"label": "General", | ||
"position": 3 | ||
} |