Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix(readme) update directory structure to avoid confusion of week-05 meeting notes. #261

Open
wants to merge 1 commit into
base: main
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Original file line number Diff line number Diff line change
@@ -1,56 +1,56 @@
---
title: OVERHAULING SCHEDULER DESIGN (Discussion)
author: Aaditya Singh
---
<!--
SPDX-License-Identifier: CC-BY-SA-4.0
SPDX-FileCopyrightText: 2024 Aaditya Singh <singh.aaditya889@gmail.com>
-->
# Meeting 8
*(June 07, 2024)*
## Attendees
- [Katharina Ettinger](https://github.com/EttingerK)
- [Shaheem Azmal M MD](https://github.com/shaheemazmalmmd)
- [Gaurav Mishra](https://github.com/GMishx)
- [Kaushlendra Pratap](https://github.com/Kaushl2208)
- [Avinal](https://github.com/avinal)
- [Aaditya Singh](https://github.com/Aaditya-Singh78)
## Discussion
**Contributors**:
- [Aaditya Singh](https://github.com/Aaditya-Singh78): Discussing integration and implementation strategies for the new scheduler design.
![architecture-version: 02](../asset/arch_ver.02.png)
It consists of a sophisticated job scheduling system that leverages Go's powerful concurrency features to efficiently manage tasks across two *primary queues*:
1. Dependent Queue
2. Independent Queue
Each queue is managed by a dedicated Global Go-Routine, which orchestrates the distribution and execution of tasks among multiple subordinate Go-Routines. These Go-Routines operate in parallel, each managing its own set of threads to ensure tasks are executed concurrently, *maximising throughput* & *minimising response time*.
**Key Components:**
- *Database*: Central storage for all job-related data, ensuring durability and consistency across job executions.
- *Dependent Queue*: Manages jobs that depend on the completion of other jobs, ensuring correct execution order.
- *Independent Queue*: Handles jobs that can be executed independently, allowing for simultaneous processing and improved efficiency.
- *Logging*: Each thread incorporates logging to track job execution, facilitating debugging and system monitoring.
- *Termination*: Ensures all tasks are either completed or properly terminated before system shutdown, maintaining system integrity.
**Mentors**:
- [Shaheem Azmal M MD](https://github.com/shaheemazmalmmd): Questioned whether priority can be implemented in both dependent and independent queues effectively.
- [Gaurav Mishra](https://github.com/GMishx): Highlighted considerations for ensuring mutual exclusivity either across dependent or independent queues, with a focus on execution rules and limitations.
---
title: week-05
author: Aaditya Singh
---
<!--
SPDX-License-Identifier: CC-BY-SA-4.0
SPDX-FileCopyrightText: 2024 Aaditya Singh <singh.aaditya889@gmail.com>
-->

# Meeting 8

*(June 07, 2024)*

## Attendees

- [Katharina Ettinger](https://github.com/EttingerK)
- [Shaheem Azmal M MD](https://github.com/shaheemazmalmmd)
- [Gaurav Mishra](https://github.com/GMishx)
- [Kaushlendra Pratap](https://github.com/Kaushl2208)
- [Avinal](https://github.com/avinal)
- [Aaditya Singh](https://github.com/Aaditya-Singh78)

## Discussion

**Contributors**:

- [Aaditya Singh](https://github.com/Aaditya-Singh78): Discussing integration and implementation strategies for the new scheduler design.

![architecture-version: 02](../../asset/arch_ver.02.png)

It consists of a sophisticated job scheduling system that leverages Go's powerful concurrency features to efficiently manage tasks across two *primary queues*:

1. Dependent Queue
2. Independent Queue

Each queue is managed by a dedicated Global Go-Routine, which orchestrates the distribution and execution of tasks among multiple subordinate Go-Routines. These Go-Routines operate in parallel, each managing its own set of threads to ensure tasks are executed concurrently, *maximising throughput* & *minimising response time*.

**Key Components:**

- *Database*: Central storage for all job-related data, ensuring durability and consistency across job executions.

- *Dependent Queue*: Manages jobs that depend on the completion of other jobs, ensuring correct execution order.

- *Independent Queue*: Handles jobs that can be executed independently, allowing for simultaneous processing and improved efficiency.

- *Logging*: Each thread incorporates logging to track job execution, facilitating debugging and system monitoring.

- *Termination*: Ensures all tasks are either completed or properly terminated before system shutdown, maintaining system integrity.

**Mentors**:

- [Shaheem Azmal M MD](https://github.com/shaheemazmalmmd): Questioned whether priority can be implemented in both dependent and independent queues effectively.

- [Gaurav Mishra](https://github.com/GMishx): Highlighted considerations for ensuring mutual exclusivity either across dependent or independent queues, with a focus on execution rules and limitations.

- [Kaushlendra Pratap](https://github.com/Kaushl2208): Inquired about how goroutines can achieve both concurrency and parallelism, and whether they should operate synchronously or asynchronously.
4 changes: 4 additions & 0 deletions docs/2024/scheduler/updates/Discussion/_category_.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,4 @@
{
"label": "Discussion",
"position": 4
}
Original file line number Diff line number Diff line change
@@ -1,63 +1,63 @@
---
title: Weekly Updates (Community Bonding)
author: Aaditya Singh
---
<!--
SPDX-License-Identifier: CC-BY-SA-4.0
SPDX-FileCopyrightText: 2024 Aaditya Singh <singh.aaditya889@gmail.com>
-->
# Meeting 7
*(June 06, 2024)*
## Attendees
- [Katharina Ettinger](https://github.com/EttingerK)
- [Shaheem Azmal M MD](https://github.com/shaheemazmalmmd)
- [Kaushlendra Pratap](https://github.com/Kaushl2208)
- [Ayush Bhardwaj](https://github.com/hastagAB)
- [Abdelrahman Jamal](https://github.com/Hero2323)
- [Aaditya Singh](https://github.com/Aaditya-Singh78)
- [Akash Sah](https://github.com/Akashsah2003)
- [Divij Sharma](https://github.com/dvjsharma)
- [Rajul Jha](https://github.com/rajuljha)
- [Avinal Kumar](https://github.com/avinal)
- [Vasudev Maduri](https://github.com/vasudevmaduri)
- [Shreya Gautam](https://github.com/ShreyaGautamm)
## Missed
- [Samuel Dushimimana](https://github.com/dushimsam)
- [Gaurav Mishra](https://github.com/GMishx)
- [Soham Banerjee](https://github.com/soham4abc)
- [Shreya Singh](https://github.com/SinghShreya05)
- [Abhishek Kumar](https://github.com/abhi-kumar17871)
- [Valens Niyonsenga](https://github.com/valens200)
- [Anupam Ghosh](https://github.com/ag4ums)
- [Sahil Jha](mailto:sjha200000@gmail.com)
## General Discussion
**Mentors:**
- [Shaheem Azmal M MD](https://github.com/shaheemazmalmmd): Provided general updates about the project.
- [Avinal Kumar](https://github.com/avinal): Suggested using a tool like [LanguageTool](https://languagetool.org) for creating GSoC documentation.
**Contributors**:
- [Abdelrahman Jamal](https://github.com/Hero2323): Demonstrated a short demo on current work involving parsing comment text of a file from FOSSology, prompting it to multiple LLM's for license name recognition. Mentioned the need to clean up and reorder the data.
- [Shreya Gautam](https://github.com/ShreyaGautamm): Presented a PPT on the end-to-end flow and code of the Safaa project, currently working on scripts to extract data from FOSSology.
- [Aaditya Singh](https://github.com/Aaditya-Singh78): Discussed rewriting the scheduler code from C to Go based on last meeting with mentors, raised a PR for the same. Exploring different approaches to complete this task.
- [Abhishek Kumar](https://github.com/abhi-kumar17871): Was absent.
- [Akash Sah](https://github.com/Akashsah2003): Discussed with mentors about using JSON format to convert the license expression and store it in a database, currently working on creating a UI for the same.
- [Divij Sharma](https://github.com/dvjsharma): Completed implementation of OAuth via API; currently looking into upgrading API from V1 to V2.
- [Rajul Jha](https://github.com/rajuljha): Discussed pulling line numbers of findings and integration challenges, was able to fetch keyword information but faced issues with copyright.
- [Valens Niyonsenga](https://github.com/valens200): Was absent.
---
title: week-05
author: Aaditya Singh
---
<!--
SPDX-License-Identifier: CC-BY-SA-4.0
SPDX-FileCopyrightText: 2024 Aaditya Singh <singh.aaditya889@gmail.com>
-->

# Meeting 7

*(June 06, 2024)*

## Attendees

- [Katharina Ettinger](https://github.com/EttingerK)
- [Shaheem Azmal M MD](https://github.com/shaheemazmalmmd)
- [Kaushlendra Pratap](https://github.com/Kaushl2208)
- [Ayush Bhardwaj](https://github.com/hastagAB)
- [Abdelrahman Jamal](https://github.com/Hero2323)
- [Aaditya Singh](https://github.com/Aaditya-Singh78)
- [Akash Sah](https://github.com/Akashsah2003)
- [Divij Sharma](https://github.com/dvjsharma)
- [Rajul Jha](https://github.com/rajuljha)
- [Avinal Kumar](https://github.com/avinal)
- [Vasudev Maduri](https://github.com/vasudevmaduri)
- [Shreya Gautam](https://github.com/ShreyaGautamm)

## Missed

- [Samuel Dushimimana](https://github.com/dushimsam)
- [Gaurav Mishra](https://github.com/GMishx)
- [Soham Banerjee](https://github.com/soham4abc)
- [Shreya Singh](https://github.com/SinghShreya05)
- [Abhishek Kumar](https://github.com/abhi-kumar17871)
- [Valens Niyonsenga](https://github.com/valens200)
- [Anupam Ghosh](https://github.com/ag4ums)
- [Sahil Jha](mailto:sjha200000@gmail.com)

## General Discussion

**Mentors:**

- [Shaheem Azmal M MD](https://github.com/shaheemazmalmmd): Provided general updates about the project.
- [Avinal Kumar](https://github.com/avinal): Suggested using a tool like [LanguageTool](https://languagetool.org) for creating GSoC documentation.

**Contributors**:

- [Abdelrahman Jamal](https://github.com/Hero2323): Demonstrated a short demo on current work involving parsing comment text of a file from FOSSology, prompting it to multiple LLM's for license name recognition. Mentioned the need to clean up and reorder the data.

- [Shreya Gautam](https://github.com/ShreyaGautamm): Presented a PPT on the end-to-end flow and code of the Safaa project, currently working on scripts to extract data from FOSSology.

- [Aaditya Singh](https://github.com/Aaditya-Singh78): Discussed rewriting the scheduler code from C to Go based on last meeting with mentors, raised a PR for the same. Exploring different approaches to complete this task.

- [Abhishek Kumar](https://github.com/abhi-kumar17871): Was absent.

- [Akash Sah](https://github.com/Akashsah2003): Discussed with mentors about using JSON format to convert the license expression and store it in a database, currently working on creating a UI for the same.

- [Divij Sharma](https://github.com/dvjsharma): Completed implementation of OAuth via API; currently looking into upgrading API from V1 to V2.

- [Rajul Jha](https://github.com/rajuljha): Discussed pulling line numbers of findings and integration challenges, was able to fetch keyword information but faced issues with copyright.

- [Valens Niyonsenga](https://github.com/valens200): Was absent.
4 changes: 4 additions & 0 deletions docs/2024/scheduler/updates/General/_category_ .json
Original file line number Diff line number Diff line change
@@ -0,0 +1,4 @@
{
"label": "General",
"position": 3
}