Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Test release candidate #256

Closed
wants to merge 72 commits into from
Closed

Test release candidate #256

wants to merge 72 commits into from

Conversation

adev4a
Copy link
Collaborator

@adev4a adev4a commented Aug 28, 2024

PR Details

Description

Related GitHub Issue

Related Jira Key

Motivation and Context

How Has This Been Tested?

Types of changes

  • Defect fix (non-breaking change that fixes an issue)
  • New feature (non-breaking change that adds functionality)
  • Breaking change (fix or feature that cause existing functionality to change)

Checklist:

  • I have added any new packages to the sonar-scanner.properties file
  • My change requires a change to the documentation.
  • I have updated the documentation accordingly.
  • I have read the CONTRIBUTING document.
  • I have added tests to cover my changes.
  • All new and existing tests passed.

abey-yoseph and others added 30 commits April 26, 2023 08:38
<!-- Thanks for the contribution, this is awesome. -->

# PR Details
## Description
Python script to plot a histogram of latency values from the
parsed messaging server log csv files.

<!--- Describe your changes in detail -->

## Related Issue

<!--- This project only accepts pull requests related to open issues -->
<!--- If suggesting a new feature or change, please discuss it in an
issue first -->
<!--- If fixing a bug, there should be an issue describing it with steps
to reproduce -->
<!--- Please link to the issue here: -->

## Motivation and Context
WFD Verification Testing Analysis

<!--- Why is this change required? What problem does it solve? -->

## How Has This Been Tested?
Locally
<!--- Please describe in detail how you tested your changes. -->
<!--- Include details of your testing environment, and the tests you ran
to -->
<!--- see how your change affects other areas of the code, etc. -->

## Types of changes

<!--- What types of changes does your code introduce? Put an `x` in all
the boxes that apply: -->

- [ ] Defect fix (non-breaking change that fixes an issue)
- [x ] New feature (non-breaking change that adds functionality)
- [ ] Breaking change (fix or feature that cause existing functionality
to change)

## Checklist:

<!--- Go over all the following points, and put an `x` in all the boxes
that apply. -->
<!--- If you're unsure about any of these, don't hesitate to ask. We're
here to help! -->

- [ ] I have added any new packages to the sonar-scanner.properties file
- [ ] My change requires a change to the documentation.
- [ ] I have updated the documentation accordingly.
- [x ] I have read the **CONTRIBUTING** document.
[CDA Telematics Contributing
Guide](https://github.com/usdot-fhwa-stol/cda-telematics/blob/main/Contributing.md)
- [ ] I have added tests to cover my changes.
- [ ] All new and existing tests passed.
* add log parser scripts

* add log parser scripts

* add comments

* address comments

* use pandas for message loss count
* Use system time for CDASim

* update comment

* fix - get sim env variable

* update bool check is_sim

* Add description for env var

* update comment
update nats connection parameters
* initial queue implementation cc bridge

* add some comments

* fix unsub logic (#126)

* init

* cc bridge simplify logic

* Cloud bridge investigation (#131)

* initial queue implementation cc bridge

* add some comments

* cc bridge simplify logic

* back to queue, add in file listener

* Fix unit status and UI notification and event live status (#129)

* init

* add comments

* fix warning

* update text

* Remove credentials (#134)

* updating log levels, docker compose log size parameter

* revert local changes

* init

* remove hardcoded values

* add analysis scripts

* messaging server log size parameter

* init

* add nan

* Fix json key value convertor logic (#146)

fix comparison

* Fix/drop nan value fields (#148)

drop fields with NaN values

* clean up readme.md

---------

Co-authored-by: Abey <abey.yoseph@leidos.com>
Co-authored-by: Anish_deva <51463994+adev4a@users.noreply.github.com>
Co-authored-by: dan-du-car <dan.du@leidos.com>
Co-authored-by: abey-yoseph <59704440+abey-yoseph@users.noreply.github.com>
Co-authored-by: dan-du-car <62157949+dan-du-car@users.noreply.github.com>
Co-authored-by: Anish <Anishdeva17@gmail.com>
Co-authored-by: Cody Garver <codygarver@users.noreply.github.com>
…t with input field payload.MessageFrame.value.PersonalSafetyMessage.id (#160)
…e for topics field when there is no available topic (#164)

* init

* init

* init
* add unit test

* update test

* update

* fix unit test

* update gitup action

* update gitup action

* disabled vehicle and cloud bridge coverage

* fix sonar

* update sonar

* test new token

* update token

* update ignore path

* add watchAll

* add ignore fields

* address comments

* address comments

* address comments

* update test description

* update sonar

* update sonar

* update sonar

* exclude tests folder

* update scm sensor

* update scm sensor

* update scm sensor

* update lcov path

* merge lcov

* merge lcov

* merge lcov

* merge lcov

* merge lcov

* merge lcov

* debug server lcov

* debug server lcov
Removing old pull request template
* initial queue implementation cc bridge

* add some comments

* fix unsub logic (#126)

* init

* cc bridge simplify logic

* Cloud bridge investigation (#131)

* initial queue implementation cc bridge

* add some comments

* cc bridge simplify logic

* back to queue, add in file listener

* Fix unit status and UI notification and event live status (#129)

* init

* add comments

* fix warning

* update text

* Remove credentials (#134)

* updating log levels, docker compose log size parameter

* revert local changes

* init

* remove hardcoded values

* add analysis scripts

* messaging server log size parameter

* init

* add nan

* Fix json key value convertor logic (#146)

fix comparison

* Fix/drop nan value fields (#148)

drop fields with NaN values

* clean up readme.md

* init

* init

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* undo changes

* undo changes

* add wait for

* update config

* fix unit test

* update local config

* update depends on

* address comments

* github action fix

* fix ci

* update sonar scanner

* update sonar scanner

* address code smell

* add unit test

* add unit test

* add unit test

* address comments

* remove --ignore-script

* remove lock file

---------

Co-authored-by: Abey <abey.yoseph@leidos.com>
Co-authored-by: Anish_deva <51463994+adev4a@users.noreply.github.com>
Co-authored-by: abey-yoseph <59704440+abey-yoseph@users.noreply.github.com>
Co-authored-by: Anish <Anishdeva17@gmail.com>
Co-authored-by: Saikrishna Bairamoni <84093461+SaikrishnaBairamoni@users.noreply.github.com>
Co-authored-by: Cody Garver <codygarver@users.noreply.github.com>
* init

* init

* init

* init

* update env

* update

* update

* update

* update
* init

* update file upload

* update

* clean file uploader

* add file list

* update uploader request

* update status logic

* update list s3 objects

* fix description field

* naming convention

* naming convention

* update unit test

* remove error throw when file upload premature

* address code smell

* update status code and remove res from controller

* update copyright year

* add unit test

* add unit test

* clean up

* address comments

* controllers/address comments

* address comments

* address comments

* address comemnts

* address comments

* clean up and update docker files

* update docker

* address comments
* init

* update file upload pages

* update historical page

* clean up

* add construct error func

* add unit test

* fix server listener

* remove http dispatch

* clean up

* update domain name

* clean up

* update domain name

* update search label

* rename variables

* rename

* rename

* fix unit test

* fix user id

* address code smell

* address code smell

* address code smell

* fix nats request

* address comments

* version

* version

* version
* Add rosbag2 processing service

* add copyright

* revert change

* fix rosmsg record

* update async

* adds nats request

* add dockerfile

* update docker build files

* add docker compose and update async implementation

* update docker compose env vars

* add nats request topic to env

* address comments

* add nats connect to separate thread

* fix multi-threading

* add initial unit tests

* address comments

* address comments

* catch exception for rosbag reading error

* add config

* add comment for generic exception

* fix

* address comments

* Feature add CI/CD for rosbag2_processing_service (#177)

* add rosbag2_processing_service to gha

* adjust python path for tests

* source rosbag2 for tests and add docker build

* temp add feature branch to test build

* corrected sonar properties path

* move source setup.bash

* tweak pytest command

* add pytest-env

* test

* min unit test

* fix test

* tweak path

* Check Path

* remove .env step

* try

* update tests

* update unit test

* test remove exprt

* try pytest

* Update sonar properties

* update sonar propeties

* update coverage file path

* add unit tests

---------

Co-authored-by: Anish <Anishdeva17@gmail.com>

* update unit tests and ci steps

* fix pytest.ini

* fix unit test

* update resource file path

* update build steps

* update tests

* add check for file exists

* fix unit test

* fix test

* fix nats request path

* fix unit test

* rename dir

---------

Co-authored-by: Saikrishna Bairamoni <84093461+SaikrishnaBairamoni@users.noreply.github.com>
…S3 bucket based on user organization (#180)

* init

* update local file copy dir

* user login

* update list s3 objects

* Historical data page: Query only list .mcap file from S3 bucket and process request issues  (#181)

* init

* clean up

* update revision

* revise update desc func

* update

* fix file path

* add unit test

* update unit test

* address code smell
* add mysql conn

* add mysql update logic

* fix logging

* add mysql table as config param

* revert config param val

* add params

* add mysql dep to ci build

* fix test

* update

* add test

* update test

* mock mysql connection

* address code smells

* fix

* fix influx record

* address comments

* update topic name

* add processing service to local docker compose

* update vars
* update docker compose and fix build error

* add influx url
* update

* fix update and insert

* update

* rename

* update env

* beautify

* beautify
adev4a and others added 28 commits June 4, 2024 17:33
… file size less than 8 bytes (#224)

* update influx url

* fix file size <8

* remove import
* catch unindexed rosbag error

* update comment

* update

* remove validity check - catch memoryerror
* catch unindexed rosbag error

* update comment

* update

* add stop event to nats callback thread

* add stop event for both service threads
* add query by filenames

* validate file existence

* return when invalid

* reove logs
…gin (#231)

* add script

* add parse arg

* add arg

* remove import

* address comments

* address comments

* complete message loss script

* update script

* address comments
* update dockerhub workflow to use reusable actions docker org, tag and metadata.

* remove telematic local messaging job

* update docker org to point candidate

* update triggers

* restructure to use reusable parameters
update messaging server local deployment service name
* init

* init

* update variable name
* update env variables

* update local influxdb retention policy

* address comments
remove thread interrupts
* fix script

* update readme

* remove comments

* update

* Update README.md

* Update README.md

* add next line

* update

* remove branch specific instruction

* address comments

* address comments

* update readme

* update readme
* add script for historical data processing log parser

* address comments

* address comments

* add comments

* update README
* initial queue implementation cc bridge

* add some comments

* fix unsub logic (#126)

* init

* cc bridge simplify logic

* Cloud bridge investigation (#131)

* initial queue implementation cc bridge

* add some comments

* cc bridge simplify logic

* back to queue, add in file listener

* Fix unit status and UI notification and event live status (#129)

* init

* add comments

* fix warning

* update text

* Remove credentials (#134)

* updating log levels, docker compose log size parameter

* revert local changes

* init

* remove hardcoded values

* add analysis scripts

* messaging server log size parameter

* init

* add nan

* Fix json key value convertor logic (#146)

fix comparison

* Fix/drop nan value fields (#148)

drop fields with NaN values

* clean up readme.md

* fix merge conflicts

* fix - revert change

* revert imports

---------

Co-authored-by: Abey <abey.yoseph@leidos.com>
Co-authored-by: dan-du-car <dan.du@leidos.com>
Co-authored-by: abey-yoseph <59704440+abey-yoseph@users.noreply.github.com>
Co-authored-by: dan-du-car <62157949+dan-du-car@users.noreply.github.com>
Co-authored-by: Saikrishna Bairamoni <84093461+SaikrishnaBairamoni@users.noreply.github.com>
Co-authored-by: Cody Garver <codygarver@users.noreply.github.com>
* initial queue implementation cc bridge

* add some comments

* fix unsub logic (#126)

* init

* cc bridge simplify logic

* Cloud bridge investigation (#131)

* initial queue implementation cc bridge

* add some comments

* cc bridge simplify logic

* back to queue, add in file listener

* Fix unit status and UI notification and event live status (#129)

* init

* add comments

* fix warning

* update text

* Remove credentials (#134)

* updating log levels, docker compose log size parameter

* revert local changes

* init

* remove hardcoded values

* add analysis scripts

* messaging server log size parameter

* init

* add nan

* Fix json key value convertor logic (#146)

fix comparison

* Fix/drop nan value fields (#148)

drop fields with NaN values

* clean up readme.md

* fix conflict

* revert change - function redefinition

---------

Co-authored-by: Abey <abey.yoseph@leidos.com>
Co-authored-by: dan-du-car <dan.du@leidos.com>
Co-authored-by: abey-yoseph <59704440+abey-yoseph@users.noreply.github.com>
Co-authored-by: dan-du-car <62157949+dan-du-car@users.noreply.github.com>
Co-authored-by: Saikrishna Bairamoni <84093461+SaikrishnaBairamoni@users.noreply.github.com>
Co-authored-by: Cody Garver <codygarver@users.noreply.github.com>
@adev4a adev4a closed this Aug 28, 2024
@adev4a adev4a deleted the test_release_candidate branch August 28, 2024 16:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants