Working with the Dev branch #2072

Dentonknifeworks · 2022-12-29T01:45:00Z

Dentonknifeworks
Dec 29, 2022

"This field cannot be empty.
Name of the day camera tuning file to use. Omit this option to preserve the default behavior of libcamera.Please read this documentation or this document if using a Raspberry camera with libcamera. For other Raspberry cameras read the camera manual for more information."
I am using a Raspberry cam
Thanks
Brad

Dentonknifeworks · 2022-12-29T02:46:23Z

Dentonknifeworks
Dec 29, 2022
Author

NVM got around that with a fresh install now getting
from .cv2 import *
Dec 28 20:45:24 allskyTest allsky.sh[2267]: ImportError: numpy.core.multiarray failed to import

1 reply

Dentonknifeworks Dec 29, 2022
Author

That turned out that updating numpy fixed my start image for Allskys have a dewheater already set up on it and I am betting there is an older version on the image.

EricClaeys · 2022-12-29T03:17:18Z

EricClaeys
Dec 29, 2022
Maintainer

@Alex-developer, does the installation script need to install/upgrade numpy?

@Dentonknifeworks, sre you still having an issue with anything?

6 replies

Dentonknifeworks Dec 29, 2022
Author

Not seeing the legacy overlay In image Overlay settings I have it set to Legacy looking at the logs not seeing errors

EricClaeys Dec 29, 2022
Maintainer

The Overlay Method should be the first setting in the "Image Overlay settings" section. It's a dropdown.
Are you not seeing it?

EricClaeys Dec 29, 2022
Maintainer

Which camera uses the IMX519?
If it's supposed to be an RPi HQ compatible camera and you have specs on it, we can probably get it to work.

Dentonknifeworks Dec 29, 2022
Author

The logs look good to me
And I understand how the Overlay is supposed to work. Going to have another look to be sure I have not missed something in the Overlay settings. I do see the drop-down no issue there.
We will get to the IMX519 later, but it is an Arducam works on the current version of Allsky.
Dec 29 05:46:44 allskyTest allsky.sh[30219]: STARTING EXPOSURE at: 2022-12-29 05:46:44 @ 100.0 sec
Dec 29 05:46:44 allskyTest allsky.sh[30219]: > Kill command: pgrep 'raspistill' | xargs kill -9 2> /dev/null
Dec 29 05:46:44 allskyTest allsky.sh[30219]: > Capture command: raspistill --output '/home/pi/allsky/tmp/image-20221229054644.jpg' --thumb none --burst -st --timeout 1 --nopreview --mode 3 --exposure off --shutter 100000000 --analoggain 2 --exif IFD0.Artist=li_100000000_2 --awb off --awbgains 2.5,2 --saturation 0 --contrast 0 --sharpness 0 --brightness 50 --quality 95
Dec 29 05:48:27 allskyTest allsky.sh[30219]: > Focus: 738.211859
Dec 29 05:48:27 allskyTest allsky.sh[30219]: > Got: shutter_us: 100.0 sec, gain: 2.000, mean: 0.349, target mean: 0.600, diff (target - mean): 0.251
Dec 29 05:48:27 allskyTest allsky.sh[30219]: > index: 2, meanHistory[]=0.600 exposureLevelHistory[]=255, newNean=0.600
Dec 29 05:48:27 allskyTest allsky.sh[30219]: > index: 0, meanHistory[]=0.290 exposureLevelHistory[]=255, newNean=1.180
Dec 29 05:48:27 allskyTest allsky.sh[30219]: > index: 1, meanHistory[]=0.349 exposureLevelHistory[]=276, newNean=2.226
Dec 29 05:48:27 allskyTest allsky.sh[30219]: > New mean target: 0.383, mean_forecast: 0.407, mean_diff (newMean - target mean): 0.217, idx=1, idxN1=0
Dec 29 05:48:27 allskyTest allsky.sh[30219]: > fast forward ExposureChange now 104 (meanDiff=0.251 > 1.50threshold=0.150)
Dec 29 05:48:27 allskyTest allsky.sh[30219]: > ExposureChange clipped to 50 (diff from last change: 0)
Dec 29 05:48:27 allskyTest allsky.sh[30219]: >> exposureLevel increased by 50 to 326
Dec 29 05:48:27 allskyTest allsky.sh[30219]: > FF activated
Dec 29 05:48:27 allskyTest allsky.sh[30219]: > Next image: exposure time: 100.0 sec, gain: 2.000
Dec 29 05:48:27 allskyTest allsky.sh[30219]: mean: 0.383 (diff from target: 0.217), Exposure level: 276 (minus 276: 0)
Dec 29 05:48:27 allskyTest allsky.sh[30219]: > Saving NIGHT image 'image-20221229054644.jpg'
Dec 29 05:48:27 allskyTest allsky.sh[30219]: > Sleeping 30.00 ms between auto exposures
Dec 29 05:48:27 allskyTest allsky.sh[30364]: saveImage.sh NIGHT /home/pi/allsky/tmp/image-20221229054644.jpg DATE=20221229 TIME=054644 AUTOEXPOSURE=1 sAUTOEXPOSURE=(auto) EXPOSURE_US=100000000 sEXPOSURE=100.0 sec AUTOGAIN=0 sAUTOGAIN= GAIN=2 AUTOWB=0 sAUTOAWB= WBR=2.500000 WBB=2 BRIGHTNESS=50 MEAN=0.348583 TEMPERATURE_C=-1 TEMPERATURE_F=30 BIN=1 FLIP=none BIT_DEPTH=0 FOCUS=738 DARKFRAME=0 eOVERLAY=-1
Dec 29 05:48:27 allskyTest allsky.sh[30219]: Executing sunwait poll exit angle -6.0000 33.1N 97.1W > /dev/null
Dec 29 05:48:27 allskyTest allsky.sh[30219]: -----
Dec 29 05:48:27 allskyTest allsky.sh[30219]: STARTING EXPOSURE at: 2022-12-29 05:48:27 @ 100.0 sec
Dec 29 05:48:27 allskyTest allsky.sh[30219]: > Kill command: pgrep 'raspistill' | xargs kill -9 2> /dev/null
Dec 29 05:48:27 allskyTest allsky.sh[30219]: > Capture command: raspistill --output '/home/pi/allsky/tmp/image-20221229054827.jpg' --thumb none --burst -st --timeout 1 --nopreview --mode 3 --exposure off --shutter 100000000 --analoggain 2 --exif IFD0.Artist=li_100000000_2 --awb off --awbgains 2.5,2 --saturation 0 --contrast 0 --sharpness 0 --brightness 50 --quality 95
Dec 29 05:48:28 allskyTest allsky.sh[30364]: saveImage.sh: Resizing '/home/pi/allsky/tmp/image-20221229054644.jpg' to 2028x1520
Dec 29 05:48:29 allskyTest allsky.sh[30364]: saveImage.sh: Stretching '/home/pi/allsky/tmp/image-20221229054644.jpg' by 10
Dec 29 05:48:31 allskyTest allsky.sh[30407]: INFO: Loading config /home/pi/allsky/config/settings.json
Dec 29 05:48:31 allskyTest allsky.sh[30407]: INFO: Loading night flow...
Dec 29 05:48:31 allskyTest allsky.sh[30407]: INFO: ----------------------- Running Module allsky_loadimage.py -----------------------
Dec 29 05:48:31 allskyTest allsky.sh[30407]: INFO: Attempting to load allsky_loadimage
Dec 29 05:48:31 allskyTest allsky.sh[30407]: INFO: Image /home/pi/allsky/tmp/image-20221229054644.jpg Loaded
Dec 29 05:48:31 allskyTest allsky.sh[30407]: INFO: Module allsky_loadimage.py ran ok in 133.25799999999998ms
Dec 29 05:48:31 allskyTest allsky.sh[30407]: INFO: ----------------------- Running Module allsky_export.py -----------------------
Dec 29 05:48:31 allskyTest allsky.sh[30407]: INFO: Attempting to load allsky_export
Dec 29 05:48:31 allskyTest allsky.sh[30407]: INFO: Allsky data exported to /home/pi/allsky/tmp/allskydata.json
Dec 29 05:48:31 allskyTest allsky.sh[30407]: INFO: Module allsky_export.py ran ok in 2.673ms
Dec 29 05:48:31 allskyTest allsky.sh[30407]: INFO: ----------------------- Running Module allsky_overlay.py -----------------------
Dec 29 05:48:31 allskyTest allsky.sh[30407]: INFO: Attempting to load allsky_overlay
Dec 29 05:48:31 allskyTest allsky.sh[30407]: INFO: External Overlay Disabled
Dec 29 05:48:31 allskyTest allsky.sh[30407]: INFO: Module allsky_overlay.py ran ok in 0.11ms
Dec 29 05:48:31 allskyTest allsky.sh[30407]: INFO: ----------------------- Running Module allsky_saveimage.py -----------------------
Dec 29 05:48:31 allskyTest allsky.sh[30407]: INFO: Attempting to load allsky_saveimage
Dec 29 05:48:31 allskyTest allsky.sh[30407]: INFO: Image /home/pi/allsky/tmp/image-20221229054644.jpg Saved, quality 95
Dec 29 05:48:31 allskyTest allsky.sh[30407]: INFO: Module allsky_saveimage.py ran ok in 96.393ms
Dec 29 05:50:10 allskyTest allsky.sh[30219]: > Focus: 720.282968
Dec 29 05:50:10 allskyTest allsky.sh[30219]: > Got: shutter_us: 100.0 sec, gain: 2.000, mean: 0.352, target mean: 0.600, diff (target - mean): 0.248
Dec 29 05:50:10 allskyTest allsky.sh[30219]: > index: 0, meanHistory[]=0.290 exposureLevelHistory[]=255, newNean=0.290
Dec 29 05:50:10 allskyTest allsky.sh[30219]: > index: 1, meanHistory[]=0.349 exposureLevelHistory[]=276, newNean=0.987
Dec 29 05:50:10 allskyTest allsky.sh[30219]: > index: 2, meanHistory[]=0.352 exposureLevelHistory[]=276, newNean=2.043
Dec 29 05:50:10 allskyTest allsky.sh[30219]: > New mean target: 0.345, mean_forecast: 0.355, mean_diff (newMean - target mean): 0.255, idx=2, idxN1=1
Dec 29 05:50:10 allskyTest allsky.sh[30219]: > fast forward ExposureChange now 141 (meanDiff=0.248 > 1.50threshold=0.150)
Dec 29 05:50:10 allskyTest allsky.sh[30219]: > ExposureChange clipped to 50 (diff from last change: 0)
Dec 29 05:50:10 allskyTest allsky.sh[30219]: >> exposureLevel increased by 50 to 326
Dec 29 05:50:10 allskyTest allsky.sh[30219]: > FF activated
Dec 29 05:50:10 allskyTest allsky.sh[30219]: > Next image: exposure time: 100.0 sec, gain: 2.000
Dec 29 05:50:10 allskyTest allsky.sh[30219]: mean: 0.345 (diff from target: 0.255), Exposure level: 276 (minus 276: 0)
Dec 29 05:50:10 allskyTest allsky.sh[30219]: > Saving NIGHT image 'image-20221229054827.jpg'
Dec 29 05:50:10 allskyTest allsky.sh[30219]: > Sleeping 30.00 ms between auto exposures
Dec 29 05:50:10 allskyTest allsky.sh[30525]: saveImage.sh NIGHT /home/pi/allsky/tmp/image-20221229054827.jpg DATE=20221229 TIME=054827 AUTOEXPOSURE=1 sAUTOEXPOSURE=(auto) EXPOSURE_US=100000000 sEXPOSURE=100.0 sec AUTOGAIN=0 sAUTOGAIN= GAIN=2 AUTOWB=0 sAUTOAWB= WBR=2.500000 WBB=2 BRIGHTNESS=50 MEAN=0.351861 TEMPERATURE_C=-1 TEMPERATURE_F=30 BIN=1 FLIP=none BIT_DEPTH=0 FOCUS=720 DARKFRAME=0 eOVERLAY=-1
Dec 29 05:50:10 allskyTest allsky.sh[30219]: Executing sunwait poll exit angle -6.0000 33.1N 97.1W > /dev/null
Dec 29 05:50:10 allskyTest allsky.sh[30219]: -----

Dentonknifeworks Dec 29, 2022
Author

I ran allsky_overlay.py and get this error.Run allsky_overlay.py
Traceback (most recent call last):
File "/home/pi/allsky/scripts/allsky_overlay.py", line 13, in
import allsky_shared as s
ModuleNotFoundError: No module named 'allsky_shared'
I also see in the log Dec 29 05:48:31 allskyTest allsky.sh[30407]: INFO: External Overlay Disabled
In the settings.json overlaymethod : "1" it is enabled as in the GUI
I see the allsky_script.py in the /home/pi/allsky/scripts/modules dir is this a path problem? I will wait for your suggestions at this point Thanks.

Dentonknifeworks · 2022-12-29T04:35:13Z

Dentonknifeworks
Dec 29, 2022
Author

Not getting any overlays. this is in legacy mode and switching to module has no change

4 replies

EricClaeys Dec 29, 2022
Maintainer

In legacy mode you need to update the settings in the WebUI. In module mode the WebUI settings are ignored. If you are in module mode and not seeing anything, make sure the Overlay module is enabled. If so, check the log file.

Alex-developer Dec 29, 2022
Maintainer

@EricClaeys I added a note on Discord the other day but I suspect its hard to find now as there has been a fair bit of discussion going on.

I have found two what I think are errors with the dev branch

This commit c085748 is looking for externaloverlay but the options.json file has it as overlaymethod. Thus the overlay never gets enabled. Changing the key in the options file to externaloverlay fixed it for me

Dec 29 14:53:21 test allsky.sh[1088]: *** WARNING: Unknown argument: [overlaymethod].  Ignored.
Dec 29 14:53:21 test allsky.sh[1088]: *** WARNING: Unknown argument: [0].  Ignored.

The two 'Tuning File' settings in the main settings appear to be mandatory preventing the settings being saved, these fields are only visible when the advanced mode is enabled so its not obvious whats going on.

I will check the numpy version

@Dentonknifeworks You cannot manually run the overlay code as its all part of a module based system.

The note in the log about the overlay being disabled is I believe caused by the above issue I have mentioned to Eric.

Dentonknifeworks Dec 29, 2022
Author

@Alex-developer Thanks I will wait for what to do Discord? is there a pubic channel?

Dentonknifeworks Dec 29, 2022
Author

And doing the change in the options.json file did the trick for me.
I now have overlays

EricClaeys · 2022-12-29T17:04:26Z

EricClaeys
Dec 29, 2022
Maintainer

@Dentonknifeworks, @Alex-developer,
I just made a change to fix the "overlayMethod" versus "externalOverlay", so the next time you do a git clone you'll get the fix.
Also fixed the issue with the tuning file settings being mandatory.

0 replies

Dentonknifeworks · 2022-12-29T20:26:32Z

Dentonknifeworks
Dec 29, 2022
Author

Next up ~/allsky/tmp. A new folder is required in the tmp directory called extra.
Created extra
Added a simple text file
test.txt
with BVTermp=100

The second I add the file to the dir overlays turn off.
Permissions are for anyone on the directory and the file.

Remove the file and overlays turn back on. I tried a blank file with no luck.
Thanks Brad

8 replies

Dentonknifeworks Dec 29, 2022
Author

File "/usr/lib/python3.9/locale.py", line 332, in atoi
Dec 29 16:33:10 allskyTest allsky.sh[7099]: return int(delocalize(string))
Dec 29 16:33:10 allskyTest allsky.sh[7099]: ValueError: invalid literal for int() with base 10: '1672352003.6'

Alex-developer Dec 29, 2022
Maintainer

Can you post all of the error lines please

Dentonknifeworks Dec 29, 2022
Author

allsky.log.zip

Alex-developer Dec 29, 2022
Maintainer

Yes that ones fixed. Edit line 183 of /home/pi/allsky/scripts/allsky_overlay.py and delete the s. from the line so it will end up looking like

fileModifiedTime = int(os.path.getmtime(dataFilename))

Be careful not to remove any leading spaces. The file is fixed in Github so any future re installs will not have the issue

Cheers

Alex

Dentonknifeworks Dec 29, 2022
Author

Done and fixed thank you.
Brad

Dentonknifeworks · 2022-12-30T00:10:20Z

Dentonknifeworks
Dec 30, 2022
Author

Added the Text file I use for the Dew heater.
its in the extra dir
I can read the variables

They show up in Available Variables after adding them.

Added to the overlay
Not showing up I see some timeouts in the log file

allsky.log (1).zip

0 replies

EricClaeys · 2022-12-30T00:25:12Z

EricClaeys
Dec 30, 2022
Maintainer

I am fine to keep using this discussion, but we talked about using Discord and/or email.

@Alex-developer do you have a preference?

3 replies

Alex-developer Dec 30, 2022
Maintainer

Discord is best I think it's far easier to have a discussion on than here

Dentonknifeworks Dec 30, 2022
Author

Discord works for me

Alex-developer Dec 31, 2022
Maintainer

Discord works for me

Can you drop me an email at 'alex.greenland ATYY gmail.com' and I will send you an invite

Thanks

Alex

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Working with the Dev branch #2072

{{title}}

Replies: 7 comments 22 replies

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{title}}

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{title}}

{{title}}

{{title}}

Select a reply

Working with the Dev branch #2072

Dentonknifeworks Dec 29, 2022

Replies: 7 comments · 22 replies

Dentonknifeworks Dec 29, 2022 Author

Dentonknifeworks Dec 29, 2022 Author

EricClaeys Dec 29, 2022 Maintainer

Dentonknifeworks Dec 29, 2022 Author

EricClaeys Dec 29, 2022 Maintainer

EricClaeys Dec 29, 2022 Maintainer

Dentonknifeworks Dec 29, 2022 Author

Dentonknifeworks Dec 29, 2022 Author

Dentonknifeworks Dec 29, 2022 Author

EricClaeys Dec 29, 2022 Maintainer

Alex-developer Dec 29, 2022 Maintainer

Dentonknifeworks Dec 29, 2022 Author

Dentonknifeworks Dec 29, 2022 Author

EricClaeys Dec 29, 2022 Maintainer

Dentonknifeworks Dec 29, 2022 Author

Dentonknifeworks Dec 29, 2022 Author

Alex-developer Dec 29, 2022 Maintainer

Dentonknifeworks Dec 29, 2022 Author

Alex-developer Dec 29, 2022 Maintainer

Dentonknifeworks Dec 29, 2022 Author

Dentonknifeworks Dec 30, 2022 Author

EricClaeys Dec 30, 2022 Maintainer

Alex-developer Dec 30, 2022 Maintainer

Dentonknifeworks Dec 30, 2022 Author

Alex-developer Dec 31, 2022 Maintainer

Dentonknifeworks
Dec 29, 2022

Replies: 7 comments 22 replies

Dentonknifeworks
Dec 29, 2022
Author

Dentonknifeworks Dec 29, 2022
Author

EricClaeys
Dec 29, 2022
Maintainer

Dentonknifeworks Dec 29, 2022
Author

EricClaeys Dec 29, 2022
Maintainer

EricClaeys Dec 29, 2022
Maintainer

Dentonknifeworks Dec 29, 2022
Author

Dentonknifeworks Dec 29, 2022
Author

Dentonknifeworks
Dec 29, 2022
Author

EricClaeys Dec 29, 2022
Maintainer

Alex-developer Dec 29, 2022
Maintainer

Dentonknifeworks Dec 29, 2022
Author

Dentonknifeworks Dec 29, 2022
Author

EricClaeys
Dec 29, 2022
Maintainer

Dentonknifeworks
Dec 29, 2022
Author

Dentonknifeworks Dec 29, 2022
Author

Alex-developer Dec 29, 2022
Maintainer

Dentonknifeworks Dec 29, 2022
Author

Alex-developer Dec 29, 2022
Maintainer

Dentonknifeworks Dec 29, 2022
Author

Dentonknifeworks
Dec 30, 2022
Author

EricClaeys
Dec 30, 2022
Maintainer

Alex-developer Dec 30, 2022
Maintainer

Dentonknifeworks Dec 30, 2022
Author

Alex-developer Dec 31, 2022
Maintainer