AllSkyAI - Sky condition classification

[christian-kardach]

Hi! First, really awesome project!
Been looking into using the AllSky camera setup to classify the sky conditions. At the moment we only have one monochrome model working quite nicely with accurate results, example can be found here: https://allskyai.kardach.se/

There is also an example page based on the data from TriStar (thank you Eor), afaik he have this incorporated into his SafetyMonitor.

Anyway, if anyone is interested in contributing with their AllSky image URL we can incorporate it into the model and create a more unified mono/color model that anyone can use.

Working on a release of a self hosted setup (both training and data wrangling) so stay tuned!

/Christian Kardach

[EorEquis]

Just hopping in to thank Christian for this work. Been using it for a bit now, and yes currently testing its integration into my ASCOM Safety Monitor.

The AI seems pretty consistent and accurate after sufficient training. Certainly hope a few more folks will give it a try, and increase the overall dataset!

[Alex-developer]

@christian-kardach This sounds interesting.

In the next release of AllSky I have a clear sky module that attempts to work out if the sky is clear by counting stars in an area. An AI trained system would be far better.

Couple of questions

• Are you planning to have a single model that people contribute to that can be used by anyone? i.e. download the model and use it locally?
• How long does it take to run the model on an image?
• I presume the image needs to be 'clean' i.e. with no text on them, I noticed in your code you black out the test

Thanks

Alex

[christian-kardach]

Thank you!

• Correct, would be really nice/the goal is to have one mono and one color model that everyone can download and use locally and even do transferred training on!

• I'll have to check the actual classification time, but I think atm it takes 1, max 2 seconds on the CPU.

• Ideally it should be "clean" images without the text, but I've just worked with what was simplest right now. Maybe a future release of AllSky could have one "clean" and one "text" version on the website!

• Another thing I haven't spent any time one yet (but should be possible) is trying to get the "lite" version running on the RPi4 directly

Atm. I just pull the image from the AllSky URL and process that so to add a parameter in the URL for a clean version would make a huge difference!

/Chris