RAI 1.0.0 release

What's Changed

New Features

• Added tools for open-set detection, manipulation, taxi, and agriculture demos
• Enhanced voice-based apps and ROS2 message tools
• Integrated Langfuse for system-wide tracing
• Introduced GenAI URDF parser

Fixes and Improvements

• Various bug fixes in text_hmi, Ros2PubMessageTool, and Turtlebot configuration
• Refactoring for better clarity and modularity (vendor separation, toolset updates)
• Improved task handling, tracing, and documentation

Documentation Updates

• New tutorials and improved docs for ROSbot XL and Turtlebot4
• Added vendor table and demo documentation

Build and CI Updates

• Updated CI setup with self-hosted runners and pre-commit configurations

Chores and Maintenance

• Dependency updates and minor improvements to launch files and extensions

What's Changed

• Update poetry dependencies by @github-actions in #234
• feat: add tool for open-set detection using grounding dino by @rachwalk in #215
• fix(docs and code): text_hmi by @maciejmajek in #238
• docs: improve whoami docs by @boczekbartek in #239
• fix(text_hmi): uids are strings by @boczekbartek in #241
• fix(Ros2PubMessageTool): not all messages has headers + unitest by @boczekbartek in #237
• feat: improve ros2 pub msg tool by @boczekbartek in #242
• build: remove CI on draft PRs by @rachwalk in #244
• fix(hri.launch): use voice_hmi_node instead of hmi_node by @maciejmajek in #246
• feat(rai_tts&rai_hmi): stable elevenlabs voice, reintroduced chunking by @maciejmajek in #247
• refactor: decouple default vendor by @maciejmajek in #248
• feat: Langfuse integration, system-wide tracing configuration (LangSmith&Langfuse) by @maciejmajek in #253
• docs: Added vendor table by @adamdbrw in #255
• refactor: separate files for ToolRunner and artifact handlers by @maciejmajek in #256
• feat: rai_hmi api for universal voice-based apps by @maciejmajek in #257
• feat: insert system prompt when not present by @maciejmajek in #259
• Update poetry dependencies by @github-actions in #254
• feat: genAI urdf parser by @maciejmajek in #260
• CI: update to self-hosted runner by @skrobinho in #245
• feat: taxi demo by @maciejmajek in #250
• chore: add sam2 and change extension name to open_set_vision by @rachwalk in #243
• docs: adapt rosbot-xl docs to adhere to new ros2 action interface by @boczekbartek in #264
• docs&refactor: clarity improvements by @maciejmajek in #267
• CI: pre-commit runner ubuntu image update by @skrobinho in #275
• feat: manipulation toolset by @maciejmajek in #271
• feat: handle background ros2 actions and refactor RaiNodes + integrate w/ open-set vision by @boczekbartek in #273
• bb/refactor/text hmi wide remove legacy by @boczekbartek in #278
• chore: reduce verbosity & feat: enhance typing by @maciejmajek in #282
• fix: adding task to the queue from text hmi by @boczekbartek in #284
• refactor: manipulation toolset by @maciejmajek in #280
• fix: add tracing to the agent in RaiStateBasedLlmNode by @boczekbartek in #288
• feat: add autoware call in taxi-demo by @maciejmajek in #263
• improve RAG formating in streamlit by @boczekbartek in #289
• feat: agriculture demo by @maciejmajek in #285
• docs: add turtlebot4 tutorial by @boczekbartek in #240
• feat/docs: add rosbot xl launchfile and improve demos docs by @boczekbartek in #291
• chore(turtlebot): update links to binaries by @boczekbartek in #294
• chore: add rviz to turtlebot launchfile by @boczekbartek in #293
• docs: release update by @maciejmajek in #283
• fix(turtlebot): vendors config and readme updates by @boczekbartek in #296
• feat: add manipulation demo by @maciejmajek in #295
• feat: manipulation and taxi demo launch files and readme by @maciejmajek in #297

New Contributors

• @skrobinho made their first contribution in #245

Full Changelog: 0.9.0-beta...1.0.0

0.9.0-beta

Summary of changes

This release brings a considerable refactoring effort to the RAI's agent system. RAI architecture now consists of two separate agents:

• HMI agent (for communication, both voice and text)
• RAI agent (for solving tasks/missions)
  The default workflow now is to add a task to the RAI agent via HMI such as text_hmi (streamlit app). The RAI Agent will pick up the task, report feedback on every iteration and return task's report at the very end (success or no).

We have also added a new, refactored version of the voice interface with much better voice detection system. Our ASR now supports (possibly) any recording device (no matter the sampling rate), as well as wake word using OpenWakeWord.

Additionally, other enhancements were introduced:

• RAI What I See (Node for intelligent image capture, based on heuristics (did anything change since the last time?))
• Extended tests
• CI license checking
• NoMaD transformer based navigation system
• Overall docs improvement
• Global configuration file (config.toml) where one can set the default model that will be used across RAI's modules
• Local ASR (Whisper)
• CI has been extended to ROS 2 Humble
• Pydantic V2 compatibility with latest Langchain version

What's Changed

• fix: check status badge by @rachwalk in #173
• hri streaming and led strip publishing by @wsiekierska in #102
• chore: remove use-case specific code by @maciejmajek in #174
• remove build badge until jenkins is setup by @rachwalk in #179
• Implementing license header checking in CI by @john-science in #184
• Update poetry dependencies by @github-actions in #185
• tests: extended coverage by @maciejmajek in #190
• chore(licensechecker.yaml): check license on pr only by @maciejmajek in #193
• ci: add support for running tests on ROS Humble and Jazzy by @maciejmajek in #192
• chore: move rai_grounding_dino to rai_extensions by @maciejmajek in #195
• docs: RAI diagram by @adamdbrw in #197
• feat(rai_cli): improved UX by @maciejmajek in #189
• fix: demo repo dir name by @pijaro in #199
• docs improvements by @adamdbrw in #200
• docs: What is rai by @adamdbrw in #198
• docs: describe development environment setup by @boczekbartek in #201
• chore: remove corrupted file by @maciejmajek in #206
• refactor (human-robot-interface): various enhancements by @maciejmajek in #180
• feat: support multiple shells in the setup script by @rachwalk in #216
• docs(README.md): fix setup section & add informations about global configuration file by @maciejmajek in #210
• Update poetry dependencies by @github-actions in #211
• Refactor of Rosbot XL demo documantation by @wsiekierska in #217
• fix: remove web uri image preprocess test by @maciejmajek in #220
• chore: update tts_clients.py by @eltociear in #221
• chore: fix typos by @maciejmajek in #223
• feat: Add NoMaD extension by @knicked in #218
• refactor: HMI Node by @maciejmajek in #143
• chore: update models' config by @maciejmajek in #226
• docs: update on openVLA by @MagdalenaKotynia in #229
• docs(voice_interface.md): fix typo in docker run command for OpenTTS by @maciejmajek in #222
• chore: Update poetry dependencies (pydantic v2) by @github-actions in #228
• First version of whatisee node by @adamdbrw in #219

New Contributors

Thank you for your contributions!

• @john-science made their first contribution in #184
• @eltociear made their first contribution in #221
• @knicked made their first contribution in #218

Full Changelog: 0.8.1-beta...0.9.0-beta

0.8.1-beta

Changelog

Highlights

• Cleanup and refactors: Various improvements, including the general cleanup, as well as changes to make the project easier to navigate.
• New ROSbot-XL Running Example: Documentation now includes a running example for the ROSbot-XL, enhancing the developer experience. It also describes the usage of simulation binary for faster startup.
• Community and Developer Documentation: The project now features a developer guide, code of conduct, link to a discord server, and community section, improving accessibility and fostering community involvement.
• Automatic Dependency Updates: A new CI workflow has been added to automatically update dependencies using Poetry, ensuring that the project stays up-to-date with the latest dependencies.

What's Changed

• Create pull_request_template.md by @adamdbrw in #137
• docs: add rosbot-xl running example by @maciejmajek in #139
• chore: update rosbot xl example gif by @maciejmajek in #141
• fix: move pr template to lower directory by @maciejmajek in #145
• fix: correct license in pyproject, add description by @rachwalk in #146
• feat(ci): add workflow for automatic dependency updates using poetry by @maciejmajek in #144
• dev docs, community section by @adamdbrw in #147
• chore: add ROS 2 Humble badges by @maciejmajek in #151
• chore: cleanup by @maciejmajek in #149
• fix: removed old reference to husarion_whoami package in README. by @pijaro in #155
• describe usage of rosbot demo with o3de binary by @boczekbartek in #157
• docs: add code of conduct by @rachwalk in #152
• chore: add discord to relevant documentation by @rachwalk in #160
• Update poetry dependencies by @github-actions in #159
• chore: update discord link to permalink by @rachwalk in #161
• docs: developer guide by @maciejmajek in #158

New Contributors

• @pijaro made their first contribution in #155
• @github-actions made their first contribution in #159

Full Changelog: 0.8.0-beta...0.8.1-beta

First beta release

First public release, beta version

Contributors:

@maciejmajek
@boczekbartek
@adamdbrw
@wsiekierska
@rachwalk
@MagdalenaKotynia
@Goldob