feat: describe graph (PT-188650872) #22
Open
+134
−88
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
emcelroy
commented
Jan 6, 2025
| @@ -1,38 +1,3 @@ | |||
| import { AssistantTool } from "openai/resources/beta/assistants"; | |||
|
|
|||
| export const openAiTools: AssistantTool[] = [ | |||
There was a problem hiding this comment.
These are no longer needed in the plugin codebase. The tool functions will be created and edited exclusively on the OpenAI platform going forward.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
#188650872
With these changes and related changes to CODAP v3 plus modified AI assistant instructions, the assistant will request an image snapshot of a graph in CODAP when the user asks DAVAI to describe what a graph actually looks like. With the proper CODAP API request, CODAP will send the plugin a base64-encoded string which the plugin can convert to a file and upload to the assistant's file storage for analysis.
To test this out in a browser, you'll need to use a branch CODAP v3 URL, as well as the plugin branch URL with the
modeparam set to "development", like so:https://codap3.concord.org/branch/describe-graph-by-text/index.html?sample=mammals&di=https://codap3.concord.org/davai-plugin/branch/describe-graph-by-text/?mode=development
You'll also need to change the assistant to "DAVAI Image Interpretation" in the Developer Options section of the plugin.