Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

AI insights #8384

Draft
wants to merge 13 commits into
base: develop
Choose a base branch
from
Draft

AI insights #8384

wants to merge 13 commits into from

Commits on Sep 13, 2024

  1. Remove Azure Storage gem

    This isn't used as far as we know and also isn't manitained. Due to old
    gem requirements if preventing some new gem from being installed.
    gbp committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    9aa8224 View commit details
    Browse the repository at this point in the history
  2. Update Foi#Attachment#body_as_html

    Allow method to be run without arguments.
    gbp committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    dc6d12d View commit details
    Browse the repository at this point in the history

Commits on Sep 20, 2024

  1. Add Workflow system for processing sequential jobs

    This commit introduces a new Workflow system that allows for the
    execution of a sequence of jobs on a given resource.
    
    Components include:
    - Workflow class: Manages the overall workflow and job execution
    - Workflow::Job model: Represents individual jobs within a workflow
    - Workflow::Source module: Handles source content and output attachments
    - Workflow::Transitions module: Manages job state transitions
    - WorkflowJob: Background job for processing workflows
    
    Features:
    - Sequential job execution with parent-child relationships
    - Job status tracking (pending, queued, processing, failed, completed)
    - Automatic progression through workflow steps
    - Extensible design for custom job types
    
    This lays the groundwork for implementing specific workflow processes in
    the application.
    gbp committed Sep 20, 2024
    Configuration menu
    Copy the full SHA
    2c0b2de View commit details
    Browse the repository at this point in the history
  2. Add chunking functionality for AI-powered analysis

    - Introduce Chunk model for storing text fragments and embeddings
    - Add Chunkable concern for processing models through chunking workflow
    - Implement chunking for InfoRequest, IncomingMessage, and FoiAttachment
      models
    
    This commit lays the groundwork for AI-powered text analysis by adding
    a chunking system that breaks down text from various models into smaller,
    analyzable pieces.
    gbp committed Sep 20, 2024
    Configuration menu
    Copy the full SHA
    dba632a View commit details
    Browse the repository at this point in the history
  3. Add Workflow Jobs for text processing and chunking

    - Implement ConvertToText, AnonymizeText, and CreateChunks jobs
    - Update Workflow class to use new job classes
    gbp committed Sep 20, 2024
    Configuration menu
    Copy the full SHA
    d486ec9 View commit details
    Browse the repository at this point in the history
  4. WIP Fix GitHub actions

    gbp committed Sep 20, 2024
    Configuration menu
    Copy the full SHA
    69ddb55 View commit details
    Browse the repository at this point in the history
  5. WIP Extend HTTP read timeout

    gbp committed Sep 20, 2024
    Configuration menu
    Copy the full SHA
    f4aaaa1 View commit details
    Browse the repository at this point in the history
  6. WIP Chunk text automatically

    Run on requests where the requester is using projects and has the
    insights feature flag.
    gbp committed Sep 20, 2024
    Configuration menu
    Copy the full SHA
    926dc0d View commit details
    Browse the repository at this point in the history
  7. WIP Project insights

    gbp committed Sep 20, 2024
    Configuration menu
    Copy the full SHA
    2c580c0 View commit details
    Browse the repository at this point in the history
  8. fixup! WIP Project insights

    gbp committed Sep 20, 2024
    Configuration menu
    Copy the full SHA
    a936d45 View commit details
    Browse the repository at this point in the history
  9. WIP UI

    gbp committed Sep 20, 2024
    Configuration menu
    Copy the full SHA
    aabeedd View commit details
    Browse the repository at this point in the history
  10. WIP temporarily disable

    gbp committed Sep 20, 2024
    Configuration menu
    Copy the full SHA
    457d31b View commit details
    Browse the repository at this point in the history
  11. fixup! WIP UI

    gbp committed Sep 20, 2024
    Configuration menu
    Copy the full SHA
    ac5eef3 View commit details
    Browse the repository at this point in the history