Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Enable Feature Factory to support LLMs RAG #20

Open
wants to merge 27 commits into
base: master
Choose a base branch
from
Open

Enable Feature Factory to support LLMs RAG #20

wants to merge 27 commits into from
+932 −26

Commits on Apr 25, 2023

  1. add support for catalog

    @lyliyu
    lyliyu committed Apr 25, 2023
    Configuration menu
    Copy the full SHA
    67339ee View commit details
    Browse the repository at this point in the history

Commits on May 16, 2023

  1. add catalog base

    @lyliyu
    lyliyu committed May 16, 2023
    Configuration menu
    Copy the full SHA
    0a21113 View commit details
    Browse the repository at this point in the history

Commits on Jun 15, 2023

  1. agg granularity to restrict group by

    @lyliyu
    lyliyu committed Jun 15, 2023
    Configuration menu
    Copy the full SHA
    4821dc5 View commit details
    Browse the repository at this point in the history

Commits on Nov 6, 2023

  1. add llm tools

    @lyliyu
    lyliyu committed Nov 6, 2023
    Configuration menu
    Copy the full SHA
    a21e3aa View commit details
    Browse the repository at this point in the history

Commits on Nov 9, 2023

  1. add mapparitions for generating chunks col

    @lyliyu
    lyliyu committed Nov 9, 2023
    Configuration menu
    Copy the full SHA
    22370b3 View commit details
    Browse the repository at this point in the history

Commits on Nov 10, 2023

  1. check the resource and create if not created before running apply logic

    @lyliyu
    lyliyu committed Nov 10, 2023
    Configuration menu
    Copy the full SHA
    7df4bc4 View commit details
    Browse the repository at this point in the history

  2. add tokenizer to the text splitter

    @lyliyu
    lyliyu committed Nov 10, 2023
    Configuration menu
    Copy the full SHA
    9e961fb View commit details
    Browse the repository at this point in the history

  3. add llm notebooks

    @lyliyu
    lyliyu committed Nov 10, 2023
    Configuration menu
    Copy the full SHA
    38abaca View commit details
    Browse the repository at this point in the history

  4. add dependencies for langchain and llamaindex

    @lyliyu
    lyliyu committed Nov 10, 2023
    Configuration menu
    Copy the full SHA
    e78ac55 View commit details
    Browse the repository at this point in the history

  5. add sample file for testing

    @lyliyu
    lyliyu committed Nov 10, 2023
    Configuration menu
    Copy the full SHA
    67f33eb View commit details
    Browse the repository at this point in the history

  6. changed to relative path

    @lyliyu
    lyliyu committed Nov 10, 2023
    Configuration menu
    Copy the full SHA
    06f3367 View commit details
    Browse the repository at this point in the history

  7. fix build issue

    @lyliyu
    lyliyu committed Nov 10, 2023
    Configuration menu
    Copy the full SHA
    e7eae70 View commit details
    Browse the repository at this point in the history

Commits on Nov 11, 2023

  1. utils funcs to convert between string, document and lcdocument

    @lyliyu
    lyliyu committed Nov 11, 2023
    Configuration menu
    Copy the full SHA
    09d88b8 View commit details
    Browse the repository at this point in the history

  2. add tokenizer splitter

    @lyliyu
    lyliyu committed Nov 11, 2023
    Configuration menu
    Copy the full SHA
    3332711 View commit details
    Browse the repository at this point in the history

  3. Merge pull request #18 from lyliyu/llms 

    Enable feature factory with data preparation for LLMs
    @lyliyu
    lyliyu authored Nov 11, 2023
    Configuration menu
    Copy the full SHA
    294d4f9 View commit details
    Browse the repository at this point in the history

Commits on Nov 13, 2023

  1. updated readme; requirements; add catalog for llm features.

    @lyliyu
    lyliyu committed Nov 13, 2023
    Configuration menu
    Copy the full SHA
    cff8eda View commit details
    Browse the repository at this point in the history

  2. add comments to llms api and classes

    @lyliyu
    lyliyu committed Nov 13, 2023
    Configuration menu
    Copy the full SHA
    0ed788b View commit details
    Browse the repository at this point in the history

  3. remove unnecessary imports

    @lyliyu
    lyliyu committed Nov 13, 2023
    Configuration menu
    Copy the full SHA
    aa41e99 View commit details
    Browse the repository at this point in the history

  4. fixed langchain version

    @lyliyu
    lyliyu committed Nov 13, 2023
    Configuration menu
    Copy the full SHA
    7b7ecb2 View commit details
    Browse the repository at this point in the history

  5. fix openai at 0.27.8

    @lyliyu
    lyliyu committed Nov 13, 2023
    Configuration menu
    Copy the full SHA
    f80c25c View commit details
    Browse the repository at this point in the history

Commits on Nov 14, 2023

  1. add specific version of openai to setup.py

    @lyliyu
    lyliyu committed Nov 14, 2023
    Configuration menu
    Copy the full SHA
    05817bf View commit details
    Browse the repository at this point in the history

  2. give a range for openai

    @lyliyu
    lyliyu committed Nov 14, 2023
    Configuration menu
    Copy the full SHA
    f5f2e80 View commit details
    Browse the repository at this point in the history

Commits on Nov 15, 2023

  1. install openai

    @lyliyu
    lyliyu committed Nov 15, 2023
    Configuration menu
    Copy the full SHA
    92ca58e View commit details
    Browse the repository at this point in the history

Commits on Nov 17, 2023

  1. implemented extract_directory_metadata to extract metadata from file … 

    …paths
    @lyliyu
    lyliyu committed Nov 17, 2023
    Configuration menu
    Copy the full SHA
    872b900 View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'ff_llms/llms' into llms

    @lyliyu
    lyliyu committed Nov 17, 2023
    Configuration menu
    Copy the full SHA
    b079aa2 View commit details
    Browse the repository at this point in the history

Commits on Dec 2, 2023

  1. Impl extractor subclassing llmtool; provide extractors as input to th… 

    …e doc splitter
    @lyliyu
    lyliyu committed Dec 2, 2023
    Configuration menu
    Copy the full SHA
    6a1272c View commit details
    Browse the repository at this point in the history

Commits on Dec 10, 2023

  1. customize prompt template

    @lyliyu
    lyliyu committed Dec 10, 2023
    Configuration menu
    Copy the full SHA
    c3216a2 View commit details
    Browse the repository at this point in the history