SkillGPT: a RESTful API service for skill extraction and standardization using a Large Language Model

Nan Li, Bo Kang, Tijl De bie

IDLAB - Department of Electronics and Information Systems (ELIS), Ghent University

Paper

Demo Video

Requirements

• Environment
  • Python 3.8 or later
  • Docker
  • Redis

Installation

1. Make sure you have all the requirements listed above

2. Clone the repository

   git clone https://github.com/aida-ugent/SkillGPT.git

3. Navigate to the directory where the repository was downloaded

   cd SkillGPT

4. Install the required dependencies

   pip install -r requirements.txt

5. Configure SkillGPT

   1. Locate the file named .env.template in the main /SkillGPT folder.
   2. Create a copy of this file, called .env by removing the template extension.
   3. Open the .env file in a text editor.
   4. Enter Model server info as well as Redis server info.
   5. Save and close the .env file.

Environment vairable setup

Set the following settings in .env

API_HOST="127.0.0.1" # the IP or domain to launch the api gateway
API_PORT=21002
REDIS_HOST=localhost # the IP or domain of the running redis instance
REDIS_PORT=6379
MODEL_PATH=models/vicuna_13b # the path to Huggingface AutoModelForCausalLM model

Usage

1. Launch docker service

   sudo docker run --name redis-stack-server -p 6379:6379 redis/redis-stack-server:latest

2. Run api Python module in your terminal

   python -m api

3. Launch gradio interface

   python gradio_server.py

4. Process via API requests. See examples in api_request.ipynb.

5. (Optional) initalize Redis vector DB. See example in the last cell "Initialize ESCO embeddings" in api_request.ipynb.

Access to the embedding files

Please fill in the form https://forms.gle/vKXKxCegWjzni1aM7 .