Skip to content

Latest commit

 

History

History

data_preparation

Folders and files

NameName
Last commit message
Last commit date

parent directory

..
 
 
 
 

Data Preparation

Overview

Contains scripts for preparing the data in JSON format to be indexed. This includes data extraction, transformation, and cleaning processes.

Steps Involved

  • Extraction: Extracting relevant data from the raw data collected by the Scanner.
  • Transformation: Transforming the data to match the desired JSON structure.
  • Cleaning: Cleaning the data and substituting any missing fields or handling mismatched data types.