In this hackathon, the goal is to create a machine learning model that extracts entity values from images. This capability is crucial in fields like healthcare, e-commerce, and content moderation, where precise product information is vital. As digital marketplaces expand, many products lack detailed textual descriptions, making it essential to obtain key details directly from images. These images provide important information such as weight, volume, voltage, wattage, dimensions, and many more, which are critical for digital stores.
The dataset consists of the following columns:
- index: An unique identifier (ID) for the data sample
- image_link: Public URL where the product image is available for download. Example link - https://m.media-amazon.com/images/I/71XfHPR36-L.jpg
To download images use
download_images
function fromsrc/utils.py
. See sample code insrc/test.ipynb
. - group_id: Category code of the product
- entity_name: Product entity name. For eg: “item_weight”
- entity_value: Product entity value. For eg: “34 gram”
Note: For test.csv, you will not see the column
entity_value
as it is the target variable.
A test_out.csv file in the Portal with the exact same formatting as sample_test_out.csv
source files
- src/sanity.py: Sanity checker to ensure that the final output file passes all formatting checks. Note: the script will not check if less/more number of predictions are present compared to the test file. See sample code in
src/test.ipynb
- src/utils.py: Contains helper functions for downloading images from the image_link.
- src/constants.py: Contains the allowed units for each entity type.
- sample_code.py: We also provided a sample dummy code that can generate an output file in the given format. Usage of this file is optional.
Dataset files
- dataset/train.csv: Training file with labels (
entity_value
). - dataset/test.csv: Test file without output labels (
entity_value
). Generate predictions using your model/solution on this file's data and format the output file to match sample_test_out.csv (Refer the above section "Output Format") - dataset/sample_test.csv: Sample test input file.
- dataset/sample_test_out.csv: Sample outputs for sample_test.csv. The output for test.csv must be formatted in the exact same way. Note: The predictions in the file might not be correct