VidSense: Lock in with YouTube!

Table of Contents

• Overview
• Key Features
• Technologies Used
• Installation
• Usage
• Demo
• Contributing
• License
• Acknowledgments

Overview

VidSense is a browser extension that provides instant answers and concise summaries based on the YouTube video you're watching. It offers AI-powered responses directly within your current tab, enhancing your video-watching experience.

Key Features

Question-Answering

VidSense uses YouTube video captions to provide accurate and contextually relevant answers to user queries. This feature allows users to quickly find precise information without watching the entire video.

Summarization

Get concise summaries of YouTube videos to grasp the main points and essential information quickly. This feature helps users efficiently access key ideas without watching the full content.

Additional Prompts

The question-answering tab also supports any other prompts such as "Generate a quiz" or "Translate to Hindi", further enhancing the utility of the extension.

Technologies Used

• Frontend: HTML/CSS/JavaScript
• Backend: Flask
• AI Integration: Google Gemini
• Containerization: Docker
• API Integration: MindsDB

Installation

Download the Latest Release

1. Download the latest release here.
2. Extract the files to your preferred location.

Backend Setup

1. Install Docker Desktop.

2. Set up MindsDB on Docker following this guide.

3. Open the SQL editor in the MindsDB extension and run the following queries:

   CREATE ML_ENGINE google_gemini_engine
   FROM google_gemini
   USING
         google_gemini_api_key = 'your-api-key';
   
   CREATE MODEL google_gemini_model
   PREDICT answer
   USING
         engine = 'google_gemini_engine',
         column = 'question',
         model = 'gemini-pro';
   

4. Download and install Python. Skip this step if it is already installed on your computer.

5. Run the install-dependencies.bat file in the extracted folder.

Extension Setup

1. Enable Extension developer mode in your browser.
2. Click on "Load Unpacked" and select the extension folder from the extracted files.
3. The VidSense extension will now be available in your browser's extensions menu.

Usage

1. Make sure the MindsDB Docker container is running
2. Start the server by running start.bat.
3. Navigate to a YouTube video.
4. Click the VidSense extension icon to open the interface.
5. Use the summary or question-answering features as needed.
6. Stop the server using stop.bat when finished.

Demo

(Click to watch on YouTube)

Screenshots

Question-Answering:

Summarization:

Additional prompt using Question-Answering (Quiz):

Contributing

If you'd like to contribute, please follow these steps:

1. Fork the repository

2. Create your feature branch:

   git checkout -b your-name/feature

3. Commit your changes:

   git commit -m 'Add some feature'

4. Push to the branch:

   git push origin your-name/feature

5. Open a Pull Request

License

This project is licensed under the MIT License.

Acknowledgments

• MindsDB for AI Data automation
• Google Gemini API for LLM tasks
• Flask for the backend framework
• Docker for containerization
• youtube-transcript-api for extracting YouTube captions.

---