Skip to content
#

mapreduce-python

Here are 91 public repositories matching this topic...

MapReduce is a programming model and an associated implementation for processing and generating large data sets. Users specify a map function that processes a key/value pair to generate a set of intermediate key/value pairs, and a reduce function that merges all intermediate values associated with the same intermediate key. Many real-world tasks…

  • Updated Apr 24, 2024
  • Python

This repository aims to develop a basic search engine utilizing Hadoop's MapReduce framework to index and process extensive text corpora efficiently. The dataset used for this project is a subset of the English Wikipedia dump, totaling 5.2 GB in size. The project focuses on implementing a naive search algorithm to address challenges in information.

  • Updated Mar 31, 2024
  • Jupyter Notebook

Improve this page

Add a description, image, and links to the mapreduce-python topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the mapreduce-python topic, visit your repo's landing page and select "manage topics."

Learn more