Applying Spark NLP models to Enron datasets with Postgres

Project that captures information about all Dark Souls 3 (DS3) weapons and performs textual analysis on.

Text summarization algorithms using PySpark

Python scripts to process, and analyze log files using PySpark.

Perform sentiment analysis on Yelp dataset with Apache Spark

Benchmark inference of custom and pre-trained NLP models with Spark NLP.

Final Project for Harvard's Scala for Big Data Systems course

This is the repository for all of my Spark projects, which include Spark NLP & Computer Vision projects.

Big data project to analyze (Subreddit : NoStupidQuestions) comments

Spark training examples of Machine Learning and Natural Language Processing, using Spark ML and Spark NLP libraries.

Compilation of NLP notebooks from various sources that address several technical challenges.

Miscellaneous codes and writings for MLOps

SparkNLP and Healthcare SparkNLP based analysis of scientific literature on equine colic.

Deep Learning notes and practical implementation with Tensorflow and keras. Text Analytics and practical application implementation with NLTK, Spacy and Gensim.

Testing and benchmarking some of the existing NLP libraries in Apache Spark

contains notebooks on topic modeling, spark and pandas implementation

O projeto mostra a utilização de alguns métodos da biblioteca Spark NLP que são utilizados para processamento de linguagem natural.

An implementation of NLP Sandbox PHI Annotator API based on Spark NLP

This project is a Spark ML pipeline using Pyspark for NLP, using annotators: DocumentAssembler, Tokenizer, WordEmbeddingsModel, PerceptronModel & NerCrfModel. It prints a transformed DataFrame showing POS & NER columns, and analyzes any relationship between found entities & their POS attributes. Hands-on experience with Spark, Pyspark & Spark-NLP.

NLP functions with John Snow's Spark NLP in the Java language