Stretching GPU performance for GEMMs and tensor contractions.

SOTA low-bit LLM quantization (INT8/FP8/INT4/FP4/NF4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX Runtime

Kernel Tuner

Pool Manager dirancang untuk mengelola pooling objek secara efisien dalam aplikasi Anda. Dengan fitur-fitur seperti sharding, caching, auto-tuning, dan kebijakan eviksi, package ini membantu meningkatkan performa dan efisiensi penggunaan memori.

bpftune uses BPF to auto-tune Linux systems

Must read research papers and links to tools and datasets that are related to using machine learning for compilers and systems optimisation

This software package accompanies the paper "A Methodology for Comparing Auto-Tuning Optimization Algorithms" (https://doi.org/10.1016/j.future.2024.05.021), making the guidelines in the methodology easy to apply.

Alchemy Cat —— 🔥Config System for SOTA

A GPU benchmark suite for autotuners

K2vTune (A Workload-aware Configuration Tuning for RocksDB)

fann networks+forex + MILK + met8

Autotuner for Spark applications

A self-hosted language learning website

CLTune: An automatic OpenCL & CUDA kernel tuner

Benchmark scripts for TVM

Machine Learning Framework for Operating Systems - Brings ML to Linux kernel

A Generic Distributed Auto-Tuning Infrastructure

Collective Knowledge crowd-tuning extension to let users crowdsource their experiments (using portable Collective Knowledge workflows) such as performance benchmarking, auto tuning and machine learning across diverse platforms with Linux, Windows, MacOS and Android provided by volunteers. Demo of DNN crowd-benchmarking and crowd-tuning:

Phoebe

ebpf profiler for jvm