GitHub Trending repo Repositories 18h ago

oujingzhou/vllm4j: A minimal Java LLM inference engine with paged KV cache (PagedAttention), prefix caching and continuous batching — ~1.5K lines, CPU-only via Java Vector API. Supports Qwen3

by oujingzhou

A minimal Java LLM inference engine with paged KV cache (PagedAttention), prefix caching and continuous batching — ~1.5K lines, CPU-only via Java Vector API. Supports Qwen3

Read Original
API LLM

Metadata

Stars
4
Language
Java
Watchers
4

Related

GitHub Trending repo 14h ago

ramyadharshinimurugaprakash-commits/Titanic-Preprocessing: This project performs Exploratory Data Analysis (EDA) and data preprocessing on the Titanic dataset using Python in Google Colab. It includes data cleaning, handling missing values, statistical analysis, data visualization, feature engineering, and dataset preparation using Pandas and NumPy for future machine learning applications.

This project performs Exploratory Data Analysis (EDA) and data preprocessing on the Titanic dataset using Python in Google Colab. It includes data cleaning, handling missing values...

39