The llama.cpp project has added OCP FP8 support and FP8 KV-cache capabilities alongside targeted CUDA optimizations. These improvements enable faster GPU inference and reduced memory usage for local LLM deployments. The updates enhance quantization efficiency and kernel performance on NVIDIA hardware.