Running local LLM inference servers like llama.cpp or vLLM on localhost with default configurations exposes them to cross-site request forgery (CSRF) and DNS rebinding attacks from any open browser tab. Malicious websites can send requests to these servers to trigger model generation and potentially read responses, despite binding only to 127.0.0.1. This decades-old web vulnerability applies directly to locally hosted AI models.

Read original