ContextPilot introduces a fine-grained reinforcement learning approach to train LLM agents for proactive context management in long-horizon tasks. The framework addresses limitations of existing methods by expanding the available tools beyond search, deletion, and summarization, enabling agents to better retrieve, integrate, and maintain dispersed information across multi-turn interactions. This approach aims to mitigate the challenge of continuously growing working context in agentic workflows.