Text of code.visualstudio.com › blogs › 2026 › 10 › 27 › configurable-eagerness as Styx crawled it on Nov 18, 2026. The page may have changed since. Only its words are kept, without pictures or layout, and only the first part of a long page.

Open the live page

Tune GitHub Copilot Inline Suggestions with Configurable Eagerness

Join VS Code at Microsoft Ignite or catch the sessions online. A year of VS Code, wrapped. Explore the highlights. On this page Choose how proactively Copilot offers inline suggestions. A helpful suggestion at the wrong moment can still feel like an interruption. When you're completing a familiar pattern, you may want Copilot to anticipate several changes ahead. When working through delicate logic, you may prefer Copilot to scope its changes to the statement at hand and leave the next decision to you.

Community feedback about inline suggestions made both preferences clear: some developers wanted fewer suggestions, while others wanted Copilot to do more. No single default could satisfy everyone. In earlier posts about training the 3-in-1 inline suggestions model covering Completions, NES, and Long-Distance NES ( part one , part two ), we explained how developer feedback helped us improve the default experience. This strong default is a great starting point, but developers differ in how much assistance they prefer.

We wanted to let them tailor their experience to their own preferences. Configurable eagerness gives developers more control over how proactively Copilot offers inline suggestions. We trained the inline suggestions model to support three modes: low, medium, and high eagerness. In this post, we'll explain how we defined and trained those behaviors, what our first approach taught us, and how on-policy distillation (OPD) and reinforcement learning (RL) made the feature easier to carry forward to future models.

Introducing configurable eagerness We define eagerness along two dimensions: how often the model offers a suggestion and the size of each proposed edit . Eagerness setting Intended behavior Low Offer fewer suggestions and favor smaller, more conservative edits. Medium Provide the current 'default' level of assistance. High Offer suggestions more proactively, including larger edits when appropriate. These settings guide how Copilot behaves rather than imposing strict limits on suggestion timing or size.

Low eagerness still offers complete, useful suggestions; it's simply more conservative. High eagerness may propose more and larger suggestions, but only when that work is relevant to the user's current task. This demo shows a simple example: from the same starting point ( class ModelManager: ), each setting produces different behavior. Low eagerness proposes five small, incremental suggestions and leaves it to the developer to decide which methods to add and what validation they need.

High eagerness proposes three larger suggestions that anticipate follow-on work, such as raising a KeyError when attempting to remove a model that doesn't exist. Figure 1. Low, medium, and high eagerness while building a ModelManager class. To train these behaviors, we needed a measurable definition of eagerness. Because our model outputs suggestions in a diff-based format, we used edit distance (the number of characters changed by a suggestion) as a proxy for eagerness, capturing both edit size and frequency 1 .

One model, three modes We considered training a separate model for each eagerness level, but this approach would have multiplied future deployment and upgrade complexity. Instead, we trained one model to produce all three behaviors (low, medium, and high eagerness) , conditioned on a lightweight control tag: Eagerness setting Control tag Low <|aggression|>low<|/aggression|> Medium No change High <|aggression|>high<|/aggression|> We trained the model to interpret this tag as an eagerness control: it produced more conservative suggestions for low eagerness and more proactive suggestions for high eagerness, while preserving its default behavior for medium.

We started with supervised fine-tuning (SFT) . For every training prompt, we sampled responses from variants of the model with varying levels of eagerness, filtered to high-quality responses, and ordered the responses by edit distance to produce examples of low, medium, and high eagerness for each prompt in the dataset. Figure 2. Supervised fine-tuning for configurable eagerness. The training dataset is sent to model variants with different eagerness settings, and their responses are filtered by eagerness and quality into low-eagerness responses with prompts, default responses, and high-eagerness responses with prompts.

These three groups form the dataset for SFT, followed by RL and evaluation. This approach fit naturally into our existing reinforcement-learning pipeline. Most of the work happened during supervised fine-tuning, with only minimal changes to the RL setup: SFT taught the model the new low-, medium-, and high-eagerness behaviors. RL improved overall suggestion quality while preserving those learned behaviors. Making configurable eagerness portable across models The SFT approach worked, but it had two limitations that made it difficult to scale: it depended on pre-existing model variants with different eagerness levels and required retraining on responses from those models.

Adding the feature to an improved base model would therefore mean training new models and then retraining from scratch. We needed a way to preserve a new model's default behavior while adding only the low- and high-eagerness modes. The key insight was that instead of relying on multiple model variants, we could use the production model to generate and compare multiple variants of a suggestion. To make eagerness portable across future base models, we separated the behavior we wanted to preserve from the behavior we wanted to change.

The training objective had two parts: For medium eagerness, match the behavior of a reference inline suggestions model. For low and high eagerness, move edit distance below or above the reference model's medium prediction while preserving suggestion quality. Figure 3. Portable post-training with on-policy distillation for configurable eagerness. The training dataset branches into default prompts and low- and high-eagerness prompts.

Default prompts and the reference model contribute the distillation objective, while low- and high-eagerness prompts contribute quality and eagerness rewards; the combined objective feeds RL and evaluation. For medium eagerness, we used on-policy distillation (OPD) to preserve the reference model's default behavior 2 . The model under training generated responses, and the reference model supplied token-level probabilities on those same generated prefixes.

Training then minimized the difference between the two models' predicted token distributions, encouraging the model to behave like the reference. This taught the model to match the reference on its own generated responses at medium eagerness, while low- and high-eagerness modes were learned through their rewards. For low and high eagerness, we reused the quality graders developed for the 3-in-1 model's SFT and RL, then added a relative eagerness reward based on the response's edit distance compared to the reference model's medium response.

Low eagerness was rewarded for proposing a smaller edit than the reference. High eagerness was rewarded for proposing a larger one. In both cases, the quality reward prevented the model from optimizing edit distance at the expense of usefulness. Mitigating reward hacking Reward hacking occurs when a model finds a way to increase its measured reward without producing the behavior the model developer intended to encourage.

During development, we observed such failure modes in both of the new eagerness settings and added mitigations for each. High eagerness: An early reward design did not apply the quality grader to the low- and high-eagerness modes. In that training run, the model sometimes proposed unrelated functionality or unnecessary formatting changes while increasing edit distance, as seen in the example below. We addressed this failure mode by balancing eagerness rewards with rewards from the RL quality grader, plus added instructions to allow legitimately broader edits.

O

The rest of this page is on the live site.