Faster, more accurate autocomplete with VS Code

Alex IskenAlex IskenAugust 21, 2024Cody,VS Code,Autocomplete,v1.32

Autocomplete has been overhauled with multiple under-the-hood changes, making it both faster and more accurate:

  • P75 latency is down by 350 milliseconds
  • Multi-line completions are significantly more accurate and relevant to the surrounding context
  • The average completion acceptance rate (CAR) for early users is up by >4%

These updates are powered by several server-side and client-side optimizations. We’ve also updated the default autocomplete model from StarCoder to DeepSeek-V2, significantly improving responsiveness and accuracy.

These updates are available now for Free and Pro users. We’ve rolled out some of these autocomplete updates to Enterprise users as well, but the most significant updates (including moving to DeepSeek-V2) will come to Enterprise users soon.