GitHub Copilot (underpinned by the Copilot Agent Runtime, or "CAR")
The Rust Restructure
As the author (Stephen Toub) notes: "A rewrite this size wasn't affordable before agents". 800,000 lines of production Rust was the result - which were much more performant than the (legacy) TypeScript. 128 pull requests landed in main and were shipped incrementally rather than in one cutover at the end. Regressions were discovered and fixed quickly along the way. The author estimates this work would have taken a year or two before agents came on the scene.
Rationale
The "CAR" was increasingly the back-end of multiple Microsoft products - including Copilot Studio and Copilot Cowork. Many products had their own agent loop previously but this could be replaced a revampled "CAR" (recall the R stands for "runtime"). Shared runtime == good :)
In Depth Analysis
There are some great deep dives into the various architectural directives used in the porting of Copilot runtime. Read the original blog post (on github.blog) for more insights
No comments:
Post a Comment