GitHub moved the Copilot runtime to Rust π
GitHub migrated the runtime behind Copilot to Rust, and used Copilot during the migration itself.
β
Why this is worth reading:
β’ Runtime work is systems work: a language migration means tracing real production behavior, not just translating syntax.
β’ Copilot was part of the workflow: useful for exploring an unfamiliar codebase, drafting changes, and keeping momentum through repetitive conversion work.
β’ The output still needs engineering judgment: boundaries, performance, correctness, and rollout safety are not autocomplete problems.
This is a practical case study for teams asking where coding agents help on a large refactor. Use them to accelerate investigation and implementation. Keep humans on architecture, tests, and production checks.
[ Blog ] :
https://github.blog/ai-and-ml/generative-ai/migrating-the-github-copilot-runtime-to-rust-using-copilot
γ°οΈγ°οΈγ°οΈγ°οΈγ°οΈγ°οΈ
#AI #GitHub #Rust #Copilot
@ProgrammingTip
GitHub migrated the runtime behind Copilot to Rust, and used Copilot during the migration itself.
β’ Runtime work is systems work: a language migration means tracing real production behavior, not just translating syntax.
β’ Copilot was part of the workflow: useful for exploring an unfamiliar codebase, drafting changes, and keeping momentum through repetitive conversion work.
β’ The output still needs engineering judgment: boundaries, performance, correctness, and rollout safety are not autocomplete problems.
This is a practical case study for teams asking where coding agents help on a large refactor. Use them to accelerate investigation and implementation. Keep humans on architecture, tests, and production checks.
[ Blog ] :
https://github.blog/ai-and-ml/generative-ai/migrating-the-github-copilot-runtime-to-rust-using-copilot
γ°οΈγ°οΈγ°οΈγ°οΈγ°οΈγ°οΈ
#AI #GitHub #Rust #Copilot
@ProgrammingTip
Please open Telegram to view this post
VIEW IN TELEGRAM
The GitHub Blog
Migrating the GitHub Copilot runtime to Rust, using Copilot
A rewrite this size wasn't affordable before agents. Here's what porting the Copilot agent runtime to 800,000 lines of production Rust actually took.
Cloudflare saved 100 TB of RAM with math and Rust π₯
Cloudflare reclaimed more than 100 TB of RAM globally in a Pingora-based consistent-hashing service. No new hardware. The win came from changing data representation and the algorithms around it.
β
Lessons:
β’ Measure retained memory, not only allocation rate.
β’ Check collection shape: duplicated keys, oversized buckets, and pointer-heavy graphs add up fast.
β’ Fix the model first: a smaller or more compact structure usually beats micro-optimizing a hot loop.
For high-cardinality caches, routing tables, or tenant maps, take a heap dump before reaching for another cache node. A few bytes per entry becomes expensive at fleet scale.
[ Blog ] :
https://blog.cloudflare.com/saving-100-tb-of-ram-with-math
γ°οΈγ°οΈγ°οΈγ°οΈγ°οΈγ°οΈ
#Performance #Memory #Rust
@ProgrammingTip
Cloudflare reclaimed more than 100 TB of RAM globally in a Pingora-based consistent-hashing service. No new hardware. The win came from changing data representation and the algorithms around it.
β’ Measure retained memory, not only allocation rate.
β’ Check collection shape: duplicated keys, oversized buckets, and pointer-heavy graphs add up fast.
β’ Fix the model first: a smaller or more compact structure usually beats micro-optimizing a hot loop.
For high-cardinality caches, routing tables, or tenant maps, take a heap dump before reaching for another cache node. A few bytes per entry becomes expensive at fleet scale.
[ Blog ] :
https://blog.cloudflare.com/saving-100-tb-of-ram-with-math
γ°οΈγ°οΈγ°οΈγ°οΈγ°οΈγ°οΈ
#Performance #Memory #Rust
@ProgrammingTip
Please open Telegram to view this post
VIEW IN TELEGRAM
Cloudflare Blog
Saving another 100TB of RAM with math (and Rust)
Cloudflare's global network is immense but not limitless. As we look for small ways to trim our resource usage, we sometimes get lucky and we can cut significantly more. Hereβs how we reduced one of our Pingora-based service's RAM usage with statistics.