DNS cache memory: 5 optimizations in Big Pineapple
DNS cache memory in Big Pineapple: how five storage changes cut footprint, improved locality, and reduced lookup latency at Cloudflare scale.
Infrastructure
Infrastructure on ThecoreGrid covers the design, operation, and evolution of the foundational systems that power modern software at scale.
We explore compute, networking, and storage layers, along with virtualization, containers, and cloud platforms in highload environments. The focus is on production-grade engineering: reliability, fault tolerance, capacity planning, cost efficiency, and secure system design. Topics include Infrastructure as Code, automation, provisioning, multi-region setups, traffic routing, and failure recovery. We analyze real-world trade-offs and operational challenges, supported by BigTech practices, incident post-mortems, and lessons from large-scale infrastructure failures. You’ll find deep dives into observability, performance tuning, and platform reliability under dynamic workloads. Instead of basic setup guides, the Infrastructure tag delivers practical insights for platform engineers, DevOps teams, SREs, and architects responsible for building and maintaining robust, scalable, and efficient infrastructure systems.
AI Architecture: 4 Layers to Production
AI architecture for enterprise: 4 layers of the production stack, trade-offs between managed API and self-hosting, integration, serving, and operations.
Agent Optimization in Foundry: Request Economics
Agent optimization in Microsoft Foundry begins not with reducing token cost, but with the price of a successful outcome. For an agentic system, this is more important because one result often requires multiple model requests. The main issue here is not the model itself, but that a prototype can easily become the production default. In … Read more
Signature Search in tree networks without unnecessary magic
Signature Search in tree networks: probabilistic analysis of five strategies, exact and approximate time estimation, occupancy and synchronization overhead.
MetaRoCE and Ethernet for AI Infrastructure
MetaRoCE for AI Infrastructure: How Offloading Intelligence to the NIC Helps Ethernet Maintain Throughput, Low Tail Latency, and Graceful Recovery.
Retained bridge share for AWS Organizations
Retained bridge share in AWS Organizations: how to preserve AWS Lake Formation permissions when migrating accounts and not lose the control plane.
POWERSLIDER: dynamic power cap for LLM serving
Dynamic power caps for LLM serving: how POWERSLIDER distributes power across stages, maintains goodput, and withstands grid demand response.
MetaRoCE for AI Infrastructure on Ethernet
MetaRoCE for Ethernet-based AI infrastructure: how Meta moves intelligence into the NIC, eliminates PFC, and creates a loss-resilient transport for million-GPU scale.
Alloy central gateway: how to avoid dropping the telemetry stream
A central gateway for full telemetry: sizing, load testing, HPA, WAL, and GOMEMLIMIT in a production scenario—with no blind spots.
Remote Spectre attack on Cloudflare Workers
remote Spectre attack on Cloudflare Workers: how DyPrIs, V8 Sandbox, and in-process isolation reduced the risk of memory leakage in production.