Latency: Reduce delay in software systems

ISBN: 1633438082

Author: Enberg, Pekka

Condition: New

Practical techniques for delivering low latency software.From first principles to production-ready code, Latency teaches you how to make your software faster at every layer of the stack. Youll learn what latency really is, how it differs from bandwidth, and why it matters for user experience. Then, guided by practical examples, youll apply Littles Law, design lock-free algorithms, and architect caching systems that scale. Youll discover how your code runs differently on distributed systems, databases, and operating systems, and understand the common latency-causing issues in each situation.In Latency youll learn how to: Define latency, distinguish it from bandwidth, and understand its impact on user experience Model performance with Littles Law and Amdahls Law, then measure and visualize delays Optimize data access with colocation, replication, partitioning, and caching Accelerate logic with algorithmic improvements, memory tuning, and lock-free concurrency Minimize delays with asynchronous processing, predictive techniques, and speculative executionPut simply, latency is the delay between a cause and effect. In practice, too much latency can create problems throughout a software system, ranging from inaccurate calculations and timeouts to impatient users simply abandoning your applications. Latency issues can be challenging to avoid and troubleshoot. This book balances theory with practical implementations, turning academic research into useful techniques you can apply to your projects.About the technologyFrom lost microseconds routing server messages to page loads that keep users waiting, latency can kill good software. This one-of-a-kind book shows you how to spot, understand, and fix unwanted latency in your applications and infrastructure.About the bookLatency: Reduce delay in software systems shows you how to troubleshoot latency in existing applications and create low latency systems from the ground up. In it, youll discover high-impact fixes for measuring latency and advanced optimizations in memory management, concurrency models, and predictive execution. The tips and tricks, hands-on projects, and personal insights make this book as enjoyable as it is practical.What's inside How to model and measure latency Organizing application data for low latency Accelerating your code Hiding latencyAbout the readerFor software engineers with a working knowledge of backends. Examples in Rust.About the authorPekka Enberg has experience in operating systems, databases, and distributed systems, having worked on the Linux kernel and the Scylla and Turso databases.Table of ContentsPart 11 Introduction2 Modeling and measuring latencyPart 23 Colocation4 Replication5 Partitioning6 CachingPart 37 Eliminating work8 Wait-free synchronization9 Exploiting concurrencyPart 410 Asynchronous processing11 Predictive techniquesA Further reading