Architectural Trends
Classic OS: cycles are the scarce resource
- but increasing gap between cycles and I/O or memory (Sites: pin bandwidth on SQL Server)
OS overhead cripples relative performance
- cross-machine communication limited by data copying, interrupt processing, thread management, but not network transfer time
Network and memory are far away (in cycles)
- hide latency: large amounts of parallelism
- goal: keep critical resource busy