]> Cypherpunks repositories - gostls13.git/commit
runtime: use cgroup CPU limit to set GOMAXPROCS
authorMichael Pratt <mpratt@google.com>
Mon, 5 May 2025 17:44:26 +0000 (13:44 -0400)
committerMichael Pratt <mpratt@google.com>
Wed, 21 May 2025 17:21:55 +0000 (10:21 -0700)
commite6dacf91ffb0a356aa692ab5c46411e2eef913f3
treefc337b1d3fe594503468a6af639ed6459442ee2a
parentf12c66fbed546645389cf184b0e2ffd6ad9f78ec
runtime: use cgroup CPU limit to set GOMAXPROCS

This CL adds two related features enabled by default via compatibility
GODEBUGs containermaxprocs and updatemaxprocs.

On Linux, containermaxprocs makes the Go runtime consider cgroup CPU
bandwidth limits (quota/period) when setting GOMAXPROCS. If the cgroup
limit is lower than the number of logical CPUs available, then the
cgroup limit takes precedence.

On all OSes, updatemaxprocs makes the Go runtime periodically
recalculate the default GOMAXPROCS value and update GOMAXPROCS if it has
changed. If GOMAXPROCS is set manually, this update does not occur. This
is intended primarily to detect changes to cgroup limits, but it applies
on all OSes because the CPU affinity mask can change as well.

The runtime only considers the limit in the leaf cgroup (the one that
actually contains the process), caching the CPU limit file
descriptor(s), which are periodically reread for updates. This is a
small departure from the original proposed design. It will not consider
limits of parent cgroups (which may be lower than the leaf), and it will
not detection cgroup migration after process start.

We can consider changing this in the future, but the simpler approach is
less invasive; less risk to packages that have some awareness of runtime
internals. e.g., if the runtime periodically opens new files during
execution, file descriptor leak detection is difficult to implement in a
stable way.

For #73193.

Cq-Include-Trybots: luci.golang.try:gotip-linux-amd64-longtest
Change-Id: I6a6a636c631c1ae577fb8254960377ba91c5dc98
Reviewed-on: https://go-review.googlesource.com/c/go/+/670497
LUCI-TryBot-Result: Go LUCI <golang-scoped@luci-project-accounts.iam.gserviceaccount.com>
Reviewed-by: Michael Knyszek <mknyszek@google.com>
24 files changed:
api/next/73193.txt [new file with mode: 0644]
doc/godebug.md
doc/next/4-runtime.md
doc/next/6-stdlib/99-minor/runtime/73193.md [new file with mode: 0644]
src/go/build/deps_test.go
src/internal/cgrouptest/cgrouptest_linux.go [new file with mode: 0644]
src/internal/cgrouptest/cgrouptest_linux_test.go [new file with mode: 0644]
src/internal/coverage/pkid.go
src/internal/godebugs/table.go
src/runtime/cgroup_linux.go [new file with mode: 0644]
src/runtime/cgroup_linux_test.go [new file with mode: 0644]
src/runtime/cgroup_stubs.go [new file with mode: 0644]
src/runtime/debug.go
src/runtime/float.go
src/runtime/gomaxprocs_windows_test.go [new file with mode: 0644]
src/runtime/lockrank.go
src/runtime/metrics/doc.go
src/runtime/mklockrank.go
src/runtime/proc.go
src/runtime/runtime.go
src/runtime/runtime1.go
src/runtime/runtime2.go
src/runtime/testdata/testprog/gomaxprocs.go [new file with mode: 0644]
src/runtime/testdata/testprog/gomaxprocs_windows.go [new file with mode: 0644]