process_collector: fill in virtual and resident memory values on macOS using optional cgo (#1616)
Unfortunately, these values aren't available from getrusage(2), or any other
builtin Go API. Go itself doesn't provide a mechanism (like on Windows) to call
into system libraries. Using a 3rd party package[1] to dynamically call system
libraries was proposed and rejected, to avoid adding to the number of
dependencies. That leaves using cgo, which is used here when available. When
not available (either because of cross compiling or explicitly disabling it), a
stub function is linked instead, and the metrics are not exported. That way,
cross compiling of other platforms is unaffected (and can also still be done
with Darwin too, but at the cost of not exporting these metrics).
Note that building an amd64 image on an arm64 mac or vice-versa is cross
compiling, and will use the stub method by default. This can be avoided by
setting `CGO_ENABLED=1` in the environment to force the use of cgo for both
architectures.
I'm unsure of the usefulness of the potential adjustment made to the virtual
memory value after calling `mach_vm_region()`. I've not seen that code get run
with a native amd64 or arm64 image, or with an amd64 image running under
Rosetta. But that's what the `ps(1)` command does, and I think we should report
what the system tools do.
When I was testing this on a beta of macOS 15 with Go 1.21.13 (the current
minimum support for this module), the amd64 image ran fine under Rosetta, but
the arm64 image immediately printed a message that it was killed, even prior to
the cgo call. This seems to be a recurring issue on macOS[2][3], and passing
`-ldflags -s` to `go build` avoided the issue. Go 1.23.1 worked out of the box,
without fiddling with linker flags, so I don't think this is an issue- Go 1.21
is simply too old to support macOS 15, but I thought it was worth noting. I
supposed we could gate the cgo code with an additional build flag, if anyone is
concerned about this.
[1] https://github.com/ebitengine/purego
[2] https://github.com/golang/go/issues/19841#issuecomment-293334802
[3] https://github.com/golang/go/issues/11887#issuecomment-125694604
Signed-off-by: Matt Harbison <mharbison72@gmail.com>
2024-09-27 19:29:44 +03:00
|
|
|
// Copyright 2024 The Prometheus Authors
|
|
|
|
// Licensed under the Apache License, Version 2.0 (the "License");
|
|
|
|
// you may not use this file except in compliance with the License.
|
|
|
|
// You may obtain a copy of the License at
|
|
|
|
//
|
|
|
|
// http://www.apache.org/licenses/LICENSE-2.0
|
|
|
|
//
|
|
|
|
// Unless required by applicable law or agreed to in writing, software
|
|
|
|
// distributed under the License is distributed on an "AS IS" BASIS,
|
|
|
|
// WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
|
|
|
|
// See the License for the specific language governing permissions and
|
|
|
|
// limitations under the License.
|
|
|
|
|
|
|
|
//go:build darwin && cgo
|
|
|
|
|
|
|
|
#include <mach/mach_init.h>
|
|
|
|
#include <mach/task.h>
|
|
|
|
#include <mach/mach_vm.h>
|
|
|
|
|
2024-11-08 01:22:22 +03:00
|
|
|
// The compiler warns that mach/shared_memory_server.h is deprecated, and to use
|
|
|
|
// mach/shared_region.h instead. But that doesn't define
|
|
|
|
// SHARED_DATA_REGION_SIZE or SHARED_TEXT_REGION_SIZE, so redefine them here and
|
|
|
|
// avoid a warning message when running tests.
|
|
|
|
#define GLOBAL_SHARED_TEXT_SEGMENT 0x90000000U
|
|
|
|
#define SHARED_DATA_REGION_SIZE 0x10000000
|
|
|
|
#define SHARED_TEXT_REGION_SIZE 0x10000000
|
|
|
|
|
process_collector: fill in virtual and resident memory values on macOS using optional cgo (#1616)
Unfortunately, these values aren't available from getrusage(2), or any other
builtin Go API. Go itself doesn't provide a mechanism (like on Windows) to call
into system libraries. Using a 3rd party package[1] to dynamically call system
libraries was proposed and rejected, to avoid adding to the number of
dependencies. That leaves using cgo, which is used here when available. When
not available (either because of cross compiling or explicitly disabling it), a
stub function is linked instead, and the metrics are not exported. That way,
cross compiling of other platforms is unaffected (and can also still be done
with Darwin too, but at the cost of not exporting these metrics).
Note that building an amd64 image on an arm64 mac or vice-versa is cross
compiling, and will use the stub method by default. This can be avoided by
setting `CGO_ENABLED=1` in the environment to force the use of cgo for both
architectures.
I'm unsure of the usefulness of the potential adjustment made to the virtual
memory value after calling `mach_vm_region()`. I've not seen that code get run
with a native amd64 or arm64 image, or with an amd64 image running under
Rosetta. But that's what the `ps(1)` command does, and I think we should report
what the system tools do.
When I was testing this on a beta of macOS 15 with Go 1.21.13 (the current
minimum support for this module), the amd64 image ran fine under Rosetta, but
the arm64 image immediately printed a message that it was killed, even prior to
the cgo call. This seems to be a recurring issue on macOS[2][3], and passing
`-ldflags -s` to `go build` avoided the issue. Go 1.23.1 worked out of the box,
without fiddling with linker flags, so I don't think this is an issue- Go 1.21
is simply too old to support macOS 15, but I thought it was worth noting. I
supposed we could gate the cgo code with an additional build flag, if anyone is
concerned about this.
[1] https://github.com/ebitengine/purego
[2] https://github.com/golang/go/issues/19841#issuecomment-293334802
[3] https://github.com/golang/go/issues/11887#issuecomment-125694604
Signed-off-by: Matt Harbison <mharbison72@gmail.com>
2024-09-27 19:29:44 +03:00
|
|
|
|
|
|
|
int get_memory_info(unsigned long long *rss, unsigned long long *vsize)
|
|
|
|
{
|
|
|
|
// This is lightly adapted from how ps(1) obtains its memory info.
|
|
|
|
// https://github.com/apple-oss-distributions/adv_cmds/blob/8744084ea0ff41ca4bb96b0f9c22407d0e48e9b7/ps/tasks.c#L109
|
|
|
|
|
|
|
|
kern_return_t error;
|
|
|
|
task_t task = MACH_PORT_NULL;
|
|
|
|
mach_task_basic_info_data_t info;
|
|
|
|
mach_msg_type_number_t info_count = MACH_TASK_BASIC_INFO_COUNT;
|
|
|
|
|
|
|
|
error = task_info(
|
|
|
|
mach_task_self(),
|
|
|
|
MACH_TASK_BASIC_INFO,
|
|
|
|
(task_info_t) &info,
|
|
|
|
&info_count );
|
|
|
|
|
|
|
|
if( error != KERN_SUCCESS )
|
|
|
|
{
|
|
|
|
return error;
|
|
|
|
}
|
|
|
|
|
|
|
|
*rss = info.resident_size;
|
|
|
|
*vsize = info.virtual_size;
|
|
|
|
|
|
|
|
{
|
|
|
|
vm_region_basic_info_data_64_t b_info;
|
|
|
|
mach_vm_address_t address = GLOBAL_SHARED_TEXT_SEGMENT;
|
|
|
|
mach_vm_size_t size;
|
|
|
|
mach_port_t object_name;
|
|
|
|
|
|
|
|
/*
|
|
|
|
* try to determine if this task has the split libraries
|
|
|
|
* mapped in... if so, adjust its virtual size down by
|
|
|
|
* the 2 segments that are used for split libraries
|
|
|
|
*/
|
|
|
|
info_count = VM_REGION_BASIC_INFO_COUNT_64;
|
|
|
|
|
|
|
|
error = mach_vm_region(
|
|
|
|
mach_task_self(),
|
|
|
|
&address,
|
|
|
|
&size,
|
|
|
|
VM_REGION_BASIC_INFO_64,
|
|
|
|
(vm_region_info_t) &b_info,
|
|
|
|
&info_count,
|
|
|
|
&object_name);
|
|
|
|
|
|
|
|
if (error == KERN_SUCCESS) {
|
|
|
|
if (b_info.reserved && size == (SHARED_TEXT_REGION_SIZE) &&
|
|
|
|
*vsize > (SHARED_TEXT_REGION_SIZE + SHARED_DATA_REGION_SIZE)) {
|
|
|
|
*vsize -= (SHARED_TEXT_REGION_SIZE + SHARED_DATA_REGION_SIZE);
|
|
|
|
}
|
|
|
|
}
|
|
|
|
}
|
|
|
|
|
|
|
|
return 0;
|
|
|
|
}
|