Ppc64le docker buildx permission issues depending on which group of workers the job runs on

Environments Multi CPU Architecture
1

I’m trying to setup a build that uses docker buildx and I’m having issues on ppc64le

#1 starting container buildx_buildkit_builder-manylinux0 0.3s done
189#1 ERROR: Error response from daemon: OCI runtime create failed: container_linux.go:349: starting container process caused "process_linux.go:449: container init caused \"process_linux.go:415: setting cgroup config for procHooks process caused \\\"failed to write \\\\\\\"a *:* rwm\\\\\\\" to \\\\\\\"/sys/fs/cgroup/devices/docker/9d6b49365c88da2340ba4a93c5ddd1db6afe16632e9529ad7896b1ebefaa3dda/devices.allow\\\\\\\": write /sys/fs/cgroup/devices/docker/9d6b49365c88da2340ba4a93c5ddd1db6afe16632e9529ad7896b1ebefaa3dda/devices.allow: operation not permitted\\\"\"": unknown
190------

build logs:
https://travis-ci.com/github/pypa/manylinux/jobs/482833247

PR:

All runs well on arm64 (graviton2 vm) & also on s390x. All I could find by digging a bit on google is that it’s most likely linked to the LXD config but then, I would expect s390x to fail as well (unless both archs do not share the same config).
Anyway, I’m stuck here. Any help appreciated

Thanks

2

It seems to be working or not working depending on the location of the host.
Working here:

Not working here:

1 Like
3

I finally got it to work by spawning a rootless docker daemon myself.
See https://github.com/pypa/manylinux/pull/998 for the details.

1 Like