WARN[0157] [hostagent] Failed to run /usr/lib/qemu/virtiofsd --version (is this QEMU virtiofsd?): exit s tatus 1: setgroups() failed with error=1:Operation not permitted #1849

lattice0 · 2023-09-27T02:13:19Z

lattice0
Sep 27, 2023

On a ubuntu 23.04 host on a intel i7 11th gen with KVM support, I get, when running:

limactl start \
  --name=$MACHINE_NAME \
  --cpus=$CPU_COUNT \
  --memory=$MEMORY \
  --tty=false \
  --mount-type=virtiofs \
  template://ubuntu

this error:

WARN[0157] [hostagent] Failed to run /usr/lib/qemu/virtiofsd --version (is this QEMU virtiofsd?): exit s
tatus 1: setgroups() failed with error=1:Operation not permitted
FATA[0157] exiting, status={Running:false Degraded:false Exiting:true Errors:[] SSHLocalPort:0} (hint: s
ee "/home/lz/.lima/dev1/ha.stderr.log")

file output:

lz@lz:~$ cat /home/lz/.lima/dev1/ha.stderr.log
{"level":"debug","msg":"Creating iso file /home/lz/.lima/dev1/cidata.iso","time":"2023-09-26T23:0
7:42-03:00"}
{"level":"debug","msg":"Using /tmp/diskfs_iso1253774483 as workspace","time":"2023-09-26T23:07:42
-03:00"}
{"level":"debug","msg":"OpenSSH version 9.0.1 detected","time":"2023-09-26T23:07:42-03:00"}
{"level":"debug","msg":"AES accelerator seems available, prioritizing aes128-gcm@openssh.com and
aes256-gcm@openssh.com","time":"2023-09-26T23:07:42-03:00"}
{"level":"debug","msg":"Start udp DNS listening on: 127.0.0.1:36003","time":"2023-09-26T23:07:42-
03:00"}
{"level":"debug","msg":"Start tcp DNS listening on: 127.0.0.1:32857","time":"2023-09-26T23:07:42-
03:00"}
{"level":"debug","msg":"QEMU version 7.2.0 detected","time":"2023-09-26T23:07:42-03:00"}
{"level":"debug","msg":"firmware candidates = [/home/lz/.local/share/qemu/edk2-x86_64-code.fd /us
r/share/qemu/edk2-x86_64-code.fd /usr/share/OVMF/OVMF_CODE.fd /usr/share/qemu/ovmf-x86_64-code.bi
n /usr/share/edk2-ovmf/x64/OVMF_CODE.fd]","time":"2023-09-26T23:07:42-03:00"}
{"level":"debug","msg":"Checking vhost directory /home/lz/.local/share/qemu/vhost-user","time":"2
023-09-26T23:07:42-03:00"}
{"level":"debug","msg":"Failed to list vhost directory: open /home/lz/.local/share/qemu/vhost-use
r: no such file or directory","time":"2023-09-26T23:07:42-03:00"}
{"level":"debug","msg":"Checking vhost directory /usr/share/qemu/vhost-user","time":"2023-09-26T2
3:07:42-03:00"}
{"level":"debug","msg":"Checking vhost config 50-qemu-gpu.json","time":"2023-09-26T23:07:42-03:00
"}
{"level":"debug","msg":"{gpu /usr/lib/qemu/vhost-user-gpu}","time":"2023-09-26T23:07:42-03:00"}
{"level":"debug","msg":"Checking vhost config 50-qemu-virtiofsd.json","time":"2023-09-26T23:07:42
-03:00"}
{"level":"debug","msg":"{fs /usr/lib/qemu/virtiofsd}","time":"2023-09-26T23:07:42-03:00"}
{"level":"warning","msg":"Failed to run /usr/lib/qemu/virtiofsd --version (is this QEMU virtiofsd
?): exit status 1: setgroups() failed with error=1:Operation not permitted\n","time":"2023-09-26T
23:07:42-03:00"}
{"level":"fatal","msg":"Failed to locate virtiofsd","time":"2023-09-26T23:07:42-03:00"}

afbjorklund · 2023-09-29T06:43:24Z

afbjorklund
Sep 29, 2023
Maintainer

You need to use the new Rust virtiofsd, not the "old" C virtiofsd

$ /usr/lib/qemu/virtiofsd --version
setgroups() failed with error=1:Operation not permitted

https://lima-vm.io/docs/config/mount/#virtiofs

https://qemu.readthedocs.io/en/v7.2.0/tools/virtiofsd.html
/usr/lib/qemu/virtiofsd
virtiofsd version 7.2.0 (Debian 1:7.2+dfsg-5ubuntu2.3)
https://gitlab.com/virtio-fs/virtiofsd
/usr/local/bin/virtiofsd
virtiofsd 1.8.0-dirty

4 replies

lattice0 Oct 9, 2023
Author

~/lima/bin$ virtiofsd --version
virtiofsd 1.8.0-dirty

and then

./limactl start --name virt  --mount-type=virtiofs   template://ubuntu
? Creating an instance "virt" Proceed with the current configuration
WARN[0001] `mountType: virtiofs` on Linux is experimental
INFO[0001] Attempting to download the image              arch=x86_64 digest="sha256:5ad255d32a30a2cda9f0df19f0a6ce8d6f3c81b63
845086a4cb5c43cf97fcb92" location="https://cloud-images.ubuntu.com/releases/23.04/release-20230810/ubuntu-23.04-server-cloudi
mg-amd64.img"
INFO[0002] Using cache "/home/lz/.cache/lima/download/by-url-sha256/e54a5ae9983387df7e867747dfd1d4b75b09df51588512504b67579b7
b7b4f1f/data"
INFO[0002] Attempting to download the nerdctl archive    arch=x86_64 digest="sha256:3f8c494e3c6a265fe2a3c41ef9d6bc859eeeb2209
5b3353d3558d8120833a23a" location="https://github.com/containerd/nerdctl/releases/download/v1.5.0/nerdctl-full-1.5.0-linux-am
d64.tar.gz"
INFO[0002] Using cache "/home/lz/.cache/lima/download/by-url-sha256/72a70b017cb55385b4c43d2bcc2a0333094089f1da0739a34c51c647b
f249674/data"
WARN[0002] [hostagent] Failed to run /usr/lib/qemu/virtiofsd --version (is this QEMU virtiofsd?): exit status 1: setgroups()
failed with error=1:Operation not permitted
FATA[0002] exiting, status={Running:false Degraded:false Exiting:true Errors:[] SSHLocalPort:0} (hint: see "/home/lz/.lima/vi
rt/ha.stderr.log")

error log:


~/lima/bin$ cat /home/lz/.lima/virt/ha.stderr.log
{"level":"debug","msg":"Creating iso file /home/lz/.lima/virt/cidata.iso","time":"2023-10-09T00:05:09-03:00"}
{"level":"debug","msg":"Using /tmp/diskfs_iso2044734303 as workspace","time":"2023-10-09T00:05:09-03:00"}
{"level":"debug","msg":"OpenSSH version 8.9.1 detected","time":"2023-10-09T00:05:10-03:00"}
{"level":"debug","msg":"AES accelerator seems available, prioritizing aes128-gcm@openssh.com and aes256-gcm@openssh.com","tim
e":"2023-10-09T00:05:10-03:00"}
{"level":"debug","msg":"Start udp DNS listening on: 127.0.0.1:33483","time":"2023-10-09T00:05:10-03:00"}
{"level":"debug","msg":"Start tcp DNS listening on: 127.0.0.1:44987","time":"2023-10-09T00:05:10-03:00"}
{"level":"debug","msg":"QEMU version 6.2.0 detected","time":"2023-10-09T00:05:10-03:00"}
{"level":"debug","msg":"firmware candidates = [/home/lz/.local/share/qemu/edk2-x86_64-code.fd /usr/share/qemu/edk2-x86_64-cod
e.fd /usr/share/OVMF/OVMF_CODE.fd /usr/share/qemu/ovmf-x86_64-code.bin /usr/share/edk2-ovmf/x64/OVMF_CODE.fd]","time":"2023-1
0-09T00:05:10-03:00"}
{"level":"debug","msg":"Checking vhost directory /home/lz/.local/share/qemu/vhost-user","time":"2023-10-09T00:05:10-03:00"}
{"level":"debug","msg":"Failed to list vhost directory: open /home/lz/.local/share/qemu/vhost-user: no such file or directory
","time":"2023-10-09T00:05:10-03:00"}
{"level":"debug","msg":"Checking vhost directory /usr/share/qemu/vhost-user","time":"2023-10-09T00:05:10-03:00"}
{"level":"debug","msg":"Checking vhost config 50-qemu-gpu.json","time":"2023-10-09T00:05:10-03:00"}
{"level":"debug","msg":"{gpu /usr/lib/qemu/vhost-user-gpu}","time":"2023-10-09T00:05:10-03:00"}
{"level":"debug","msg":"Checking vhost config 50-qemu-virtiofsd.json","time":"2023-10-09T00:05:10-03:00"}
{"level":"debug","msg":"{fs /usr/lib/qemu/virtiofsd}","time":"2023-10-09T00:05:10-03:00"}
{"level":"warning","msg":"Failed to run /usr/lib/qemu/virtiofsd --version (is this QEMU virtiofsd?): exit status 1: setgroups
() failed with error=1:Operation not permitted\n","time":"2023-10-09T00:05:10-03:00"}
{"level":"fatal","msg":"Failed to locate virtiofsd","time":"2023-10-09T00:05:10-03:00"}

lattice0 Oct 9, 2023
Author

I moved virtiofsd to /usr/lib/qemu/ and then got

 cat /home/lz/.lima/virt/ha.stderr.log
{"level":"debug","msg":"Creating iso file /home/lz/.lima/virt/cidata.iso","time":"2023-10-09T00:09:18-03:00"}
{"level":"debug","msg":"Using /tmp/diskfs_iso1865973165 as workspace","time":"2023-10-09T00:09:18-03:00"}
{"level":"debug","msg":"OpenSSH version 8.9.1 detected","time":"2023-10-09T00:09:18-03:00"}
{"level":"debug","msg":"AES accelerator seems available, prioritizing aes128-gcm@openssh.com and aes256-gcm@openssh.com","tim
e":"2023-10-09T00:09:18-03:00"}
{"level":"debug","msg":"Start udp DNS listening on: 127.0.0.1:55832","time":"2023-10-09T00:09:18-03:00"}
{"level":"debug","msg":"Start tcp DNS listening on: 127.0.0.1:33517","time":"2023-10-09T00:09:18-03:00"}
{"level":"debug","msg":"QEMU version 6.2.0 detected","time":"2023-10-09T00:09:18-03:00"}
{"level":"debug","msg":"firmware candidates = [/home/lz/.local/share/qemu/edk2-x86_64-code.fd /usr/share/qemu/edk2-x86_64-cod
e.fd /usr/share/OVMF/OVMF_CODE.fd /usr/share/qemu/ovmf-x86_64-code.bin /usr/share/edk2-ovmf/x64/OVMF_CODE.fd]","time":"2023-1
0-09T00:09:18-03:00"}
{"level":"debug","msg":"Checking vhost directory /home/lz/.local/share/qemu/vhost-user","time":"2023-10-09T00:09:18-03:00"}
{"level":"debug","msg":"Failed to list vhost directory: open /home/lz/.local/share/qemu/vhost-user: no such file or directory
","time":"2023-10-09T00:09:18-03:00"}
{"level":"debug","msg":"Checking vhost directory /usr/share/qemu/vhost-user","time":"2023-10-09T00:09:18-03:00"}
{"level":"debug","msg":"Checking vhost config 50-qemu-gpu.json","time":"2023-10-09T00:09:18-03:00"}
{"level":"debug","msg":"{fs /usr/lib/qemu/virtiofsd}","time":"2023-10-09T00:09:18-03:00"}
{"level":"debug","msg":"vhostCmd[0].Args: [/usr/lib/qemu/virtiofsd --socket-path /home/lz/.lima/virt/virtiofsd-0.sock --share
d-dir /home/lz]","time":"2023-10-09T00:09:18-03:00"}
{"level":"debug","msg":"Try waiting for /home/lz/.lima/virt/virtiofsd-0.sock to appear (attempt 0)","time":"2023-10-09T00:09:
18-03:00"}
{"level":"debug","msg":"vhostCmd[1].Args: [/usr/lib/qemu/virtiofsd --socket-path /home/lz/.lima/virt/virtiofsd-1.sock --share
d-dir /tmp/lima]","time":"2023-10-09T00:09:18-03:00"}
{"level":"debug","msg":"virtiofsd-0[stderr]: thread 'main' panicked at src/sandbox.rs:408:21:","time":"2023-10-09T00:09:18-03
:00"}
{"level":"debug","msg":"virtiofsd-0[stderr]: couldn't setup id mappings: write to uid map failed: failed to execute newuidmap
: No such file or directory (os error 2)","time":"2023-10-09T00:09:18-03:00"}
{"level":"debug","msg":"virtiofsd-1[stderr]: thread 'main' panicked at src/sandbox.rs:408:21:","time":"2023-10-09T00:09:18-03
:00"}
{"level":"debug","msg":"virtiofsd-1[stderr]: couldn't setup id mappings: write to uid map failed: failed to execute newuidmap
: No such file or directory (os error 2)","time":"2023-10-09T00:09:18-03:00"}
{"level":"debug","msg":"virtiofsd-0[stderr]: note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace","
time":"2023-10-09T00:09:18-03:00"}
{"level":"debug","msg":"Try waiting for /home/lz/.lima/virt/virtiofsd-1.sock to appear (attempt 0)","time":"2023-10-09T00:09:
18-03:00"}
{"level":"debug","msg":"virtiofsd-1[stderr]: note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace","
time":"2023-10-09T00:09:18-03:00"}
{"level":"error","msg":"Error from virtiofsd instance #0: exit status 1","time":"2023-10-09T00:09:18-03:00"}
{"level":"fatal","msg":"virtiofsd never created vhost socket: exit status 1","time":"2023-10-09T00:09:18-03:00"}

lattice0 Oct 9, 2023
Author

Ok I installed ˋsudo apt install -y uidmapˋ and now I have

cat /home/lz/.lima/virt/ha.stderr.log
{"level":"debug","msg":"Creating iso file /home/lz/.lima/virt/cidata.iso","time":"2023-10-09T06:40:03-03:00"}
{"level":"debug","msg":"Using /tmp/diskfs_iso163240857 as workspace","time":"2023-10-09T06:40:03-03:00"}
{"level":"debug","msg":"OpenSSH version 8.9.1 detected","time":"2023-10-09T06:40:04-03:00"}
{"level":"debug","msg":"AES accelerator seems available, prioritizing aes128-gcm@openssh.com and aes256-gcm@openssh.com","time":"2023-10-09T06:40:04-03:00"}
{"level":"debug","msg":"Start tcp DNS listening on: 127.0.0.1:35321","time":"2023-10-09T06:40:04-03:00"}
{"level":"debug","msg":"Start udp DNS listening on: 127.0.0.1:47929","time":"2023-10-09T06:40:04-03:00"}
{"level":"debug","msg":"QEMU version 6.2.0 detected","time":"2023-10-09T06:40:04-03:00"}
{"level":"debug","msg":"firmware candidates = [/home/lz/.local/share/qemu/edk2-x86_64-code.fd /usr/share/qemu/edk2-x86_64-code.fd /usr/share/OVMF/OVMF_CODE.fd }{"level":"debug","msg":"Checking vhost directory /home/lz/.local/share/qemu/vhost-user","time":"2023-10-09T06:40:04-03:00"}
{"level":"debug","msg":"Failed to list vhost directory: open /home/lz/.local/share/qemu/vhost-user: no such file or directory","time":"2023-10-09T06:40:04-03:0}{"level":"debug","msg":"Checking vhost directory /usr/share/qemu/vhost-user","time":"2023-10-09T06:40:04-03:00"}
{"level":"debug","msg":"Checking vhost config 50-qemu-gpu.json","time":"2023-10-09T06:40:04-03:00"}
{"level":"debug","msg":"{gpu /usr/lib/qemu/vhost-user-gpu}","time":"2023-10-09T06:40:04-03:00"}
{"level":"debug","msg":"Checking vhost config 50-qemu-virtiofsd.json","time":"2023-10-09T06:40:04-03:00"}
{"level":"debug","msg":"{fs /usr/lib/qemu/virtiofsd}","time":"2023-10-09T06:40:04-03:00"}
{"level":"debug","msg":"vhostCmd[0].Args: [/usr/lib/qemu/virtiofsd --socket-path /home/lz/.lima/virt/virtiofsd-0.sock --shared-dir /home/lz]","time":"2023-10-0}{"level":"debug","msg":"Try waiting for /home/lz/.lima/virt/virtiofsd-0.sock to appear (attempt 0)","time":"2023-10-09T06:40:04-03:00"}
{"level":"debug","msg":"vhostCmd[1].Args: [/usr/lib/qemu/virtiofsd --socket-path /home/lz/.lima/virt/virtiofsd-1.sock --shared-dir /tmp/lima]","time":"2023-10-}{"level":"debug","msg":"Try waiting for /home/lz/.lima/virt/virtiofsd-1.sock to appear (attempt 0)","time":"2023-10-09T06:40:04-03:00"}
{"level":"info","msg":"Starting QEMU (hint: to watch the boot progress, see \"/home/lz/.lima/virt/serial*.log\")","time":"2023-10-09T06:40:04-03:00"}
{"level":"debug","msg":"qCmd.Args: [/usr/bin/qemu-system-x86_64 -m 4096 -object memory-backend-file,id=virtiofs-shm,size=4294967296,mem-path=/dev/shm,share=on }{"level":"debug","msg":"virtiofsd-1[stderr]: [2023-10-09T09:40:04Z WARN  virtiofsd::sandbox] Couldn't set the process uid as root: -1","time":"2023-10-09T06:40}{"level":"debug","msg":"virtiofsd-1[stderr]: [2023-10-09T09:40:04Z WARN  virtiofsd::sandbox] Couldn't set the process gid as root: -1","time":"2023-10-09T06:40}{"level":"info","msg":"Waiting for the essential requirement 1 of 3: \"ssh\"","time":"2023-10-09T06:40:04-03:00"}
{"level":"debug","msg":"executing script \"ssh\"","time":"2023-10-09T06:40:04-03:00"}
{"level":"debug","msg":"virtiofsd-0[stderr]: [2023-10-09T09:40:04Z WARN  virtiofsd::sandbox] Couldn't set the process uid as root: -1","time":"2023-10-09T06:40}{"level":"debug","msg":"virtiofsd-0[stderr]: [2023-10-09T09:40:04Z WARN  virtiofsd::sandbox] Couldn't set the process gid as root: -1","time":"2023-10-09T06:40}{"level":"debug","msg":"executing ssh for script \"ssh\": /usr/bin/ssh [ssh -F /dev/null -o IdentityFile=\"/home/lz/.lima/_config/user\" -o StrictHostKeyChecki}{"level":"debug","msg":"virtiofsd-0[stderr]: [2023-10-09T09:40:04Z INFO  virtiofsd] Waiting for vhost-user socket connection...","time":"2023-10-09T06:40:04-03}{"level":"debug","msg":"virtiofsd-1[stderr]: [2023-10-09T09:40:04Z INFO  virtiofsd] Waiting for vhost-user socket connection...","time":"2023-10-09T06:40:04-03}{"level":"debug","msg":"stdout=\"\", stderr=\"ssh: connect to host 127.0.0.1 port 34803: Connection refused\\r\\n\", err=failed to execute script \"ssh\": stdo}{"level":"debug","msg":"qemu[stderr]: Could not access KVM kernel module: Permission denied","time":"2023-10-09T06:40:04-03:00"}
{"level":"info","msg":"Driver stopped due to error: \"exit status 1\"","time":"2023-10-09T06:40:04-03:00"}
{"level":"info","msg":"Shutting down the host agent","time":"2023-10-09T06:40:04-03:00"}
{"level":"debug","msg":"shutting down the SSH master","time":"2023-10-09T06:40:04-03:00"}
{"level":"debug","msg":"executing ssh for exiting the master: /usr/bin/ssh [ssh -F /dev/null -o IdentityFile=\"/home/lz/.lima/_config/user\" -o StrictHostKeyCh}{"error":"failed to execute `ssh -O exit -p 34803 127.0.0.1`, out=\"Control socket connect(/home/lz/.lima/virt/ssh.sock): No such file or directory\\r\\n\": ex}{"level":"info","msg":"Shutting down QEMU with ACPI","time":"2023-10-09T06:40:04-03:00"}
{"error":"dial unix /home/lz/.lima/virt/qmp.sock: connect: connection refused","level":"warning","msg":"failed to open the QMP socket \"/home/lz/.lima/virt/qmp}{"level":"info","msg":"QEMU has already exited","time":"2023-10-09T06:40:04-03:00"}

lattice0 Oct 9, 2023
Author

It appears that ˋsudo usermod -aG kvm $USER ˋ solved the problem

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

WARN[0157] [hostagent] Failed to run /usr/lib/qemu/virtiofsd --version (is this QEMU virtiofsd?): exit s tatus 1: setgroups() failed with error=1:Operation not permitted #1849

{{title}}

Replies: 1 comment 4 replies

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{title}}

{{title}}

{{title}}

Select a reply

WARN[0157] [hostagent] Failed to run /usr/lib/qemu/virtiofsd --version (is this QEMU virtiofsd?): exit s tatus 1: setgroups() failed with error=1:Operation not permitted #1849

lattice0 Sep 27, 2023

Replies: 1 comment · 4 replies

afbjorklund Sep 29, 2023 Maintainer

lattice0 Oct 9, 2023 Author

lattice0 Oct 9, 2023 Author

lattice0 Oct 9, 2023 Author

lattice0 Oct 9, 2023 Author

lattice0
Sep 27, 2023

Replies: 1 comment 4 replies

afbjorklund
Sep 29, 2023
Maintainer

lattice0 Oct 9, 2023
Author

lattice0 Oct 9, 2023
Author

lattice0 Oct 9, 2023
Author

lattice0 Oct 9, 2023
Author