Intel-on-ARM emulation fails with error "vz driver state stopped" #1573

flok-dev · 2023-05-24T08:57:16Z

flok-dev
May 24, 2023

I am attempting to emulate rocky linux 9 (x86) on a M1 Max pro using vz and rosetta but fail with the above mentioned error ("vz driver state stopped").

Lima was installed through brew and runs on version 0.15.1
MacOS: 13.3.1 (a) (22E772610a)
CPU: Apple M1 Max

Below you'll find the template file:

vmType: "vz"
rosetta:
  # Enable Rosetta for Linux.
  # Hint: try `softwareupdate --install-rosetta` if Lima gets stuck at `Installing rosetta...`
  enabled: true
  # Register rosetta to /proc/sys/fs/binfmt_misc
  binfmt: true
arch: "x86_64"
images:
- location: "https://dl.rockylinux.org/pub/rocky/9.2/images/x86_64/Rocky-9-GenericCloud-Base-9.2-20230513.0.x86_64.qcow2"
  arch: "x86_64"
  digest: "sha256:50510f98abe1b20a548102a05a9be83153b0bf634fc502d5c8d1f508f6de1430"
- location: "http://dl.rockylinux.org/pub/rocky/9.2/images/aarch64/Rocky-9-GenericCloud-Base-9.2-20230513.0.aarch64.qcow2"
  arch: "aarch64"
  digest: "sha256:eb7752c0be359007ad470e43b0d8c921e31d3ad7d4bcec9b6a2b18a8d17c05d8"
mounts:
- location: "~"
- location: "/tmp/lima"
  writable: true
ssh:
  # A localhost port of the host. Forwarded to port 22 of the guest.
  # 🟢 Builtin default: 0 (automatically assigned to a free port)
  # NOTE: when the instance name is "default", the builtin default value is set to
  # 60022 for backward compatibility.
  localPort: 0
  # Load ~/.ssh/*.pub in addition to $LIMA_HOME/_config/user.pub .
  # This option is useful when you want to use other SSH-based
  # applications such as rsync with the Lima instance.
  # If you have an insecure key under ~/.ssh, do not use this option.
  # 🟢 Builtin default: true
  loadDotSSHPubKeys: false

This is the output from the limactl cmd

limactl start --name=default rocky-9_x86.yaml

? Creating an instance "default" Proceed with the current configuration
WARN[0001] `vmType: vz` is experimental                 
INFO[0001] Attempting to download the image              arch=x86_64 digest="sha256:50510f98abe1b20a548102a05a9be83153b0bf634fc502d5c8d1f508f6de1430" location="https://dl.rockylinux.org/pub/rocky/9.2/images/x86_64/Rocky-9-GenericCloud-Base-9.2-20230513.0.x86_64.qcow2"
INFO[0001] Using cache "/Users/flok/Library/Caches/lima/download/by-url-sha256/4c664f8d449782dbadcf82fb827c58e185d4798361442cdade1042673acd5b13/data" 
INFO[0003] Attempting to download the nerdctl archive    arch=x86_64 digest="sha256:955f9a4853762b1258cd38c967e45b6061a181a668907059e56cc01c32f1cf21" location="https://github.com/containerd/nerdctl/releases/download/v1.3.1/nerdctl-full-1.3.1-linux-amd64.tar.gz"
INFO[0003] Using cache "/Users/flok/Library/Caches/lima/download/by-url-sha256/ced4c1bbc347f1a74f9f9f25172cdb69115d21bf84000cc529013917a24a067a/data" 
INFO[0004] [hostagent] Starting VZ (hint: to watch the boot progress, see "/Users/flok/.lima/default/serial.log") 
INFO[0004] [hostagent] Setting up Rosetta share         
INFO[0004] SSH Local Port: 60022                        
INFO[0004] [hostagent] new connection from  to          
INFO[0004] [hostagent] Waiting for the essential requirement 1 of 5: "ssh" 
INFO[0004] [hostagent] [VZ] - vm state change: running  
INFO[0004] [hostagent] [VZ] - vm state change: stopped  
INFO[0004] [hostagent] Driver stopped due to error: "vz driver state stopped" 
INFO[0004] [hostagent] Shutting down the host agent     
WARN[0004] [hostagent] failed to exit SSH master        
INFO[0004] [hostagent] Shutting down VZ                 
FATA[0004] exiting, status={Running:false Degraded:false Exiting:true Errors:[] SSHLocalPort:0} (hint: see "/Users/flok/.lima/default/ha.stderr.log")

~/.lima/default/serial.log is empty and below is the output from ha.stderr.log is as follows:

{"level":"debug","msg":"executing [ssh-keygen -t ed25519 -q -N  -f /Users/flok/.lima/_config/user]","time":"2023-05-24T10:29:56+02:00"}
{"level":"debug","msg":"Creating iso file /Users/flok/.lima/default/cidata.iso","time":"2023-05-24T10:29:56+02:00"}
{"level":"debug","msg":"Using /var/folders/mc/v3xwnwy909b06g9wt11rq6w00000gn/T/diskfs_iso2793702617 as workspace","time":"2023-05-24T10:29:56+02:00"}
{"level":"debug","msg":"Failed to detect CPU features. Assuming that AES acceleration is available on this Apple silicon.","time":"2023-05-24T10:29:57+02:00"}
{"level":"debug","msg":"OpenSSH version 9.0.1 detected","time":"2023-05-24T10:29:57+02:00"}
{"level":"debug","msg":"AES accelerator seems available, prioritizing aes128-gcm@openssh.com and aes256-gcm@openssh.com","time":"2023-05-24T10:29:57+02:00"}
{"level":"info","msg":"Starting VZ (hint: to watch the boot progress, see \"/Users/flok/.lima/default/serial.log\")","time":"2023-05-24T10:29:57+02:00"}
{"level":"debug","msg":"Start udp server listening on: 127.0.0.1:57653","time":"2023-05-24T10:29:57+02:00"}
{"level":"debug","msg":"Start tcp server listening on: 127.0.0.1:53895","time":"2023-05-24T10:29:57+02:00"}
{"level":"info","msg":"Setting up Rosetta share","time":"2023-05-24T10:29:57+02:00"}
{"level":"debug","msg":"Using search domains: [intern]","time":"2023-05-24T10:29:57+02:00"}
{"level":"debug","msg":"[VZ] - vm state change: \"VirtualMachineStateStarting\"","time":"2023-05-24T10:29:57+02:00"}
{"level":"info","msg":"new connection from  to ","time":"2023-05-24T10:29:57+02:00"}
{"level":"info","msg":"Waiting for the essential requirement 1 of 5: \"ssh\"","time":"2023-05-24T10:29:57+02:00"}
{"level":"info","msg":"[VZ] - vm state change: running","time":"2023-05-24T10:29:57+02:00"}
{"level":"debug","msg":"executing script \"ssh\"","time":"2023-05-24T10:29:57+02:00"}
{"level":"debug","msg":"executing ssh for script \"ssh\": /usr/bin/ssh [ssh -F /dev/null -o IdentityFile=\"/Users/flok/.lima/_config/user\" -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null -o NoHostAuthenticationForLocalhost=yes -o GSSAPIAuthentication=no -o PreferredAuthentications=publickey -o Compression=no -o BatchMode=yes -o IdentitiesOnly=yes -o Ciphers=\"^aes128-gcm@openssh.com,aes256-gcm@openssh.com\" -o User=flok -o ControlMaster=auto -o ControlPath=\"/Users/flok/.lima/default/ssh.sock\" -o ControlPersist=5m -p 60022 127.0.0.1 -- /bin/bash]","time":"2023-05-24T10:29:57+02:00"}
{"level":"info","msg":"[VZ] - vm state change: stopped","time":"2023-05-24T10:29:58+02:00"}
{"level":"info","msg":"Driver stopped due to error: \"vz driver state stopped\"","time":"2023-05-24T10:29:58+02:00"}
{"level":"info","msg":"Shutting down the host agent","time":"2023-05-24T10:29:58+02:00"}
{"level":"debug","msg":"shutting down the SSH master","time":"2023-05-24T10:29:58+02:00"}
{"level":"debug","msg":"executing ssh for exiting the master: /usr/bin/ssh [ssh -F /dev/null -o IdentityFile=\"/Users/flok/.lima/_config/user\" -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null -o NoHostAuthenticationForLocalhost=yes -o GSSAPIAuthentication=no -o PreferredAuthentications=publickey -o Compression=no -o BatchMode=yes -o IdentitiesOnly=yes -o Ciphers=\"^aes128-gcm@openssh.com,aes256-gcm@openssh.com\" -o User=flok -o ControlMaster=auto -o ControlPath=\"/Users/flok/.lima/default/ssh.sock\" -o ControlPersist=5m -O exit -p 60022 127.0.0.1]","time":"2023-05-24T10:29:58+02:00"}
{"error":"failed to execute `ssh -O exit -p 60022 127.0.0.1`, out=\"Control socket connect(/Users/flok/.lima/default/ssh.sock): No such file or directory\\r\\n\": exit status 255","level":"warning","msg":"failed to exit SSH master","time":"2023-05-24T10:29:58+02:00"}
{"level":"info","msg":"Shutting down VZ","time":"2023-05-24T10:29:58+02:00"}
{"level":"fatal","msg":"vz: CanRequestStop is not supported","time":"2023-05-24T10:29:58+02:00"}

Any help/input would be much appreciated!