[Q&A] ModuleNotFoundError: No module named 'nvflare.fuel.f3.drivers.\\grpc' at hello-numpy-sag with FL simulator

[pablo-llorente]

Python version (python3 -V)

3.10.11

NVFlare version (python3 -m pip list | grep "nvflare")

2.4.1

NVFlare branch (if running examples, please use the branch that corresponds to the NVFlare version, git branch)

2.4

Operating system

Windows

Have you successfully run any of the following examples?

• hello-numpy-sag with simulator
• hello-pt with simulator
• hello-numpy-sag with POC
• hello-pt with POC

Please describe your question

Hello, I'm a bit newbe on this kinda applications, so this error might be so simple or I might failed on a simple first step. But I can't understand where could I failed, since I'm just starting with the simulator. First I couldn't execute nvflare as I got the error: No module named 'resource' - at the next path:

C:\Users\pabll\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.10_qbz5n2kfra8p0\LocalCache\local-packages\Python310\site-packages\nvflare\fuel\f3\cellnet\net_agent.py

This happened just after python3 -m pip install nvflare. I don't know what could I have done bad, but, well... I solved it by changing import resource, by:

if os.name == 'posix':
     import resource # pylint: disable=import-error

Next, I noticed python version 3.11 was not supported, so I uninstalled it and installed a previous one (3.10.11), re-made the last solution, and finally I could execute nvflare simulator -h. However, at the moment I clonned Nvflare, switch branch to 2.4 and execute nvflare simulator NVFlare/examples/hello-world/hello-numpy-sag/jobs/hello-numpy-sag -w /tmp/nvflare/workspace_folder/ -n 8 -t 1 I got the next amout of errors and I have no idea how to solve them. I can guess than the RuntimeError is due to the first one, so the most important error is Unexpected exception: ModuleNotFoundError: No module named 'nvflare.fuel.f3.drivers.\\grpc':

C:\>nvflare simulator NVFlare/examples/hello-world/hello-numpy-sag/jobs/hello-numpy-sag -w /tmp/nvflare/workspace_folder/ -n 8 -t 1
2024-05-25 12:41:11,145 - SimulatorRunner - INFO - Create the Simulator Server.
2024-05-25 12:41:11,160 - CoreCell - INFO - server: creating listener on tcp://0:54239
2024-05-25 12:41:11,254 - ConnectorManager - ERROR - Unexpected exception: ModuleNotFoundError: No module named 'nvflare.fuel.f3.drivers.\\grpc'
2024-05-25 12:41:11,254 - ConnectorManager - ERROR - Traceback (most recent call last):
  File "C:\Users\pabll\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.10_qbz5n2kfra8p0\LocalCache\local-packages\Python310\site-packages\nvflare\fuel\f3\cellnet\connector_manager.py", line 199, in _get_connector
    handle = self.communicator.add_connector(url, Mode.PASSIVE, ssl_required)
  File "C:\Users\pabll\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.10_qbz5n2kfra8p0\LocalCache\local-packages\Python310\site-packages\nvflare\fuel\f3\communicator.py", line 173, in add_connector
    load_comm_drivers()
  File "C:\Users\pabll\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.10_qbz5n2kfra8p0\LocalCache\local-packages\Python310\site-packages\nvflare\fuel\f3\communicator.py", line 42, in load_comm_drivers
    driver_mgr.search_folder(os.path.dirname(drivers._file), drivers.package_)
  File "C:\Users\pabll\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.10_qbz5n2kfra8p0\LocalCache\local-packages\Python310\site-packages\nvflare\fuel\f3\drivers\driver_manager.py", line 81, in search_folder
    imported = importlib.import_module(module)
  File "C:\Program Files\WindowsApps\PythonSoftwareFoundation.Python.3.10_3.10.3056.0_x64_qbz5n2kfra8p0\lib\importlib\init_.py", line 126, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
  File "<frozen importlib._bootstrap>", line 1050, in _gcd_import
  File "<frozen importlib._bootstrap>", line 1027, in _find_and_load
  File "<frozen importlib._bootstrap>", line 992, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed
  File "<frozen importlib._bootstrap>", line 1050, in _gcd_import
  File "<frozen importlib._bootstrap>", line 1027, in _find_and_load
  File "<frozen importlib._bootstrap>", line 1004, in _find_and_load_unlocked
ModuleNotFoundError: No module named 'nvflare.fuel.f3.drivers.\\grpc'

2024-05-25 12:41:11,254 - SimulatorRunner - ERROR - Simulator setup error: RuntimeError: 16624: server: cannot create backbone external listener for tcp://0:54239
2024-05-25 12:41:11,270 - root - ERROR - Traceback (most recent call last):
  File "C:\Users\pabll\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.10_qbz5n2kfra8p0\LocalCache\local-packages\Python310\site-packages\nvflare\private\fed\app\simulator\simulator_runner.py", line 239, in setup
    simulator_server, self.server = self.deployer.create_fl_server(self.args)
  File "C:\Users\pabll\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.10_qbz5n2kfra8p0\LocalCache\local-packages\Python310\site-packages\nvflare\private\fed\app\deployer\simulator_deployer.py", line 54, in create_fl_server
    services.deploy(args, grpc_args=simulator_server)
  File "C:\Users\pabll\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.10_qbz5n2kfra8p0\LocalCache\local-packages\Python310\site-packages\nvflare\private\fed\simulator\simulator_server.py", line 131, in deploy
    super(FederatedServer, self).deploy(args, grpc_args, secure_train)
  File "C:\Users\pabll\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.10_qbz5n2kfra8p0\LocalCache\local-packages\Python310\site-packages\nvflare\private\fed\server\fed_server.py", line 187, in deploy
    self.cell.start()
  File "C:\Users\pabll\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.10_qbz5n2kfra8p0\LocalCache\local-packages\Python310\site-packages\nvflare\fuel\f3\cellnet\cell.py", line 138, in method
    return getattr(self.core_cell, func)(*args, **kwargs)
  File "C:\Users\pabll\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.10_qbz5n2kfra8p0\LocalCache\local-packages\Python310\site-packages\nvflare\fuel\f3\cellnet\core_cell.py", line 846, in start
    self._set_bb_for_server_root()
  File "C:\Users\pabll\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.10_qbz5n2kfra8p0\LocalCache\local-packages\Python310\site-packages\nvflare\fuel\f3\cellnet\core_cell.py", line 567, in _set_bb_for_server_root
    self._create_external_listener(url)
  File "C:\Users\pabll\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.10_qbz5n2kfra8p0\LocalCache\local-packages\Python310\site-packages\nvflare\fuel\f3\cellnet\core_cell.py", line 750, in _create_external_listener
    raise RuntimeError(
RuntimeError: 16624: server: cannot create backbone external listener for tcp://0:54239

2024-05-25 12:41:14,270 - MPM - INFO - MPM: Good Bye!

I cannot understand how I found that amount of "internal" errors on imports, where installation seemed to be correct. I will be so glad if you can help me.

Thanks you,

Pablo - kirdan1223

[YuanTingHsieh]

@kirdan1223 thanks for the interest!

I notice you are running on Windows OS.
We have not tested on Windows OS.
One way to get around this is that you can launch a docker container that runs Ubuntu.
And inside the docker container you can try NVFlare.