Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Conflicts with the latest version of Triton, ComfyUI cannot load the nunchaku node. #152

Open
edisonchan opened this issue Mar 7, 2025 · 0 comments

Comments

@edisonchan
Copy link

In order to use the torchmodelcompile node in ComfyUI, after compiling the latest source code from https://github.com/triton-lang/triton, nunchaku can no longer be loaded (affected also includes comfyui-easy-use and others).

(same comfyui venv)

git clone https://github.com/triton-lang/triton
cd triton
pip install -e python

and then run comfyui

ComfyUI version: 0.3.18
[Prompt Server] web root: /home/edison/Downloads/ComfyUI/web
### Loading: ComfyUI-Manager (V3.27.2)
[ComfyUI-Manager] network_mode: public
### ComfyUI Revision: 3183 [b07f116d] *DETACHED | Released on '2025-02-26'

[rgthree-comfy] Loaded 42 magnificent nodes. 🎉

Traceback (most recent call last):
  File "/home/edison/Downloads/ComfyUI/.venv/lib/python3.12/site-packages/diffusers/utils/import_utils.py", line 920, in _get_module
    return importlib.import_module("." + module_name, self.__name__)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.12/importlib/__init__.py", line 90, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "<frozen importlib._bootstrap>", line 1387, in _gcd_import
  File "<frozen importlib._bootstrap>", line 1360, in _find_and_load
  File "<frozen importlib._bootstrap>", line 1310, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 488, in _call_with_frames_removed
  File "<frozen importlib._bootstrap>", line 1387, in _gcd_import
  File "<frozen importlib._bootstrap>", line 1360, in _find_and_load
  File "<frozen importlib._bootstrap>", line 1331, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 935, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 995, in exec_module
  File "<frozen importlib._bootstrap>", line 488, in _call_with_frames_removed
  File "/home/edison/Downloads/ComfyUI/.venv/lib/python3.12/site-packages/diffusers/models/transformers/__init__.py", line 5, in <module>
    from .auraflow_transformer_2d import AuraFlowTransformer2DModel
  File "/home/edison/Downloads/ComfyUI/.venv/lib/python3.12/site-packages/diffusers/models/transformers/auraflow_transformer_2d.py", line 25, in <module>
    from ..attention_processor import (
  File "/home/edison/Downloads/ComfyUI/.venv/lib/python3.12/site-packages/diffusers/models/attention_processor.py", line 35, in <module>
    import xformers.ops
  File "/home/edison/Downloads/ComfyUI/.venv/lib/python3.12/site-packages/xformers/ops/__init__.py", line 9, in <module>
    from .fmha import (
  File "/home/edison/Downloads/ComfyUI/.venv/lib/python3.12/site-packages/xformers/ops/fmha/__init__.py", line 10, in <module>
    from . import (
  File "/home/edison/Downloads/ComfyUI/.venv/lib/python3.12/site-packages/xformers/ops/fmha/triton_splitk.py", line 112, in <module>
    from ._triton.splitk_kernels import _fwd_kernel_splitK, _splitK_reduce
  File "/home/edison/Downloads/ComfyUI/.venv/lib/python3.12/site-packages/xformers/ops/fmha/_triton/splitk_kernels.py", line 639, in <module>
    _get_splitk_kernel(num_groups)
  File "/home/edison/Downloads/ComfyUI/.venv/lib/python3.12/site-packages/xformers/ops/fmha/_triton/splitk_kernels.py", line 588, in _get_splitk_kernel
    _fwd_kernel_splitK_unrolled = unroll_varargs(_fwd_kernel_splitK, N=num_groups)
                                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/edison/Downloads/ComfyUI/.venv/lib/python3.12/site-packages/xformers/triton/vararg_kernel.py", line 244, in unroll_varargs
    jitted_fn.src = new_src
    ^^^^^^^^^^^^^
  File "/home/edison/Downloads/triton/python/triton/runtime/jit.py", line 718, in __setattr__
    raise AttributeError(f"Cannot set attribute '{name}' directly. "
AttributeError: Cannot set attribute 'src' directly. Use '_unsafe_update_src()' and manually clear `.hash` of all callersinstead.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/home/edison/Downloads/ComfyUI/nodes.py", line 2147, in load_custom_node
    module_spec.loader.exec_module(module)
  File "<frozen importlib._bootstrap_external>", line 995, in exec_module
  File "<frozen importlib._bootstrap>", line 488, in _call_with_frames_removed
  File "/home/edison/Downloads/ComfyUI/custom_nodes/svdquant/__init__.py", line 4, in <module>
    from .nodes.models import SVDQuantFluxDiTLoader, SVDQuantTextEncoderLoader
  File "/home/edison/Downloads/ComfyUI/custom_nodes/svdquant/nodes/models/__init__.py", line 1, in <module>
    from .flux import SVDQuantFluxDiTLoader
  File "/home/edison/Downloads/ComfyUI/custom_nodes/svdquant/nodes/models/flux.py", line 9, in <module>
    from diffusers import FluxTransformer2DModel
  File "<frozen importlib._bootstrap>", line 1412, in _handle_fromlist
  File "/home/edison/Downloads/ComfyUI/.venv/lib/python3.12/site-packages/diffusers/utils/import_utils.py", line 911, in __getattr__
    value = getattr(module, name)
            ^^^^^^^^^^^^^^^^^^^^^
  File "/home/edison/Downloads/ComfyUI/.venv/lib/python3.12/site-packages/diffusers/utils/import_utils.py", line 910, in __getattr__
    module = self._get_module(self._class_to_module[name])
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/edison/Downloads/ComfyUI/.venv/lib/python3.12/site-packages/diffusers/utils/import_utils.py", line 922, in _get_module
    raise RuntimeError(
RuntimeError: Failed to import diffusers.models.transformers.transformer_flux because of the following error (look up to see its traceback):
Cannot set attribute 'src' directly. Use '_unsafe_update_src()' and manually clear `.hash` of all callersinstead.

Cannot import /home/edison/Downloads/ComfyUI/custom_nodes/svdquant module for custom nodes: Failed to import diffusers.models.transformers.transformer_flux because of the following error (look up to see its traceback):
Cannot set attribute 'src' directly. Use '_unsafe_update_src()' and manually clear `.hash` of all callersinstead.
[ComfyUI-Manager] default cache updated: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/alter-list.json
[ComfyUI-Manager] default cache updated: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/extension-node-map.json
[ComfyUI-Manager] default cache updated: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/custom-node-list.json
[ComfyUI-Manager] default cache updated: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/github-stats.json
WAS Node Suite: OpenCV Python FFMPEG support is enabled
WAS Node Suite: `ffmpeg_bin_path` is set to: /usr/bin/ffmpeg
[ComfyUI-Manager] default cache updated: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/model-list.json
WAS Node Suite: Finished. Loaded 220 nodes successfully.

        "Success is not about being better than someone else. It's about being better than you used to be." - Unknown

Traceback (most recent call last):
  File "/home/edison/Downloads/ComfyUI/nodes.py", line 2147, in load_custom_node
    module_spec.loader.exec_module(module)
  File "<frozen importlib._bootstrap_external>", line 995, in exec_module
  File "<frozen importlib._bootstrap>", line 488, in _call_with_frames_removed
  File "/home/edison/Downloads/ComfyUI/custom_nodes/comfyui-easy-use/__init__.py", line 11, in <module>
    importlib.import_module('.py.routes', __name__)
  File "/usr/lib/python3.12/importlib/__init__.py", line 90, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "<frozen importlib._bootstrap>", line 1387, in _gcd_import
  File "<frozen importlib._bootstrap>", line 1360, in _find_and_load
  File "<frozen importlib._bootstrap>", line 1310, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 488, in _call_with_frames_removed
  File "<frozen importlib._bootstrap>", line 1387, in _gcd_import
  File "<frozen importlib._bootstrap>", line 1360, in _find_and_load
  File "<frozen importlib._bootstrap>", line 1331, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 935, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 995, in exec_module
  File "<frozen importlib._bootstrap>", line 488, in _call_with_frames_removed
  File "/home/edison/Downloads/ComfyUI/custom_nodes/comfyui-easy-use/py/__init__.py", line 2, in <module>
    from .libs.sampler import easySampler
  File "/home/edison/Downloads/ComfyUI/custom_nodes/comfyui-easy-use/py/libs/sampler.py", line 10, in <module>
    from ..modules.brushnet.model_patch import add_model_patch
  File "/home/edison/Downloads/ComfyUI/custom_nodes/comfyui-easy-use/py/modules/brushnet/__init__.py", line 12, in <module>
    from .model import BrushNetModel, PowerPaintModel
  File "/home/edison/Downloads/ComfyUI/custom_nodes/comfyui-easy-use/py/modules/brushnet/model.py", line 13, in <module>
    from diffusers.models.attention_processor import (
  File "/home/edison/Downloads/ComfyUI/.venv/lib/python3.12/site-packages/diffusers/models/attention_processor.py", line 35, in <module>
    import xformers.ops
  File "/home/edison/Downloads/ComfyUI/.venv/lib/python3.12/site-packages/xformers/ops/__init__.py", line 9, in <module>
    from .fmha import (
  File "/home/edison/Downloads/ComfyUI/.venv/lib/python3.12/site-packages/xformers/ops/fmha/__init__.py", line 10, in <module>
    from . import (
  File "/home/edison/Downloads/ComfyUI/.venv/lib/python3.12/site-packages/xformers/ops/fmha/triton_splitk.py", line 112, in <module>
    from ._triton.splitk_kernels import _fwd_kernel_splitK, _splitK_reduce
  File "/home/edison/Downloads/ComfyUI/.venv/lib/python3.12/site-packages/xformers/ops/fmha/_triton/splitk_kernels.py", line 639, in <module>
    _get_splitk_kernel(num_groups)
  File "/home/edison/Downloads/ComfyUI/.venv/lib/python3.12/site-packages/xformers/ops/fmha/_triton/splitk_kernels.py", line 588, in _get_splitk_kernel
    _fwd_kernel_splitK_unrolled = unroll_varargs(_fwd_kernel_splitK, N=num_groups)
                                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/edison/Downloads/ComfyUI/.venv/lib/python3.12/site-packages/xformers/triton/vararg_kernel.py", line 244, in unroll_varargs
    jitted_fn.src = new_src
    ^^^^^^^^^^^^^
  File "/home/edison/Downloads/triton/python/triton/runtime/jit.py", line 718, in __setattr__
    raise AttributeError(f"Cannot set attribute '{name}' directly. "
AttributeError: Cannot set attribute 'src' directly. Use '_unsafe_update_src()' and manually clear `.hash` of all callersinstead.

Cannot import /home/edison/Downloads/ComfyUI/custom_nodes/comfyui-easy-use module for custom nodes: Cannot set attribute 'src' directly. Use '_unsafe_update_src()' and manually clear `.hash` of all callersinstead.

Import times for custom nodes:
   0.0 seconds: /home/edison/Downloads/ComfyUI/custom_nodes/websocket_image_save.py
   0.0 seconds: /home/edison/Downloads/ComfyUI/custom_nodes/ComfyUI_AdvancedRefluxControl
   0.0 seconds: /home/edison/Downloads/ComfyUI/custom_nodes/comfyui-inpaint-cropandstitch
   0.0 seconds: /home/edison/Downloads/ComfyUI/custom_nodes/comfyui-inpainteasy
   0.0 seconds: /home/edison/Downloads/ComfyUI/custom_nodes/comfyui_essentials
   0.0 seconds: /home/edison/Downloads/ComfyUI/custom_nodes/comfyui_ultimatesdupscale
   0.0 seconds: /home/edison/Downloads/ComfyUI/custom_nodes/ComfyUI-GGUF
   0.0 seconds: /home/edison/Downloads/ComfyUI/custom_nodes/rgthree-comfy
   0.0 seconds: /home/edison/Downloads/ComfyUI/custom_nodes/comfyui_layerstyle
   0.0 seconds: /home/edison/Downloads/ComfyUI/custom_nodes/comfyui_bnb_nf4_loaders
   0.0 seconds (IMPORT FAILED): /home/edison/Downloads/ComfyUI/custom_nodes/comfyui-easy-use
   0.0 seconds: /home/edison/Downloads/ComfyUI/custom_nodes/comfyui-manager
   0.0 seconds (IMPORT FAILED): /home/edison/Downloads/ComfyUI/custom_nodes/svdquant
   0.8 seconds: /home/edison/Downloads/ComfyUI/custom_nodes/was-node-suite-comfyui
   0.9 seconds: /home/edison/Downloads/ComfyUI/custom_nodes/ComfyUI_LayerStyle_Advance
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant