Skip to content

unrealcv/unrealcv

Folders and files

NameName
Last commit message
Last commit date

Latest commit

a451927 · Feb 8, 2025
Jul 17, 2017
Oct 21, 2017
Aug 20, 2019
May 21, 2016
Jan 27, 2025
Feb 8, 2025
Feb 5, 2025
Apr 9, 2024
Feb 5, 2025
Sep 5, 2018
Jul 12, 2023
Sep 14, 2016
Jun 12, 2024
Jul 13, 2023
Nov 22, 2017
Sep 2, 2018
Oct 19, 2017

Repository files navigation

UnrealCV

Join the chat at https://gitter.im/unrealcv/unrealcv Docs Status

UnrealCV is a project to help computer vision researchers build virtual worlds using Unreal Engine (UE). It extends UE with a plugin by providing:

  1. A set of UnrealCV commands to interact with the virtual world.
  2. Communication between UE and an external program, such as Caffe.

UnrealCV can be used in two ways. The first one is using a compiled game binary with UnrealCV embedded. This is as simple as running a game, no knowledge of Unreal Engine is required. The second is installing the UnrealCV plugin into Unreal Engine and using the editor to build a new virtual world.

Please read Tutorial: Getting Started to learn using UnrealCV.

annotation

Images generated from the technical demo RealisticRendering

New Features

  • Call any Blueprint function from Python by vbp [obj_name] [func_name] [arg1] [arg2] ... command.
  • Support RPC communication between Server and Client in Linux, higher FPS and more reliable.
  • A set of new commands for camera control and object manipulation, please refer to command system for more details.

How to install UnrealCV

To install the UnrealCV Server, you need:

  1. Download the source code and place it on the Plugin folder of a C++ UE project.
  2. launch the C++ project with Visual Studio 2019, UnrealCV will be compiled at the same time.
  3. To check the success installation of UnrealCV, you can run vget /unrealcv/status in the console (Press ` to display the console).

To install the UnrealCV Client, just run: pip install unrealcv

Citation

If you found this project useful, please consider citing our paper

@article{qiu2017unrealcv,
  Author = {Weichao Qiu, Fangwei Zhong, Yi Zhang, Siyuan Qiao,Zihao Xiao, Tae Soo Kim, Yizhou Wang, Alan Yuille},
  Journal = {ACM Multimedia Open Source Software Competition},
  Title = {UnrealCV: Virtual Worlds for Computer Vision},
  Year = {2017}
}

Contact

If you have any suggestion or interested in using UnrealCV, please contact us.