Create containers in parallel when possible

[denkv]

User story

To make things faster, containers should not be created one by one and created in parallel when possible.

Possible opportunities:

• platform/platform-controller/src/main/java/org/hobbit/controller/ExperimentManager.java

  Lines 239 to 273 in e8c1d84

  	LOGGER.info("Creating benchmark controller " + benchmark.mainImage);
  	String containerId = controller.containerManager.startContainer(benchmark.mainImage,
  	Constants.CONTAINER_TYPE_BENCHMARK, experimentStatus.getRootContainer(),
  	new String[] { Constants.RABBIT_MQ_HOST_NAME_KEY + "=" + experimentStatus.getRabbitMQContainer(),
  	Constants.HOBBIT_SESSION_ID_KEY + "=" + config.id,
  	Constants.HOBBIT_EXPERIMENT_URI_KEY + "=" + experimentStatus.experimentUri,
  	Constants.BENCHMARK_PARAMETERS_MODEL_KEY + "=" + config.serializedBenchParams,
  	Constants.SYSTEM_URI_KEY + "=" + config.systemUri },
  	null, null, config.id);
  	if (containerId == null) {
  	experimentStatus.addError(HobbitErrors.BenchmarkCreationError);
  	throw new Exception("Couldn't create benchmark controller " + config.benchmarkUri);
  	}
  	if (experimentStatus.getRootContainer() == null) {
  	experimentStatus.setRootContainer(containerId);
  	}
  	experimentStatus.setBenchmarkContainer(containerId);
  	LOGGER.info("Creating system " + system.mainImage);
  	String serializedSystemParams = getSerializedSystemParams(config, benchmark, system);
  	containerId = controller.containerManager.startContainer(system.mainImage,
  	Constants.CONTAINER_TYPE_SYSTEM, experimentStatus.getRootContainer(),
  	new String[] { Constants.RABBIT_MQ_HOST_NAME_KEY + "=" + experimentStatus.getRabbitMQContainer(),
  	Constants.HOBBIT_SESSION_ID_KEY + "=" + config.id,
  	Constants.SYSTEM_PARAMETERS_MODEL_KEY + "=" + serializedSystemParams },
  	null, null, config.id);
  	if (containerId == null) {
  	LOGGER.error("Couldn't start the system. Trying to cancel the benchmark.");
  	forceBenchmarkTerminate_unsecured(HobbitErrors.SystemCreationError);
  	throw new Exception("Couldn't start the system " + config.systemUri);
  	} else {
  	experimentStatus.setSystemContainer(containerId);
  	}
  	LOGGER.info("Finished starting of new experiment.");

• platform/platform-controller/src/main/java/org/hobbit/controller/ExperimentManager.java

  Lines 346 to 349 in e8c1d84

  	for (String image : usedImages) {
  	experimentStatus.addImage(image);
  	controller.containerManager.pullImage(image);
  	}

Solution

We already have API for that and it was tested with ORCA:

• https://github.com/dice-group/orca/blob/02e46a0fae6c199955252e4138b27325beecb45b/ldcbench.controller/src/main/java/org/dice_research/ldcbench/benchmark/BenchmarkController.java#L137