Evolved control of natural plants: Crossing the reality gap for user-defined steering of growth and motion

Mixing societies of natural and artificial systems can provide interesting and potentially fruitful research targets. Here we mix robotic setups and natural plants in order to steer the motion behavior of plants while growing. The robotic setup uses a camera to observe the plant and uses a pair of light sources to trigger phototropic response, steering the plant to user-defined targets. An evolutionary robotic approach is used to design a controller for the setup. Initially, preliminary experiments are performed with a simple predetermined controller and a growing bean plant. The plant behavior in response to the simple controller is captured by image processing, and a model of the plant tip dynamics is developed. The model is used in simulation to evolve a robot controller that steers the plant tip such that it follows a number of randomly generated target points. Finally, we test the simulation-evolved controller in the real setup controlling a natural bean plant. The results demonstrate a successful crossing of the reality gap in the setup. The success of the approach allows for future extensions to more complex tasks including control of the shape of plants and pattern formation in multiple plant setups. 2017 Copyright is held by the owner/author(s). Publication rights licensed to ACM.