Yoshihiro MIYAKE was born in 1959. He received the B.S. degree in 1983, the M.S. degree in 1985, and the Ph.D. in 1989 from The University of Tokyo. He was a lecturer from 1989 to 1994, and an associate professor from 1994 to 1996 in the department of Computer Engineering at Kanazawa Institute of Technology. Since 1996, he has been an associate professor in the department of Computational Intelligence and Systems Science, Interdisciplinary Graduate School of Science and Engineering, at Tokyo Institute of Technology, JAPAN. Since 1999, he is also a guest professor in the Human Research Center at The University of Munich, Germany.
Co-creation system
Yoshihiro MIYAKE
Dept. of Computational Intelligence and Systems Science, Tokyo Institute of Technology
Abstract
The purpose of our research group is to realize a "Co-creation System." Co-creation means co-emergence of real-time coordination by sharing subjective space between different persons. Human communication with emergent reality like this needs two kinds of processing at the same time. One is explicit communication such as the exchange of messages and the other is implicit embodied interaction such as sympathy and direct experience. Using this dual-processing complementarily, we are developing co-creative man-machine interfaces and interactive media. This new technology will be effective for recovering human linkage, social ethics and mutual-reliability that has been lost in the IT society.
1 Introduction
As the background to this research, we have already pointed out the serious limitation of intelligence realized in artificial systems. Human intelligence can be classified into two different categories: "search" and "emergence." A searching algorithm based on "completeness" of intelligence has been widely used in IT systems. This kind of intelligence is applicable to definite situations in which every state can be previously defined (Fig.1a). However, in indefinite situations, such as the system including human behaviour and social communication, searching cannot be used. In such unpredictable conditions, another type of intelligence is required and intelligence with emergence is essential for overcoming the limitation of the conventional approach.
 |
 |
| (a) |
(b) |
Figure 1: Search and emergence
2 Incompleteness and Co-creation
In the present IT systems based on the framework of searching, the relationship between humans and artificial systems is a one-sided transfer from the system to human. As a result, the size of the information space prepared in the artificial system becomes extremely large and the human becomes very passive on the other side. This is a problem of design principle based on intelligence with completeness. On the other hand, Japanese culture has very different traditional background, i.e. emergence in real-time. Japanese think that artificial systems should be incomplete, but this is a kind of active "incompleteness" to realize an emergent reality with humans (Fig.1b). Due to this incompleteness, coordination between the system and the human is co-created in real-time.
In this process, embodied interaction plays an essential role in realizing a relevant function with real-time coordination. The stone garden Ryoanji temple in Kyoto is a famous example. There are 15 stones in this garden, however you can never see all stones at the same time (Fig.2). Some stones are always hidden by other stones. This is a kind of active incompleteness. So if you want to get a whole image of the garden, you have to walk around in the garden as part of the garden. Then you will be able to co-create the whole image including you as part of the garden. This is the design principle of the co-creation system that is based on active incompleteness and embodiment. However, how to realize such process in an IT system is still an open question.
Figure 2: Japanese stone garden
3 Dual-dynamics Model
To achieve this target, the design principle of the co-creation system should be investigated. In our research group, "duality of self" was proposed as a hypothesis for realizing co-creation. This hypothesis assumes that our human intelligence is composed of two different processing modes. One is the process of "explicit self" and the other is "implicit self." This explicit self is concerned with self-consciousness and realizes intelligence with completeness. In other words this intelligence is our causal operation in formal logic. On the other hand, the implicit self is concerned with embodiment with active incompleteness. This realizes the interaction between the system and the indefinite actual world. Here, the interface between these two processes emerges by "mutual constraint." We regard this emergence as a co-creative process of intelligence.
Figure 3: Dual dynamics model
From this hypothesis, we have already proposed a model of co-creation (Fig.3). This "dual-dynamics model" is composed of two sub-models. One is an internal model to show the explicit process and the other is a body model to represent the implicit process. Since the synchronization phenomenon of the body motion is widely observed as a typical dynamics of the embodied process, a nonlinear oscillator and mutual entrainment are used to show the dynamics of a body model that can be embedded as a part of the indefinite world. This is a kind of mathematical expression of the active incompleteness and temporal coherence can be self-organized in such open space. On the other hand, the internal model is a coupled nonlinear oscillator as closed space to represent the process based on completeness. By the mutual constraint between these two sub-models, an emergent process of intelligence is simulated.
4 Co-creation in Man-Machine Interaction
This model was represented as part of the co-creation process between human and machine. The rehabilitation process of human walking was used as an example because coordinated walking between two persons is widely observed in rehabilitation for elderly people to redevelop their walking ability. Our dual-dynamics model is realized in a personal computer as a virtual walking robot and footsteps are exchanged between the robot and human walker (Fig.4). The footstep of the robot is transmitted to the human by headphones and the footstep of the human is feed back to the robot by a touch sensor. Everyone has had this kind of experience when walking with another person. In such situation, temporal coherence of footsteps between two persons spontaneously appears. This co-creation robot was named "Walk-Mate."
Figure 4: Walk-Mate
Figure 5: Co-creation process
To evaluate the effectiveness of this system, interaction between Walk-Mate and a human with walking impairment was analyzed. As a result, three characteristic properties were observed (Fig.5). The first is mutual adaptation between the human walker and Walk-Mate. The periods of their footsteps mutually coincided with each other after the start of interaction. This is a kind of co-creation dynamics in walking motion. The second is the emergence of global stability including both the dynamics of the human and the Walk-Mate. Fluctuation of the footstep period due to the walking impairment was significantly decreased in this co-creation process. The third is the sense of togetherness emerging through this process, suggesting this process also realizes the emergence of our mental connection. These results show that our proposed framework could be effective for establishing a co-creation process between humans and artificial systems.
5 Conclusion
In this way, we are developing co-creation systems in a man-machine interface. In the next step, this technology for a co-creative interface should be extended to a network system to support co-creative communication in human linkage. On the Internet, exchange of explicit information is very easy but the implicit process cannot be shared there. This means there is no co-creation on the Internet. As such network system has penetrated into daily life, relation-building problems, such as mutual reliability in a virtual community and togetherness between remote families has become an important subject. This co-creation technology has the potential for overcoming the problems of the modern network society.
Recent publications
[Background]
Miyake, Y. (1997). Design in Life (in Japanese). Gendai Shisou, 25(6), pp.301-317.
Shimizu, H., Kume, T., Miwa, Y. & Miyake, Y. (2000). Ba and Co-creation
(in Japanese). NTT Publisher, Tokyo.
[Co-ceation system]
Miyake, Y., "Co-creation system," Cognitive Processing, vol.3, pp.131-136 (2002)
Miyake, Y., "Co-creation in human-computer interaction," in C
Stephanidis & J Jacko (Eds.), Human-Computer Interaction (pp.513-517),
Lawrence Erlbaum Associates Publishers, London (2003)
Miyake, Y., Miyagawa, T. & Tamura, Y., "Man-machine interaction
as co-creation process," Tranzaction of the Society of Instrument
and Control Engineers, vol.E-2 (in press)
[Cognitive process]
Miyake, Y., Onishi, Y. & Poeppel, E., "Two types of anticipation
in synchronous tapping," Acta Neurobiologiae Experimentalis, vol.64
(in press)
Miyake, Y., Onishi, Y. & Poeppel, E., "Two modes of timing anticipation
in synchronization tapping," Tranzaction of the Society of Instrument
and Control Engineers, vol.E-2 (in press)
[Theoretical framework]
Nozawa, T. & Miyake, Y., "Description of systematicity intrinsic
to the dynamics of complex-system models," Chaos, Solitons and Fractals,
vol.14, pp.1095-1115 (2002)
Ogawa, K. & Miyake, Y., "An autonomous decentralized model with
a non-local interaction -- Roles of an extracellular matrix in organization
of multicellular system --," Electronics and Communication in Japan:
Part 3, vol.87 (in press)
about our lab ＆ this site == info@dis.titech.ac.jp
