Summary of Research Project Results Under the JSPS FY2000
"Research for the future Program"



1.Research Institution Tokyo Institute of Technology
 
2.Research Area Integrated Fields
 
3.Research Field Information on Life Systems
 
4.Term of Project FY1996〜FY2000
 
5.Project Number 96I00105
 
6.Title of Project Biologically Inspired Adaptive Systems

7.Projetct Leader
Name Institution,Department Title of Position
Shigenobu Kobayashi Tokyo Institute of Technology, Interdisciplinary Graduate School of Science and Engineering Professor

8.Core Members

Names Institution,Department Title of Position
Koji Ito Tokyo Institute of Technology, Interdisciplinary Graduate School of Science and Engineering Professor
Katsumi Nitta Tokyo Institute of Technology, Interdisciplinary Graduate School of Science and Engineering Professor
Hajime Kita National Institution for Academic Degrees, Faculty of University Evaluation and Research Professor

9.Cooperating Researchers

Names Institution,Department Title of Position
Kiyohiko Nakamura Tokyo Institute of Technology, Interdisciplinary Graduate School of Science and Engineering Professor
Masayuki Yamamura Tokyo Institute of Technology, Interdisciplinary Graduate School of Science and Engineering Assoc. Prof.
Isao Ono The University of Tokushima, Faculty of Engineering Assoc. Prof.

10.Summary of Research Results

This project has two objectives. The first is to analyze fundamental principles about autonomy, adaptability and emergence of life systems from viewpoints of information science and systems science. The second is to realize adaptive systems that show biological behaviors.
As operational frameworks of biologically inspired adaptive systems, evolutionary computation to investigate the principle of a long-range adaptation of species, reinforcement learning to investigate the principle of individual adaptation under a given environment, and multi-agent systems to investigate the principle of cooperation among populations were chosen.
The group of evolutionary computation has made theoretical and methodological researches to acquire new functions by evolution from a point of engineering. Especially, we have focused on establishing emergent design theory based on real-coded genetic algorithms. As a result, without depending on domain knowledge, we realized automated lens design, forecasting 3D structure of proteins, controlling parallel double inverted pendulums and so on.
The group of adaptive learning has made theoretical and methodological researches to realize learning by interactions with environments. Especially, we have focused on establishing emergent control theory based on reinforcement learning. As a result, without incorporating heuristics, we realized walking of four-legged robots, adaptive control of timeout interval on transactions processing and so on.
The group of multi-agent systems has made theoretical and methodological researches to design and control autonomous distributed systems by autonomous agents with learning functions. As a result, we realized simulation of real stock markets, adaptive control of foul water systems, adaptive Web search systems and so on.

11.Key Words

(1)Biologically Inspired Adaptive Systems、(2)Complex Adaptive Systems、(3)Evolutionary Computation
(4)Genetic Algorithms、(5)Emergent Design Theory、(6)Reinforcement Learning
(7)Emergent Control Theory、(8)Multi-agent Systems、(9)Autonomous Distributed Systems Theory

12.References

[Reference Articles]
Author Title of Article
K. Ikeda and S. Kobayashi GA Based on the UV-Structure Hypothesis and its Application to JSP
Journal Volume Year Pages Concerned
Proc. of Parallel Problem Solving from Nature (PPSN IV)   2000 273-282

Author Title of Article
S. Kimura and S. Kobayashi An Adaptive Alternation Model in Genetic Algorithms considering Landscape Complexity
Journal Volume Year Pages Concerned
Proc. of Int. Conf. on Systems, Man and Cybernetics (SMC 99)   1999 I-601-606

Author Title of Article
I. Ono, S. Kobayashi and K. Yoshida Optimal Lens Design by Real-Coded Genetic Algorithms Using UNDX
Journal Volume Year Pages Concerned
Computer methods in applied mechanics and engineering 186 2000 483-497

Author Title of Article
J. Sakuma and S. Kobayashi Extrapolation-Directed Crossover for Job-shop Scheduling Problems: Complementary Combination with JOX
Journal Volume Year Pages Concerned
Proc. of Genetic and Evolutionary Computation Conf. (GECCO2000)   2000 973-980

Author Title of Article
O. Takahashi, H. Kita and S. Kobayashi Protein Folding by A Hierarchical Genetic Algorithm
Journal Volume Year Pages Concerned
Proc. AROB99   1999 334-339

Author Title of Article
Y. Kabashima and D. Saad The TAP Approach to Intensive and Extensive Connectivity Systems
Journal Volume Year Pages Concerned
Advanced Mean Field Methods, M. Opper and D. Saad Ed., MIT Press     to appear

Author Title of Article
Y. Kabashima, T. Murayama and D. Saad Typical Performance of Gallager-type Error-Correcting Codes
Journal Volume Year Pages Concerned
Physical Review Letters 84 2000 1355-1358

Author Title of Article
Y. Kabashima, T. Murayama and D. Saad Cryptographical Properties of Ising Spin Systems
Journal Volume Year Pages Concerned
Physical Review Letters 84 2000 2030-2033

Author Title of Article
S. Katayama and S. Kobayashi A Stochastic Exploration Strategy for Satisficing Reinforcement Learning
Journal Volume Year Pages Concerned
Proc. of the Int. Conf. on Intelligent Autonomous Systems 5   1998 296-303

Author Title of Article
S. Katayama, H. Kimura, S. Kobayashi A Universal Generalization for Temporal-Difference Learning Using Haar Basis Functions
Journal Volume Year Pages Concerned
Proc. of 17th Int. Conf. on Machine Learning   2000 447-454

Author Title of Article
H. Kimura and S. Kobayashi Efficient Non-Linear Control by Combining Q-learning with Local Linear Controllers
Journal Volume Year Pages Concerned
16th Int. Conf. On Machine Learning   1999 210-219

Author Title of Article
K. Miyazaki and S. Kobayashi Proposal for an Algorithm to improve a Rational Policy in POMDPs
Journal Volume Year Pages Concerned
Proc. of Int. Conf. on Systems, Man and Cybernetics (SMC 99)   1999 V-492-497

Author Title of Article
K. Miyazaki and S. Kobayashi On the Rationality of Profit Sharing in Partially Observable Markov Decision Processes
Journal Volume Year Pages Concerned
5th Int. Conference on Information Systems Analysis and Cynthesis   1999 190-197

Author Title of Article
S. Morita, K. Shibata, X. -Z. Zheng and K. Ito Prosthetic Hand Control based on Torque Estimation from EMG Signal
Journal Volume Year Pages Concerned
Proc. of the 2000 IEEE/RSJ Int. Conf. on Intelligent Robots and Systems 1 2000 389-394

Author Title of Article
E. A. Y. Murakami, K. Shibata, X. -Z. Zheng and K. Ito Human Control Characteristics in Bilateral Micro-Teleoperation System
Journal Volume Year Pages Concerned
IECON 2000   2000 CD-ROM

Author Title of Article
K. Murakoshi and K. Nakamura Firing Patterns Depending on Model Neurons
Journal Volume Year Pages Concerned
IEICE Transactions on Information and Systems E84-D 2001 394-402

Author Title of Article
K. Nakamura Neural processing of the subsecond time range in the temporal cortex
Journal Volume Year Pages Concerned
Neural Computation 10[3] 1998 567-595

Author Title of Article
K. Nakamura, Y. Kabashima and D. Saad Statistical mechanics of low-density parity check error correcting codes over Galois Field
Journal Volume Year Pages Concerned
Europhysics Letters     submitted

Author Title of Article
M. Sato, S. Kobayashi Variance-Penalized Reinforcement Learning for Risk-Averse Asset Allocation
Journal Volume Year Pages Concerned
2nd Int. Conf. on Intelligent Data Engineering and Automated Learning (IDEAL 2000)   2000  

Author Title of Article
X. -Z. Zheng, W. Inamura, K. Shibata and K. Ito A Learning and Dynamic Pattern Generating Architecture for Skillful Robotic Baseball Batting System
Journal Volume Year Pages Concerned
Proc. of ICRA 2000 (IEEE Int'l Conf. on Robotics and Automation)   2000 3227-3232

Author Title of Article
Y. Kobayashi and Y. Miyade New Ensemble System Based on Mutual Entrainment
Journal Volume Year Pages Concerned
IEEE 9th Int. Workshop on Robot and Human Interactive Communication (ROMAN2000)   2000 288-291

Author Title of Article
Y. Miyake and T. Miyagawa Internal observation and co-generative interface
Journal Volume Year Pages Concerned
Proc. of 1999 IEEE Int. Conf. on Systems, Man, and Cybernetics (SMC'99)   1999 I-229-237

Author Title of Article
T. Muto and Y. Miyake Analysis of the Process of Mutual Interaction between Human and Internal Control Model
Journal Volume Year Pages Concerned
Proc. of 2000 IEEE Int. Conf. on Systems, Man, and Cybernetics (SMC'2000)   2000 769-774

Author Title of Article
N. Ono and K. Fukumoto A Modular Approach to Multi-agent Reinforcement Learning
Journal Volume Year Pages Concerned
Weiss(Ed.): Distributed Artificial Intelligence Meets Machine Learning: Learning in Multi-Agent Environments, Springer-Verlag   1997 25-39

Author Title of Article
N. Ono and Y. Fukuta Learning Coordinated Behavior in a Continuous Environment
Journal Volume Year Pages Concerned
G. Weiss(Ed. ): Distributed Artificial Intelligence Meets Machine Learning, Learning in Multi-Agent Environments, Springer-Verlag   1997 73-81

Author Title of Article
I. Ono, T. Nijo and N. Ono A Genetic Algorithm for Automatically Designing Modular Reinforcement Learning Agents
Journal Volume Year Pages Concerned
Proc. 2000 Genetic and Evolutionary Computation Conf. (GECCO-2000)   2000 203-210

Author Title of Article
M. Shibasaki, K. Nitta A Framework for Nonmonotonic Reasoning with Rule Priorities
Journal Volume Year Pages Concerned
Journal of Advanced Computational Intelligence 2[1] 1998 16-25

Author Title of Article
Y. Takama and K. Hirota Application of Immune Network Model to Keyword Set Extraction with Variety
Journal Volume Year Pages Concerned
Proc. of 6th Int'l Conf. on Soft Computing (IIZUKA2000)   2000 825-830

Author Title of Article
Y. Tatsumi and Y. Miyake Hierarchy and fluctuation in time structure of spoken dialog
Journal Volume Year Pages Concerned
Proc. of 1999 IEEE Int. Conf. on Systems, Man, and Cybernetics (SMC'99)   1999 V-1040-1044

Author Title of Article
S. Yamada and M. Mase Integrated information search in the WWW and a human group
Journal Volume Year Pages Concerned
INFORMS/KORMS 2000   2000 1407-1413

Author Title of Article
T. Yamamoto and Y. Miyake Analysis of Interaction in Musical Communication and Its Modeling
Journal Volume Year Pages Concerned
Proc. of 2000 IEEE Int. Conf. on Systems, Man, and Cybernetics (SMC 2000)   2000 763-768

Author Title of Article
M. Yuasa, Y. Yasumura, K. Nitta Giving Advice in Negotiation using Physiological Information
Journal Volume Year Pages Concerned
Proc. of IEEE Int. Conf. on System, Man and Cybernetics (SMC2000)   2000 248-253


back