Abstract: In this paper, a theory of knowledge discovery is presented. This theory is based on the simulation of the process of human knowledge discovery, and comprises classification of data, generalization of data in each class against those in other classes, and discovery of implication relation between generated concepts. An implementation of this theory by using an integrated learning called KD3 is described, and applications of KD3 to automated construction of knowledge bases for expert systems are outlined.