This paper aims at discussing at the on-line learning based LVQ using akernel function in support vector machines. Furthermore, its extension with fuzzy membership functions is considered.Numerical examples are compared to other kernel-based clustering algorithms and effects of proposed algorithms are discussed.