Interactive cartoon reusing by transfer learning

详细信息	查看全文 | 推荐本文 |

• 作者：Jun Yu^a ; Jun Cheng^b ; ^c ; Dacheng Tao^d ; ^{dacheng.tao@uts.edu.au}
• 关键词：Reusing ; Visual features ; Semantic gap ; Transfer learning ; Subsspace
• 刊名：Signal Processing
• 出版年：2012
• 期刊代码：162_01651684
• 类别：et
• 出版时间：September, 2012
• 卷：92
• 期：9
• 页码：2147-2158
• 文件大小：1340 K

摘要

Cartoon character retrieval is critical for cartoonists to effectively and efficiently make cartoons by reusing existing cartoon data. To successfully achieve these tasks, it is essential to extract visual features to comprehensively represent cartoon characters and accurately estimate dissimilarity between cartoon characters. In this paper, we define three visual features: Hausdorff contour feature (HCF), color histogram (CH) and motion feature (MF), to characterize the shape, color and motion structure information of a cartoon character. The HCF can be referred as intra-features, and the features of CH and MF can be regarded as inter-feature. However, due to the semantic gap, the cartoon retrieval by using these visual features still cannot achieve excellent performance. Since the labeling information has been proven effective to reduce the semantic gap, we introduce a labeling procedure called interactive cartoon labeling (ICL). The labeling information actually reflects user鈥檚 retrieval purpose. A new dimension reduction tool, termed sparse transfer learning (SPA-TL), is adopted to effectively and efficiently encode user鈥檚 search intention. In particular, SPA-TL exploits two pieces of knowledge data, i.e., the labeling knowledge contained in labeled data and the data distribution knowledge contained in all samples (labeled and unlabeled). The low-dimensional subspace is obtained by transferring the user feedback knowledge from labeled samples to unlabeled samples by preserving the sample distribution knowledge. Experimental evaluations in cartoon synthesis suggest the effectiveness of the visual features and SPA-TL.