| Peng Fei (彭飞),You Jiali,Zeng Xuewen,Deng Haojiang.[J].高技术通讯(英文),2016,22(3):288~296 |
|
| MapReduce based computation of the diffusion method in recommender systems |
| |
| DOI：10.3772/j.issn.1006-6748.2016.03.008 |
| 中文关键词: |
| 英文关键词: MapReduce, recommender system, diffusion, parallel, matrix multiplication |
| 基金项目: |
| Author Name | Affiliation | | Peng Fei (彭飞) | | | You Jiali | | | Zeng Xuewen | | | Deng Haojiang | |
|
| Hits: 1031 |
| Download times: 916 |
| 中文摘要: |
| |
| 英文摘要: |
| The performance of existing diffusion-based algorithms in recommender systems is still limited by the processing ability of a single computer. In order to conduct the diffusion computation on large data sets, a parallel implementation of the classic diffusion method on the MapReduce framework is proposed. At first, the diffusion computation is transformed from a summation format to a cascade matrix multiplication format, and then, a parallel matrix multiplication algorithm based on dynamic vector is proposed to reduce the CPU and I/O cost on the MapReduce framework, which can also be applied to other parallel matrix multiplication scenarios. Then, block partitioning is used to further improve the performance, while the order of matrix multiplication is also taken into consideration. Experiments on different kinds of data sets have verified the efficiency of the proposed method. |
|
View Full Text
View/Add Comment Download reader |
| Close |
|
|
|
