中国科学院软件研究所机构知识库
Advanced  
ISCAS OpenIR  > 软件所图书馆  > 期刊论文
Title:
一种基于文件支持度的动态副本管理机制
Alternative Title: A Dynamic Replica Management Mechanism Based on File Support Degree
Author: 肖中正 ; 陈宁江 ; 贾炅昊 ; 张文博
Keyword: 分布式存储 ; 动态副本管理 ; 负载均衡 ; 文件支持度 ; 容错
Source: 计算机研究与发展
Issued Date: 2016
Volume: 53, Issue:2, Pages:431-442
Indexed Type: CSCD
Department: 肖中正, 广西大学计算机与电子信息学院, 南宁, 广西 530004, 中国;陈宁江, 广西大学计算机与电子信息学院, 南宁, 广西 530004, 中国;贾炅昊, 广西大学计算机与电子信息学院, 南宁, 广西 530004, 中国;张文博, 中国科学院软件研究所软件工程技术研究开发中心, 北京 100190, 中国;
Abstract: 在大规模分布式存储系统的容错技术中,数据副本管理是一种重要机制.针对网络环境中的动态副本管理需求,建立一种文件支持度指标及其动态计算模型.该模型 通过周期性数据采集,利用文件支持度的自相关性,结合文件上一采集周期访问量、访问量占比、被访问数据量以及文件级别等参数,构建了能够较准确描述文件的 动态副本需求状态模型.通过动态适应性的参数调整以适应变化的负载状态,使副本管理决策尽可能反映系统实际状态.在此基础上设计了数据结点负载均衡、副本 调整、副本清理等相关算法,实现了动态副本管理的目标.通过实验验证了所设计的动态副本管理机制的有效性.
English Abstract: Replication-based management schema is an important fault tolerance mechanism in large scale distributed storage systems. In response to the demand of dynamic replication management in distributed storage systems, a file popularity index named file support degree and its computation model are proposed. Within this model, file's parameters are periodically collected. By combination of self-correlation of file support degree, file hits in previous collection cycle, accessed data volume and file's grade, a model that exactly reflects files' replication requirement is built. To adapt to the variable system load, the model dynamically adjusts its parameters, making the replication decision-making to reflect real system status. Based on these work, some algorithms like load balancing, replication adjustment and replication clearing are designed. To avoid a single data storage node being overloaded, a data storage nodes' load-balance strategy is proposed. In this strategy, data storage nodes are divided into 3 groups: a holding group, an acceptable group and a begging group. There are 2 periodic procedures in the system, including replication adjusting procedure and replication clearing procedure. In replication adjusting procedure, top P files are replicated to data storage nodes selected based on the load-balance strategy. Replication clearing procedure is a long-periodic procedure, because it needs many adjusting procedures to make the begging group be empty. This dynamic replication management mechanism is proven effective through the given experimentations.
Language: 中文
Citation statistics:
Content Type: 期刊论文
URI: http://ir.iscas.ac.cn/handle/311060/17372
Appears in Collections:软件所图书馆_期刊论文

Files in This Item:
File Name/ File Size Content Type Version Access License
一种基于文件支持度的动态副本管理机制.pdf(3244KB)----限制开放 联系获取全文

Recommended Citation:
肖中正,陈宁江,贾炅昊,等. 一种基于文件支持度的动态副本管理机制[J]. 计算机研究与发展,2016-01-01,53(2):431-442.
Service
Recommend this item
Sava as my favorate item
Show this item's statistics
Export Endnote File
Google Scholar
Similar articles in Google Scholar
[肖中正]'s Articles
[陈宁江]'s Articles
[贾炅昊]'s Articles
CSDL cross search
Similar articles in CSDL Cross Search
[肖中正]‘s Articles
[陈宁江]‘s Articles
[贾炅昊]‘s Articles
Related Copyright Policies
Null
Social Bookmarking
Add to CiteULike Add to Connotea Add to Del.icio.us Add to Digg Add to Reddit
所有评论 (0)
暂无评论
 
评注功能仅针对注册用户开放,请您登录
您对该条目有什么异议,请填写以下表单,管理员会尽快联系您。
内 容:
Email:  *
单位:
验证码:   刷新
您在IR的使用过程中有什么好的想法或者建议可以反馈给我们。
标 题:
 *
内 容:
Email:  *
验证码:   刷新

Items in IR are protected by copyright, with all rights reserved, unless otherwise indicated.

 

 

Valid XHTML 1.0!
Copyright © 2007-2019  中国科学院软件研究所 - Feedback
Powered by CSpace