论文部分内容阅读
信息技术正在从以计算设备为核心的计算时代进入到以数据为核心的存储时代.数据量和数据价值的增加,对存储系统的容量、成本、访问性能和数据可靠性等方面提出了更高的要求.为减小冗余数据开销并保证数据的可用性和可靠性,采用纠删码技术已成为业界的发展趋势.数据一致性是纠删码存储系统的本质属性,保证了数据的可靠性和可用性,高效保证纠删码数据的一致性是纠删码系统的关键.提出“写后重映射”存储模型(After Write Remapping,AWR)和事务实现方法,保证了纠删码数据的一致性.AWR模型为纠删码数据的更新过程提供原子性和持久性,采用非原位更新和原子重映射机制保证了更新过程中数据的一致性,具有通用性好、存储开销低和事务性能高的特点.经过理论分析和实际测试验证,AWR事务存储模型带来的纠删码存储系统读性能损失低于1%,64KB及以上粒度的写性能损失低于3%,高效地保证了纠删码数据的一致性.
Information technology is moving from a computationally-based computing era to a data-centric era of storage, with increased amounts of data and data, and higher levels of storage capacity, cost, access performance and data reliability .In order to reduce redundant data overhead and ensure data availability and reliability, the use of erasure code technology has become the industry trend.Data consistency is the essential attribute of erasure code storage system to ensure the reliability of the data And availability, and ensure the consistency of erasure code data efficiently is the key of erasure code system.After Write Remapping (AWR) and transaction implementation methods are proposed to ensure that erasure code data Consistency.AWR model provides atomicity and persistence for the erasure code data update process, using non-in situ updating and atomic remapping mechanism to ensure the consistency of the data in the update process, with good universality, low storage overhead and transaction High performance.After theoretical analysis and practical testing, AWR transaction storage model to bring erasure code storage system read performance loss of less than 1%, 64KB and above granularity Write performance loss of less than 3%, effectively ensure the consistency of erasure code data.