欢迎访问机床与液压官方网站!

咨询热线:020-32385312 32385313 RSS EMAIL-ALERT
基于一致性哈希算法的分布式机电系统海量数据存储策略研究
作者:
作者单位:

作者简介:

通讯作者:

中图分类号:

基金项目:

国家自然科学基金(61903291);陕西省重点研发计划(2022GY-134)


Research on Mass Data Storage Strategy of Distributed Electromechanical System Based on Consistent Hash Algorithm
Author:
Affiliation:

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    针对分布式机电系统远程全寿命周期运行监测庞大的海量数据分布式存储与管理的负载不均衡问题,提出一种基于权值比例分配各主机节点数量的分布式存储策略。分析分布式机电系统远程监测平台的数据流结构及其数据特征,建立基于一致性哈希算法的机电液数据的哈希环信息映射,同时引入虚拟节点解决哈希偏移问题。考虑各主机性能差异,基于权值分配虚拟节点,实现负载的自适应,并建立了虚拟节点的动态分配机制。试验结果表明:该存储策略具有良好的负载均衡性,较平均分配各主机节点数量的一致性哈希动态分配存储策略效果更好,能有效减少动态分配次数,使系统快速进入正常运行状态,实现数据的高效存储。

    Abstract:

    A distributed storage strategy based on weight ratio allocation of the number of host nodes was proposed to address the load imbalance problem of distributed storage and management of massive data in remote full life-cycle operation and monitoring of distributed electromechanical systems.The data flow structure of the distributed electromechanical system remote monitoring platform and its data characteristics were analyzed,and a Hash ring information mapping of electromechanical fluid data based on a consistent Hash algorithm was established,while virtual nodes were introduced to solve the Hash offset problem.Considering the performance difference of each host,virtual nodes were assigned based on weights to achieve load adaption,and a dynamic allocation mechanism of virtual nodes was established.The experimental results show that the storage strategy has good load balancing and is more effective than the consistent Hash dynamic allocation strategy which distributes the number of host nodes evenly,the number of dynamic allocations is effectively reduced,the system is enable to enter normal operation quickly and efficient data storage is achieved.

    参考文献
    相似文献
    引证文献
引用本文

刘沛津,王柳月,孙昱,史洁琳,晏东阳.基于一致性哈希算法的分布式机电系统海量数据存储策略研究[J].机床与液压,2023,51(22):31-38.
LIU Peijin, WANG Liuyue, SUN Yu, SHI Jielin, YAN Dongyang. Research on Mass Data Storage Strategy of Distributed Electromechanical System Based on Consistent Hash Algorithm[J]. Machine Tool & Hydraulics,2023,51(22):31-38

复制
分享
文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:
  • 最后修改日期:
  • 录用日期:
  • 在线发布日期: 2023-12-06
  • 出版日期: 2023-11-28