首页 | 本学科首页   官方微博 | 高级检索  
     检索      

一种基于影像块组织的遥感数据分布式存储方法
引用本文:池子文,张 丰,杜震洪,刘仁义.一种基于影像块组织的遥感数据分布式存储方法[J].浙江大学学报(理学版),2014(1):95-99,112.
作者姓名:池子文  张 丰  杜震洪  刘仁义
作者单位:[1]浙江大学浙江省资源与环境信息系统重点实验室,浙江杭州310028 [2]浙江大学地理信息科学研究所,浙江杭州310028
基金项目:国家自然科学基金资助项目(41001227,41101356,41101371);海洋公益性行业科研专项经费资助(20090512-8);浙江省科技攻关计划项目(2010C33146);中央高校基本科研业务费专项(2011QNA3008,2013QNA3023).
摘    要:云存储是解决动态增长的海量遥感数据产品存储管理难题的有效手段.针对云存储在遥感数据存储领域中存在的问题,提出了一种基于影像块组织的遥感数据分布式Key-Value存储模型,解决了分布式文件系统存储大规模影像块效率低下的问题,使遥感数据云存储具备了空间区域访问特性;结合开源分布式文件系统HDFS,实现了影像数据的分布式高效存储与空间区域检索.实验与分析表明,系统在多用户并发连接情况下可以维持较高的吞吐率,同时具备良好的可伸缩性和稳定性.

关 键 词:遥感数据产品  分布式文件系统  HDFS  MapFile  Ke  卜value

A distributed storage method of remote sensing data based on image blocks organization.
CHI Ziwen,ZHANG Feng,DU Zhenhong,LIU Renyi.A distributed storage method of remote sensing data based on image blocks organization.[J].Journal of Zhejiang University(Sciences Edition),2014(1):95-99,112.
Authors:CHI Ziwen  ZHANG Feng  DU Zhenhong  LIU Renyi
Institution:1,2 (1. Zhejiang Provincial Key Lab of GIS, Zhejiang University, Hangzhou 310028, China; 2, Institute of Geographical Information Science, Zhejiang University, Hangzhou 310028, China)
Abstract:As the volume of remote sensing data products is massive and growing rapidly in recent years, cloud stor- age with unparalleled scalability and high throughput is considered as a most potential way to solve the challenges of the storage and management, and reduce the investment for storage equipment. In this paper, the problems existing in the application of cloud storage for remote sensing data were brought up, and a distributed Key-Value storage module based on image blocks organization was put forward to settle them. Thus, the storage inefficiencies problem of distributed file system of cloud platforms for massive image blocks was solved, and the ability of spatial data ac- cess of the remote sensing data cloud storage was introduced. On the basis of HDFS, an open-source cloud-based distributed file system, the efficient distributed storage and retrieval of image data were implemented. The experi ment and analysis showed that the storage system maintains a high throughput under multiple concurrent connec- tions, having a good level of scalability and stability.
Keywords:remote sensing data product  distributed file system  HDFS  MapFile  Key-Value
本文献已被 CNKI 维普 等数据库收录!
设为首页 | 免责声明 | 关于勤云 | 加入收藏

Copyright©北京勤云科技发展有限公司  京ICP备09084417号