介绍

主要研究方向为分布式计算、大数据与机器学习系统 ,目前主要关注以内存为中心的大数据处理与分析,包括面向流式机器学习、分布式图数据挖掘分析等新型计算需求的引擎系统与算法。获国家重点研发计划课题、国家自然科学基金、国家863高技术计划、中科院先导A类专项课题等资助,与华为、阿里、京东、金山云等企业开展合作。
    • 招收对分布式系统、大数据与机器学习系统研究感兴趣的博士生/硕士生/实习生/访问学生(常年有效),要求学生对研究具有较强兴趣、和较强的动手能力!

    成员

      指导老师

      博士研究生

      • 任仲山, 唐震, 李慧, 孙晓晨

      硕士研究生

      • 邵佳琦, 胡家煊, 康 锴, 叶星彤

      实习生

      • 袁秉诚, 曲慕子, 李京龙, 章凯

    科研项目

      大数据算法研究

      • GraphLib: 分布式图挖掘算法库
      • GraphFlow: 流式图计算引擎及算法
      • StreamML: 流式机器学习并行计算框架及算法
      • BigGraphEmbedding: 大规模图向量表示算法

      大数据系统研究

      • Spark/Flink Benchmark: 大数据处理框架基准测试
      • 系统可靠性保障:内存溢出错误分析与诊断,垃圾回收机制研究
      • EasyCache:内存数据网格系统
      • EasyTesting:负载测试云服务系统
      • EasyAPM:分布式应用性能管理系统
      • TRE4J:多租户性能管理系统

      合作研究

      • 与华为、腾讯、阿里、京东等国内大型IT企业建立了良好的项目合作关系,同时推荐优秀毕业生到这些企业实习和工作。
      • 与国外学者合作密切,定期邀请如OSU Feng Qin教授、WPI的Tian Guo教授来访交流。

    论文发表

      期刊

      • Zheng Tang, Wei Wang, Lei Sun, et al. IO Dependent SSD Cache Allocation for Elastic Hadoop Applications. Sci. China Inf. Sci. (2018) 61: 050104.
      • Lijie Xu, Wensheng Dou, Feng Zhu, Chushu Gao, Jie Liu, and Jun Wei. Characterizing and Diagnosing Out of Memory Errors in MapReduce Applications. The Journal of Systems and Software (JSS), Volume 137, March 2018, Pages 399-414.
      • Xiulei Qin, Wei Wang, Wenbo Zhang, Jun Wei, Xin Zhao, Hua Zhong, Tao Huang. PRESC2: efficient self-reconfiguration of cache strategies for elastic caching platforms. Computing 96(5): 415-451 (2014).
      • 唐震, 吴恒, 王伟, 魏峻, 黄涛. 虚拟化环境下面向多目标优化的自适应SSD缓存系统.软件学报,2017,28(8):1982-1998.
      • 王彦士, 王伟, 刘朝辉, 魏峻, 黄涛. 支持透明集成的数据缓存机制. 计算机研究与发展, 2015, 52(4):907-917.
      • 王伟, 黄涛, 魏峻, 钟华, 宋云奎. 面向多租户Web应用的性能隔离方法. 中国科学:信息科学, 2013, 43(1):45-59.
      • 秦秀磊, 张文博, 王伟, 魏峻, 赵鑫, 黄涛. 面向云端Key/Value存储系统的开销敏感的数据迁移方法. 软件学报, 2013(6):1403-1417.
      • 秦秀磊, 张文博, 魏峻, 王伟, 黄涛. 云计算环境下分布式缓存技术的现状与挑战. 软件学报, 2013, 24(1):50-66.

      会议

      • Zhen Tang, Heng Wu, Lei Sun, Zhongshan Ren, Wei Wang, Wei Zhou, Liang Yang. Transaction-aware SSD Cache Allocation for the Virtualization Environment. SOSE 2018:174-179.
      • Yingying Zheng, Lijie Xu, Wei Wang, Wei Zhou, Ying Ding. A Reliability Benchmark for Big Data Systems on JointCloud. ICDCS Workshops 2017: 306-310.
      • Zhen Tang, Wei Wang, Yu Huang, Heng Wu, Jun Wei, Tao Huang. Application-centric SSD Cache Allocation for Hadoop Applications. Internetware 2017: 5:1--5:10.
      • Yingying Zheng, Wei Wang, Lijie Xu, Zhen Tang, Zhongshan Ren, Jun Wei, Dan Ye. Fast and Precise recovery in Stream processing based on Distributed Cache. Internetware 2017: 19:1-19:6.
      • Lijie Xu, Wensheng Dou, Feng Zhu, Chushu Gao, Jie Liu, Hua Zhong, Jun Wei. A Characteristic Study on Out of Memory Errors in Distributed Data-Parallel Applications. ISSRE 2015: 518-529.
      • Lijie Xu, Jie Liu, and Jun Wei. FMEM: A Fine-grained Memory Estimator for MapReduce Jobs. ICAC 2013:65-68.
      • Lijie Xu, Jie Liu, and Jun Wei. MapReduce Framework Optimization via Performance Modeling. IPDPS PhD Forum:2506-2509.
      • Wei Wang, Zhaohui Liu, Yong Jiang, Xinchen Yuan, Jun Wei. EasyCache: a transparent in-memory data caching approach for internetware. Internetware 2014: 35-44.
      • Qiang Gao, Wei Wang, Guoquan Wu, Xuan Li, Jun Wei, Hua Zhong. Migrating Load Testing to the Cloud: A Case Study. SOSE 2013: 429-434.
      • Wei Wang, Xiang Huang, Xiulei Qin, Wenbo Zhang, Jun Wei, Hua Zhong. Application-Level CPU Consumption Estimation: Towards Performance Isolation of Multi-tenancy Web Applications. IEEE CLOUD 2012: 439-446.
      • Xiulei Qin, Wenbo Zhang, Wei Wang, Jun Wei, Xin Zhao, Tao Huang. Optimizing data migration for cloud-based key-value stores. CIKM 2012: 2204-2208.
      • Xiulei Qin, Wenbo Zhang, Wei Wang, Jun Wei, Xin Zhao, Tao Huang. Towards a Cost-Aware Data Migration Approach for Key-Value Stores. CLUSTER 2012: 551-556.
      • Xiulei Qin, Wei Wang, Wenbo Zhang, Jun Wei, Xin Zhao, Tao Huang. Elasticat: A load rebalancing framework for cloud-based key-value stores. HiPC 2012: 1-10.
      • Shuping Ji, Wei Wang, Chunyang Ye, Jun Wei, Zhaohui Liu. Constructing a data accessing layer for in-memory data grid. Internetware 2012: 15:1-15:7.
      • Wei Wang, Xiang Huang, Yunkui Song, Wenbo Zhang, Jun Wei, Hua Zhong, Tao Huang. A Statistical Approach for Estimating CPU Consumption in Shared Java Middleware Server. COMPSAC 2011: 541-546.

    专利

    • 一种大数据流处理框架的性能基准测试系统及方法,201810461515.X
    • 一种基于混合存储的流式数据自适应持久化方法及系统,201610197157.7
    • 一种基于内存数据网格的流式数据处理程序错误的数据溯源定位方法,201610186177.4
    • 一种基于内存数据网格的实时流式数据处理失效恢复系统及方法,201610186150.5
    • 一种云应用导向的固态盘缓存管理方法及系统,201611127232.9
    • 一种面向内存数据网格的分布式事务保障方法,ZL201310415370.7
    • 一种面向分布式系统性能测试的测试资源管理方法,ZL201310376714.8
    • 基于机器学习的分布式缓存策略自适应切换方法及系统,ZL201110167018.7
    • 一种软件生产线构造方法及系统,ZL201010279066.0
    • 一种Web应用细粒度性能建模方法及其系统,ZL201010275216.0
    • 一种面向Web应用宿主平台的资源供给方法,ZL201010578793.7
    • 一种Web应用性能异常侦测方法,ZL200910079404.3
    • 线程池容量自适应调节方法及应用服务器并发控制方法,ZL200810119285.5
    • 一种基于模型同步的软件工具集成方法,ZL200810119280.2
    • 一种面向应用服务器的资源敏感性能优化方法及其系统,ZL200810119278.5

    毕业生

      博士

      • Xiulei Qin (Advisor: Tao Huang), Gruadated in 2013, Frist employment: Glodon, Beijing. Phd dissertation: Research on the Key Technologies of PaaS-Oriented Distributed Caching Services.

      硕士

      • Wenting Shen, Graduated in 2018, First employment: Alibaba, Hangzhou
      • Wei Zhao, Graduated in 2018, First employment: China Merchants Bank, Shenzhen
      • Chongrui Liu, Graduated in 2018, First employment: SenseTime, Beijing
      • Yingying Zheng, Graduated in 2017, First employment: ISCAS, Beijing
      • Caizheng Liu, Graduated in 2017, Studying in ICTCAS for Phd degree
      • Shikai Duan, Graduated in 2017, First employment: Alibaba, Hangzhou
      • Yong Jiang, Graduated in 2016, First employment: Antfin, Hangzhou
      • Xinchen Yuan, Graduated in 2016, First employment: JD, Beijing
      • Xiaoran Wang, Graduated in 2015, First employment: Xiaomi, Beijing
      • Tienan Chen, Graduated in 2015, First employment: Yuanfudao, Beijing
      • Zhaohui Liu, Graduated in 2015, First employment: Microsoft, US
      • Xinsheng Yang, Graduated in 2014, First employment: Microsoft, US
      • Yanshi Wang, Graduated in 2014, First employment: Alibaba, Hangzhou
      • Shuping Ji, Graduated in 2013, First employment: Microstrategy, Beijing
      • Xuan Li, Graduated in 2013, First employment: Microsoft, Beijing
      • Xin Zhao, Graduated in 2013, First employment: Microstrategy, Beijing

      学士

      • ​Bincheng Yuan, Graduated in 2018, UCAS, studying in ISCAS for Master degree
      • Muzi Qu, Graduated in 2018, UCAS, studying in ISCAS for Master degree
      • Kai Zhang, Graduated in 2018, UCAS, studying in ISCAS for Master degree
      • Keren Zhu, Graduated in 2018, TJU
      • Kai Kang, Graduated in 2017, JLU, studying in ISCAS for Master degree
      • Xingtong Ye, Graduated in 2017, NJTU, studying in ISCAS for Master degree
      • Shixiong Li, Graduated in 2016, HUST, studying in ISCAS for Master degree
      • Chongrui Liu, Graduated in 2015, BUAA, studying in ISCAS for Master degree
      • Yingying Zheng, Graduated in 2014, JLU, studying in ISCAS for Master degree
      • Kai Ren, Graduated in 2013, USTC, studying in ISCAS for Master degree