SMART: 基于数据流技术的电信网络流量监控系统

SMART: 基于数据流技术的电信网络流量监控系统

常建龙¹^，²，闫莺¹,宫学庆¹,戴岱²,周傲英¹

1. 复旦大学计算机科学与工程学院，上海 200433； 2. 上海电信，上海 200120

收稿日期:1900-01-01 修回日期:1900-01-01 出版日期:2006-10-24 发布日期:2006-10-24
通讯作者: 常建龙

SMART： a system for online monitoring large volumes of network traffic

CHANG Jian-long¹^，²，YAN Ying¹,　GONG Xue-qing¹, DAI Dai², ZHOU Ao-ying¹

1. Computer Science and Engineer， Fudan University， Shanghai 200433， China；2. Shanghai Telecom， Shanghai 200120， China

Received:1900-01-01 Revised:1900-01-01 Online:2006-10-24 Published:2006-10-24
Contact: CHANG Jian-long

摘要/Abstract

摘要： 大多数国内电信运营商现有的网络流量监控系统的分析都是基于数据文件的操作模式，处理速度远跟不上大量数据到达的速度。基于这种情况，提出了基于数据流技术来实现在线网络流量监控系统SMART。SMART收集多个路由器发送的Netflow V5或者V9格式的数据，并将其转换成用户定义的监控流；以滑动窗口的方式查询输出流量构成中Top-k频繁数据信息；监测网络流量突变；以可视化的图形和报表形式显示结果。SMART先进的数据流算法技术基础和完整的系统框架设计使得它在上海电信高效稳定的7*24h运行。

关键词: 数据流系统, 网络流量监控, 电信

Abstract: Monitoring systems deployed in telecom operators are usually too slow because of their disk-based processing approach. To address this problem, an online network traffic monitoring system, named SMART, was designed and developed. The system converts different formats of raw net flow data (Netflow V5 or V9) to user-defined control flows through combination and filtering. It can compute top-k frequent flows with sliding window, detect burst on arbitrary attributes, and present results visually to users. The system could be used to replace the traditional offline monitoring system used in Shanghai Telecom. The basis of advanced streaming algorithms and the design of robust system architecture enable SMART to achieve good performance.

Key words: telecom , network traffic monitoring, data stream system

中图分类号:

TP311.13

常建龙,闫莺,宫学庆,戴岱,周傲英 . SMART: 基于数据流技术的电信网络流量监控系统[J]. J4, 2007, 42(11): 27-31 .

CHANG Jian-long,YAN Ying,GONG Xue-qing,DAI Dai,ZHOU Ao-ying . SMART： a system for online monitoring large volumes of network traffic[J]. J4, 2007, 42(11): 27-31 .

参考文献

多维度评价

Viewed

Full text

Abstract

Cited

Shared

Discussed