Measurement- and model-based performance evaluation and speed-up communications of multiprocessor PC systems in high-speed networks |
| |
Team Leader | |
Scientists | |
Partners | Telecommunications And Computer Networks, University of Hamburg |
Funding | Deutsche Forschungsgemeinschaft (German Research Foundation) |
Project Time | 01.08.2012 - 01.01.2016 |
Project Description | In order to use PC-systems for high speed data transmission in gigabit and 10 gigabit networks drivers, network protocol stacks and applications need to be improved to fit the hardware architecture and to make use of its provided techniques for parallelization. Goal of the MEMPHIS project is to analyze and develop methods for performance evaluation and improvement of packet and protocol processing on current multiprocessor computer systems. These results can be used within a broad field of application. The project tries to gain basic understanding of the interplay between the various hardware and software components that are involved in the packet and protocol processing. Therefore a model which describes the interaction between hardware and software is developed. It allows exact determination of the required resources for the various processing steps within existing systems. This model is parameterised and validated with the help of measurements that are performed on real systems. The system and the model, are used to identify the performance limiting factors and bottlenecks of existing software router systems. The model allows prediction of effects caused by changes in the software side. So transposition, implementation and evaluation of performance-enhancing factors is done. |
| [1] | Martin Steil. Comparison of Windows and Linux Networking Performance. IDP, 2016. [ .pdf ] |
| [2] | Jan Weicker. Performance Comparison of Virtual Switching on Windows and Linux Systems. MA, 2016. [ .pdf ] |
| [3] | offen. Entwicklung eines OpenFlow-Switch Benchmarks. MA/BA/GR, 2016. [ .pdf ] |
| [4] | offen. Software Components to Process Millions of Packets per Second. MA, 2016. [ .pdf ] |
| [5] | Peter Pfrommer. Evaluation of High-Performance Packet IO for Servers based on Commodity Hardware. BA, 2015. [ .pdf ] |
| [6] | offen. MoonGUI - Live Evaluation of Network Tests. BA, IDP, HiWi, 2015. [ .pdf ] |
| [7] | Sven Hertle. Smart Meter - Energy Measurement in Data Centers. IDP, 2015. [ .pdf ] |
| [8] | Lukas Wieditz. Testing and Validating Tests for Reproducible Experiments. BA, 2015. [ .pdf ] |
| [9] | offen. Calibrating MoonGen for Reproducible Experiments. BA, IDP, HiWi, 2015. [ .pdf ] |
| [10] | Daniel Krieger. Comparison of the Windows Network Stack Performance with Linux. BA, 2015. [ .pdf ] |
| [11] | Dominik Scholz. Component Interaction Models for Linux-based Network Systems. Guided Research, 2015. [ .pdf ] |
| [12] | Dominik Scholz. Protocol Stacks for Packet Generators: A Dynamic Approach. IDP, 2015. |
| [13] | Marcel Sütterlin. Analysis of the FreeBSD Network Stack Performance. BA, 2015. [ .pdf ] |
| [14] | Lukas Märdian. Accelerating Network Applications with NIC Offloading. IDP, 2015. [ .pdf ] |
| [15] | Lukas Märdian. Automatic verification of RF equipment with off-the-shelf hardware. MA, 2015. |
| [16] | offen. Automated Network Device Benchmarking Framework Beyond RFC2544. BA,MA,IDP, 2015. [ .pdf ] |
| [17] | Patrick Werneck. Network Device Benchmarking Framework. BA, 2015. [ .pdf ] |
| [18] | Stefan Kreuzer. Automation of Virtual Machine Setups for Network Experiments. BA, 2015. [ .pdf ] |
| [19] | Thomas Schultz. A Test Bench for SDN Device Certification. MA, 2015. [ .pdf ] |
| [20] | offen. Latency of Game Servers. GP, 2015. [ .pdf ] |
| [21] | offen. Analysis of Parallel Packet Processing on NUMA Architectures. BA,MA,GR, 2015. [ .pdf ] |
| [22] | Rainer Schönberger. A Modular Software Router based on DPDK. MA, 2015. |
| [23] | Sina Shafaei. Performance Evaluation of Mobile Network Components. IDP, 2015. |
| [24] | Simon Gallitscher. Netzwerkstack gesucht - Hilf uns einen schnellen Stack zu finden. GR, 2015. [ .pdf ] |
| [25] | Paul Emmerich. A Performance Analysis of Open vSwitch. MA, 2014. [ .pdf ] |
| [26] | Christian Fuchs. Network Delay Measurements with Commodity Hardware. BA, 2014. [ .pdf ] |
| [27] | Sebastian Gallenmüller. Comparison of Memory Mapping Techniques for High-Speed Packet Processing. MA, 2014. [ .pdf ] |
| [28] | Zubair Hafeez. A Case Study of Software Defined Networking (SDN) Deployments. MA, 2014. [ .pdf ] |
| [29] | offen. Entwicklung der Performanz des Linux Network Stacks. BA/MA, 2014. [ .pdf ] |
| [30] | Stefan Edinger. QoS-differentiation in Software Routers. BA, 2014. [ .pdf ] |
| [31] | Lukas Erlacher. Temporal Behavior of PC-based Packet Processing. MA, 2014. [ .pdf ] |
| [32] | Felix Lampe. Scaling of Future Software Router Architectures. BA, 2014. [ .pdf ] |
| [33] | Linus Lotz. Energy Efficiency of Software Routers. IDP, 2014. [ .pdf ] |
| [34] | Tobias Betz. Scientific Workflow Optimization in Networking Testbeds. BA, 2014. [ .pdf ] |
| [35] | Dominik Scholz. A Model for Performance Prediction in PC-based Packet Processing Systems. BA, 2014. [ .pdf ] |
| [36] | Tobias Weiher. Robustness and Performance of Online Game Server Infrastructure. BA, 2014. [ .pdf ] |
| [37] | Simon Gallitscher. Performance Evaluation of Software-based Packet Processing in Commodity Routers. BA, 2014. [ .pdf ] |
| [38] | Alexander Mildner. Beyond RFC 2544: A Framework for Device Benchmarking. BA, 2013. [ .pdf ] |
| [39] | Syed Rizvi. Software Defined Networking (SDN) for ISP Networks. MA, 2013. [ .pdf ] |
| [40] | Robert Schmidpeter. On the Trail of Packets in PC-based Packetprocessing Systems. BA, 2013. [ .pdf ] |
| [41] | Alexander Schubert. Resource Mapping for Network Experiments. BA, 2013. |
| [42] | Thomas Schultz. A Performance Analysis of PC-based Software Routers. BA, 2012. [ .pdf ] |
Related Publications
Publications
| 2015-10-01 | Paul Emmerich, Sebastian Gallenmüller, Daniel Raumer, Florian Wohlfart, Georg Carle, “MoonGen: A Scriptable High-Speed Packet Generator,” in Internet Measurement Conference (IMC) 2015, IRTF Applied Networking Research Prize 2017, Tokyo, Japan, Oct. 2015. [Pdf] [Bib] |
| 2015-09-01 | Torsten Runge, Daniel Raumer, Florian Wohlfart, Bernd E. Wolfinger, Georg Carle, “How Do Multiple Network Cards Influence the Software Router Performance?,” in Proceedings of Leistungs-, Zuverlässigkeits- und Verlässlichkeitsbewertung von Kommunikationsnetzen und Verteilten Systemen, 6. GI/ITG-Workshop MMBnet 2015, Hamburg, Germany, Sep. 2015. [Pdf] [Bib] |
| 2015-09-01 | Daniel Raumer, Florian Wohlfart, Dominik Scholz, Georg Carle, “Performance Exploration of Software-based Packet Processing Systems,” in Proceedings of Leistungs-, Zuverlässigkeits- und Verlässlichkeitsbewertung von Kommunikationsnetzen und Verteilten Systemen, 6. GI/ITG-Workshop MMBnet 2015, Hamburg, Germany, Sep. 2015. [Pdf] [Bib] |
| 2015-07-01 | Paul Emmerich, Daniel Raumer, Alexander Beifuß, Lukas Erlacher, Florian Wohlfart, Torsten M. Runge, Sebastian Gallenmüller, Georg Carle, “Optimizing Latency and CPU Load in Packet Processing Systems,” in International Symposium on Performance Evaluation of Computer and Telecommunication Systems (SPECTS 2015), Chicago, IL, USA, Jul. 2015. [Pdf] [Bib] |
| 2015-06-01 | Viktor Goldberg, Florian Wohlfart, Daniel Raumer, “Datacenter Network Virtualization in Multi-Tenant Environments,” in 8. DFN-Forum Kommunikationstechnologien, Jun. 2015. [Pdf] [Bib] |
| 2015-05-01 | Sebastian Gallenmüller, Paul Emmerich, Daniel Raumer, Georg Carle, “MoonGen: Software Packet Generation for 10 Gbit and Beyond,” in 12th USENIX Symposium on Networked Systems Design and Implementation (NSDI 15), Oakland, CA, USA, May 2015. [Pdf] [Poster] [Bib] |
| 2015-05-01 | Sebastian Gallenmüller, Paul Emmerich, Florian Wohlfart, Daniel Raumer, Georg Carle, “Comparison of Frameworks for High-Performance Packet IO,” in ACM/IEEE Symposium on Architectures for Networking and Communications Systems (ANCS 2015), Oakland, CA, USA, May 2015. [Pdf] [Bib] |
| 2015-04-01 | Torsten M. Runge, Daniel Raumer, Florian Wohlfart, Bernd E. Wolfinger, Georg Carle, “Towards Low Latency Software Routers,” Journal of Networks (JNW), Vol 10, No 4, Apr. 2015. [Pdf] [Bib] |
| 2015-04-01 | Paul Emmerich, Daniel Raumer, Florian Wohlfart, Georg Carle, “Assessing Soft- and Hardware Bottlenecks in PC-based Packet Forwarding Systems,” in Fourteenth International Conference on Networks (ICN 2015), Best Paper Award, Barcelona, Spain, Apr. 2015. [Pdf] [Bib] |
| 2015-03-01 | Alexander Beifuß, Daniel Raumer, Paul Emmerich, Torsten M. Runge, Florian Wohlfart, Bernd E. Wolfinger, Georg Carle, “A Study of Networking Software Induced Latency,” in 2nd International Conference on Networked Systems 2015 (NetSys’15), Cottbus, Germany, Mar. 2015. [Pdf] [Bib] |
| 2015-01-01 | Syed Naveed Rizvi, Daniel Raumer, Florian Wohlfart, Georg Carle, “Towards Carrier Grade SDNs,” Journal of Computer Networks, 2015. [Pdf] [Bib] |
| 2014-12-01 | Paul Emmerich, Daniel Raumer, Florian Wohlfart, Georg Carle, “A Study of Network Stack Latency for Game Servers,” in 13th Annual Workshop on Network and Systems Support for Games (NetGames’14), Nagoya, Japan, Dec. 2014. [Pdf] [Bib] |
| 2014-10-01 | Paul Emmerich, Daniel Raumer, Florian Wohlfart, Georg Carle, “Performance Characteristics of Virtual Switching,” in 2014 IEEE 3rd International Conference on Cloud Networking (CloudNet’14), Luxembourg, Oct. 2014. [Pdf] [Bib] |
| 2014-07-01 | Torsten Meyer, Daniel Raumer, Florian Wohlfart, Bernd E. Wolfinger, Georg Carle, “Low latency Packet Processing in Software Routers,” in International Symposium on Performance Evaluation of Computer and Telecommunication Systems (SPECTS 2014), Best Paper Award, Monterey, CA, USA, Jul. 2014. [Pdf] [Bib] |
| 2014-03-01 | Torsten Meyer, Florian Wohlfart, Daniel Raumer, Bernd E. Wolfinger, Georg Carle, “Validated Model-Based Prediction of Multi-Core Software Router Performance,” Praxis der Informationsverarbeitung und Kommunikation (PIK), vol. 37.2, pp. 93–107, Mar. 2014. [Pdf] [Bib] |
| 2013-12-01 | Andreas Müller, Florian Wohlfart, Georg Carle, “Analysis and Topology-based Traversal of Cascaded Large Scale NATs,” in HotMiddlebox: ACM CoNEXT Workshop on Hot Topics in Middleboxes and Network Function Virtualization, Santa Barbara, CA, USA, Dec. 2013. [Pdf] [Bib] |
| 2013-09-01 | Torsten Meyer, Florian Wohlfart, Daniel Raumer, Bernd E. Wolfinger, Georg Carle, “Measurement and Simulation of High-Performance Packet Processing in Software Routers,” in Proceedings of Leistungs-, Zuverlässigkeits- und Verlässlichkeitsbewertung von Kommunikationsnetzen und Verteilten Systemen, 5. GI/ITG-Workshop MMBnet 2013, Hamburg, Germany, Sep. 2013. [Pdf] [Bib] |
| 2013-05-01 | Lothar Braun, Cornelius Diekmann, Nils Kammenhuber, Georg Carle, “Adaptive Load-Aware Sampling for Network Monitoring on Multicore Commodity Hardware,” in IFIP Networking 2013, New York, NY, May 2013. [Url] [Pdf] [Preprint] [Sourcecode] [Bib] |