Exploratory Modeling of Software Performance on Message-Oriented Middleware

Modelado exploratorio del rendimiento y la confiabilidad de software sobre middleware orientado a mensajes

Main Article Content

Martín Flores-González, M.Sc.
Ignacio Trejos-Zelaya, M.Sc.
César Garita, Ph. D.


Performance is an important quality attribute in a software system. Software Performance Engineering comprises analysis, design, construction, measurement and validation concerning performance requirements during software development processes. Performance in software systems using message-based communication depends mostly on the Message-Oriented Middleware (MOM). Software architects need to consider MOM’s organization, configuration and usage details to get meaningful predictions about the behavior of a software system that uses such platform. When including MOM in software architecture, it is required to foresee the impact of messaging and its underlying infrastructure. Software architects may omit the MOM influence, which could lead to wrong predictions. In this article, we explore MOM’s influence through the Palladio Component Model – PCM, a component-based modeling and simulation approach. An application previously modeled with PCM was adapted to include message-oriented communication. Simulations over the model, systematic measurements, and load testing on the adapted application were performed, in order to determine how the changes in the model influenced the prediction of the application’s behavior on performance and reliability. A bottleneck that impacts performance and reliability of the original system was identified.  Introducing MOM improved the system’s reliability but harmed its performance.  Component-based performance simulation revealed significant differences with measurements obtained during the load testing experiments.



Download data is not yet available.

Article Details

Author Biographies (SEE)

Martín Flores-González, M.Sc., Instituto Tecnológico de Costa Rica

Roles: Conceptualization, Formal analysis, Investigation, Methodology, Software, Visualization, Writing – original draft, Writing – review & editing.

Ignacio Trejos-Zelaya, M.Sc., Instituto Tecnológico de Costa Rica

Roles: Conceptualization, Formal analysis, Funding acquisition, Methodology, Writing – original draft, Writing – review & editing.

César Garita, Ph. D., Instituto Tecnológico de Costa Rica

Roles: Conceptualization, Supervision, Writing – original draft, Writing – review & editing.

References (SEE)

[1] M. Woodside, G. Franks, and D. C. Petriu. “The Future of Software Performance Engineering,” in Future of Software Engineering, 2007, pp. 171-187. https://doi.org/10.1109/FOSE.2007.32

[2] I. Sommerville, Software Engineering, London: Pearson Education, 2016.

[3] R. H. Reussner, S. Becker, J. Happe, R. Heinrich, A. Koziolek, H. Koziolek, M. Kramer, and K. Krogmann. Modeling and Simulating Software Architectures: The Palladio Approach, Boston: The MIT Pressm 2016.

[4] S. Tockey, How to Engineer Software - A Model-Based Approach, New York: IEEE Computer Society & John Wiley & Sons, 2019.

[5] H. Koziolek, “Performance evaluation of component-based software systems: A survey,” Performance Evaluation, vol. 67 (8), pp. 634-658, 2010. https://doi.org/10.1016/j.peva.2009.07.007

[6] Q. Noorshams, “Modeling and Prediction of I/O Performance in Virtualized Environments,” Doctoral Thesis, Karlsruhe Institute of Technology, Karlsruhe, 2015. http://digbib.ubka.uni-karlsruhe.de/volltexte/1000046750

[7] J. Happe, H. Friedrich, S. Becker, and R. H. Reussner. “A pattern-based performance completion for Message-oriented Middleware,” in Proceedings of the 7th international workshop on Software and performance (WOSP ’08), 2008, pp. 165-176. https://doi.org/10.1145/1383559.1383581

[8] M. Richards, R. Monson-Haefel, and D. Chappell, Java Message Service. Sebastopol, USA: O’Reilly Media, 2009.

[9] Z. B. Chew, “Modelling Message-oriented-middleware Brokers Using Autoregressive Models for Bottleneck Prediction,” Doctoral Thesis, University of London, London, 2013. http://qmro.qmul.ac.uk/xmlui/handle/123456789/8832

[10] M Woodside, D. Petriu, and K. Siddiqui. “Performance related Completions for Software Specifications,” in Proceedings of the 24th International Conference on Software Engineering, 2002, pp. 22-32.

[11] Y. Liu, and I. Gorton. “Performance prediction of J2EE applications using messaging protocols,” in Proceedings of the 8th international conference on Component-Based Software Engineering (CBSE’05), 2005, pp. 1-16. https://doi.org/10.1007/11424529_1

[12] T.¸ Martinec, L.¸ Marek, A. Steinhauser, P. Tuma, Q. Noorshams, A. Rentschler, and R. Reussner. “Constructing performance model of JMS middleware platform,” in Proceedings of the 5th ACM/SPEC international conference on Performance engineering (ICPE ’14), 2014, pp. 123-134. https://doi.org/10.1145/2568088.2568096

[13] S. S. Alwakeel, and H. M. Almansour, “Modeling and Performance Evaluation of Message-oriented Middleware with Priority Queuing,” Information Technology Journal, vol. 10, pp. 61-70, 2011. https://doi.org/10.3923/itj.2011.61.70

[14] S. Lehrig, R. Sanders, G. Brataas, M. Cecowski, S. Ivanšek, and J. Polutnik. “CloudStore — towards scalability, elasticity, and efficiency benchmarking and analysis in Cloud computing,” Future Generation Computer Systems, vol. 38, pp. 115-126, 2018. https://doi.org/10.1016/j.future.2017.04.018

[15] G. Brataas, E. Stav, S. Lehrig, S. Becker, G. Kopcak, and D. Huljenic. 2013. “CloudScale: scalability management for cloud systems,” in Proceedings of the 4th ACM/SPEC International Conference on Performance Engineering (ICPE ’13), 2013, pp. 335-338. https://doi.org/10.1145/2479871.2479920

[16] M. Flores González, “Modelado y simulación de funciones en la nube en plataformas Function-as-a-Service,” Master Thesis, Instituto Tecnológico de Costa Rica, Costa Rica, 2019.

Citado por: