Home   Research Publications Members Related Software
IndexBrowse   BibliographiesMy selection
 Search: in   (word length ≥ 3)
      Login
Publication no #671   Download bibtex file Type :   Html | Bib | Both
Add to my selection
Breaking the Vicious Circle: Self-Adaptive Microservice Circuit Breaking and Retry

Mohammad Reza Saleh Sedghpour, David Garlan, Bradley Schmerl, Cristian Klein and Johan Tordsson.


In Proceedings of the 11th IEEE International conference on Cloud Engineering (IC2E), 25-28 September 2023. Best Paper Award.

Online links: PDF

Abstract
Microservice-based architectures consist of numer- ous, loosely coupled services with multiple instances. Service meshes aim to simplify traffic management and prevent mi- croservice overload through circuit breaking and request retry mechanisms. Previous studies have demonstrated that the static configuration of these mechanisms is unfit for the dynamic environment of microservices. We conduct a sensitivity analysis to understand the impact of retrying across a wide range of scenarios. Based on the findings, we propose a retry controller that can also work with dynamically configured circuit breakers. We have empirically assessed our proposed controller in various scenarios, including transient overload and noisy neighbors while enforcing adaptive circuit breaking. The results show that our proposed controller does not deviate from a well-tuned configura- tion while maintaining carried response time and adapting to the changes. In comparison to the default static retry configuration that is mostly used in practice, our approach improves the carried throughput up to 12x and 32x respectively in the cases of transient overload and noisy neighbors.

Keywords: Self-adaptation, Self-Repair.  
@InProceedings{2023:Sedghpour:IC2E,
      AUTHOR = {Sedghpour, Mohammad Reza Saleh and Garlan, David and Schmerl, Bradley and Klein, Cristian and Tordsson, Johan},
      TITLE = {Breaking the Vicious Circle: Self-Adaptive Microservice Circuit Breaking and Retry},
      YEAR = {2023},
      MONTH = {25-28 September},
      BOOKTITLE = {Proceedings of the 11th IEEE International conference on Cloud Engineering (IC2E)},
      PDF = {http://acme.able.cs.cmu.edu/pubs/uploads/pdf/Mohammad___Paper___6.pdf},
      ABSTRACT = {Microservice-based architectures consist of numer- ous, loosely coupled services with multiple instances. Service meshes aim to simplify traffic management and prevent mi- croservice overload through circuit breaking and request retry mechanisms. Previous studies have demonstrated that the static configuration of these mechanisms is unfit for the dynamic environment of microservices. We conduct a sensitivity analysis to understand the impact of retrying across a wide range of scenarios. Based on the findings, we propose a retry controller that can also work with dynamically configured circuit breakers. We have empirically assessed our proposed controller in various scenarios, including transient overload and noisy neighbors while enforcing adaptive circuit breaking. The results show that our proposed controller does not deviate from a well-tuned configura- tion while maintaining carried response time and adapting to the changes. In comparison to the default static retry configuration that is mostly used in practice, our approach improves the carried throughput up to 12x and 32x respectively in the cases of transient overload and noisy neighbors.},
      NOTE = {Best Paper Award},
      KEYWORDS = {Self-adaptation, Self-Repair}
}
    Created: 2023-07-17 11:52:18     Modified: 2024-02-01 10:50:37
Feedback: ABLE Webmaster
Last modified: Sat October 12 2019 16:15:32
        BibAdmin