• KSII Transactions on Internet and Information Systems
    Monthly Online Journal (eISSN: 1976-7277)

A GQM Approach to Evaluation of the Quality of SmartThings Applications Using Static Analysis

Vol. 14, No. 6, June 30, 2020
10.3837/tiis.2020.06.003, Download Paper (Free):

Abstract

SmartThings is one of the most popular open platforms for home automation IoT solutions that allows users to create their own applications called SmartApps for personal use or for public distribution. The nature of openness demands high standards on the quality of SmartApps, but there have been few studies that have evaluated this thoroughly yet. As part of software quality practice, code reviews are responsible for detecting violations of coding standards and ensuring that best practices are followed. The purpose of this research is to propose systematically designed quality metrics under the well-known Goal/Question/Metric methodology and to evaluate the quality of SmartApps through automatic code reviews using a static analysis. We first organize our static analysis rules by following the GQM methodology, and then we apply the rules to real-world SmartApps to analyze and evaluate them. A study of 105 officially published and 74 community-created real-world SmartApps found a high ratio of violations in both types of SmartApps, and of all violations, security violations were most common. Our static analysis tool can effectively inspect reliability, maintainability, and security violations. The results of the automatic code review indicate the common violations among SmartApps.


Statistics

Show / Hide Statistics

Statistics (Cumulative Counts from December 1st, 2015)
Multiple requests among the same browser session are counted as one view.
If you mouse over a chart, the values of data points will be shown.


Cite this article

[IEEE Style]
B. Chang, J. C. Son and K. Choi, "A GQM Approach to Evaluation of the Quality of SmartThings Applications Using Static Analysis," KSII Transactions on Internet and Information Systems, vol. 14, no. 6, pp. 2354-2376, 2020. DOI: 10.3837/tiis.2020.06.003.

[ACM Style]
Byeong-Mo Chang, Janine Cassandra Son, and Kwanghoon Choi. 2020. A GQM Approach to Evaluation of the Quality of SmartThings Applications Using Static Analysis. KSII Transactions on Internet and Information Systems, 14, 6, (2020), 2354-2376. DOI: 10.3837/tiis.2020.06.003.