Subgroup Discovery in Smart Electricity Meter Data

Nanlin Jin, Peter Flach, Tom Wilcox, Royston Sellman, Joshua Thumim, Arno Knobbe

Research output: Contribution to journalArticlepeer-review

23 Citations (Scopus)

Abstract

This work presents data mining methods for discovering unusual consumption patterns and their associated descriptive models from smart electricity meter data. At present, data mining and knowledge discovery in electricity meter data suffer from three notable weaknesses: 1) insufficient focus on intelligent data analysis of subgroups (subsets) whose patterns vary significantly from aggregate patterns embodied in an entire dataset; 2) a lack of effort towards generating intuitively understandable and practically applicable knowledge for industrial practitioners to identify such subgroups; and 3) limited knowledge regarding the link between unusual consumption patterns and household consumers' socio-demographic characteristics. This paper addresses these practically important but technically challenging issues by applying subgroup discovery algorithms to a real smart electricity meter dataset. Subgroups whose patterns are unusual and whose sizes are large enough are discovered, and their descriptive and predictive models are generated. Furthermore, to enrich subgroup discovery algorithms, three new-quality measures for real-valued targets are proposed. The comparative studies empirically evaluate the effectiveness and usefulness of subgroup discovery on classification accuracy, predictive power, and computational resources. The methodologies and algorithms presented are generic, and therefore applicable to a wider range of data mining problems.
Original languageEnglish
Pages (from-to)1327-1336
Number of pages10
JournalIEEE Transactions on Industrial Informatics
Volume10
Issue number2
Early online date14 Mar 2014
DOIs
Publication statusPublished - May 2014

Fingerprint

Dive into the research topics of 'Subgroup Discovery in Smart Electricity Meter Data'. Together they form a unique fingerprint.

Cite this