Key Performance Indicators

In CITI-SENSE, we developed and implemented Key Performance Indicators (KPIs) for project progress evaluation and risk management.

The KPIs covered CITI-SENSE information flow ‘citizens – sensors & platforms – data servers – products & services’.

KPIs score is extracted by questionnaire, and included the following five completion scales and labelled with colours (as showed in Table below):

  • 1: 0 – 60%, If an objective was achieved lowly or relatively poor.
  • 2: 60% – 70%, If an objective was achieved about 60-70%
  • 3: 70% – 80%, If an objective was achieved about 70-80%
  • 4: 80% – 90%, If an objective was achieved mostly.
  • 5: 90 – 100%, If an objective was achieved nealrlya fully.  

Flag colours

Project successful level

Score (%)

Blue

Excellent or complete success

90-100%

Green

Very good or very effective pilot studies

80-90%

Yellow

Good or effective pilot studies

70-80%

Orange

Fair or moderate achievement of goals of the pilot studies

60-70%

Red

Low or relatively poor achievement of the objective of the pilot studies

<60%

The KPIs were implemented in CITI-SENSE at both pilot phase and full implementation phase (see underneth examples), and results showed that it is  a very practical approach for keeping project on right track.

Table 1. The overall score (%) for pilot’ studies KPIs self-evaluation in cities.

 

KPIs theme

Barcelona

Belgrade

Edinburgh

Haifa

Ljubljana

Oslo

Ostrava

Vienna

Citizens

75

65

50

65

85

70

85

60

Sensors and sensor platforms

90

80

50

90

50

80

20

80

Data server platforms

60

60

20

80

100

20

20

100

Products and services

64

38

20

69

56

44

73

64

Others

100

80

20

65

80

40

100

80


Table 2. The overall score (%) for pilot’ studies KPIs self-evaluation in schools.


KPIs theme

20.Oktobar (Serbia)

Holy Rood (Edinburgh)

Gimnazija VIČ (Slovenia)

Horten Videregående (Norway)

Citizens

82

70

82

77

Sensors and sensor platforms

50

50

40

40

Data server platforms

100

100

100

60

Products and services

67

58

56

56

Others

87

73

87

73


Table 3. The overall score (%) for pilot’ studies KPIs self-evaluation in public space Vitoria. 


KPIs theme

Overall score

Explanation

Citizens

60

Above average, we initiated dialog with CEA and Vitoria municipality, but not engaging citizens yet in the pilot’ studies.

Sensors and sensor platforms

100

Very high, we have chosen commercialized sensors. The thermal levels measured by portable Kestrel 4000 can be considered sufficiently accurate and representative for thermal comfort evaluation. The accuracy of the noise levels measured by the Microphone is not reaching the accuracy of a sonometer class 1, but it gives a global noise level with a difference of ± 2 dB.

Data server platforms

60

Above average, data communication via smartphone is working well, further tuning is needed in the full implementation, and CITI-SENSE data server platform is under development.

Products and services

46

Lower than average, various products and services are under development.

Others

100

Very high, the pilot’ studies are a great experiment and lessons learned for the project team that are very crucial for the full implementation.


For more information about KPIs, e.g., how it is developed, how to use it, etc., please contact Hai-Ying Liu from NILU via email hyl@nilu.no.

Term of Use

If you use our Key Performance Indicators, please refer it to the CITI-SENSE project as follows: The Key Performance Indicators were partly developed by the CITI-SENSE project. CITI-SENSE is a Collaborative Project partly funded by the EU FP7-ENV-2012 under grant agreement no. 308524.