Downloads

eGovMon Project Folder (PDF-Document, 686.84 KB)

A brief introduction to the project goals and an overview of the collaborating partners.

eGovMon prosjekthefte (PDF-Document, Norwegian Bokmål, 749.46 KB)

En kort introduksjon til målene for prosjektet og en oversikt over samarbeidspartnere.

D2.1.1 Comparison of accessibility evaluations carried out by eGovMon and DIFI (Norge.no) (PDF-Document, 273.7 KB)

This deliverable contains a short summary of the eGovMon evaluations, which are based on the web accessibility tests developed in the EIAO project, as well as an overview of the Norge.no indicators. In a Question and Answer section the similarities and differences are discussed.

D2.1.1 Sammenligning av eGovMon og norge.no's evalueringer av tilgjengelighet (PDF-Document, Norwegian Bokmål, 443.73 KB)

Denne leveransen inneholder et kot sammendrag av evalueringer som gjøres av eGovMon, basert på tilgjenglighetstester utiviklet in EIAO-prosjektet. I tillegg inneholder den en oversikt over indikatorene brukt av Norge.no. I spørsmål- og svarkapittelet blir likheter og forskjeller diskutert.

D2.1.2 State-of-the-art review: transparency indicators (PDF-Document, 853.14 KB)

This deliverable gives an overview of current state-of-the-art of research and practice in the area of eGovernment transparency measurements. It was compiled as a starting point for further work to define ways to measure transparency of local governments and public agencies by use of automatic and semi-automatic tools, as well as through expert evaluations and surveys.

D4.1.1 Web-mining Methods (PDF-Document, 455.26 KB)

In this deliverable we present an approach for measuring transparency of Norwegian municipality web sites using learning algorithms. As a proof of concept we have developed an algorithm for detecting the presence of mail records. This implementation detects mail records with an accuracy of 96.5% using only about 3 seconds per page.

Additionally, we have outlined initial ideas of how to implement algorithms for all eGovMon tests which rely on learning algorithms.

D4.2.1 eGovMon System Design Specification (PDF-Document, 458.1 KB)

In this document we present the design specification of the first iteration of the eGovMon implementation. The eGovMon tool is built on the results from the FP6 project European Internet Accessibility Observatory (EIAO), and is intended to include approaches to measure accessibility, transparency, efficiency and impact.

The main focus of this paper is to present the architecture updates from EIAO to eGovMon motivated by changes needed to: (1) evaluate transparency and (2) simplify the data storage approach and improve the capacity compared to the results achieved in the EIAO project.

D5.1.2 eGovMon Demonstrator Interface 1.0: User Interface Specification (PDF-Document, 6.42 MB)

This deliverable presents the user interface design specification for a first interface for the eGovMon Demonstrator. It discusses the functionalities and views for presenting Norwegian accessibility results including screenshots of the main visual concepts. 

This deliverable presents a demonstrator simulation model built using System Dynamics methodology and focusing on the eGovernment website accessibility. This model is a part of the eGovMon policy design and testing tool. The document contains a brief description of the model objectives and structure. Furthermore, a preliminary model behaviour based on guestimated parameters for illustration purposes.

This deliverable presents a simulation model built using System Dynamics methodology, aiming at facilitating eParticipation using an online interface for the model. The model is designed to cover some selected factors that are believed to disable or enable disabled people to take up jobs, and intended to support a more targeted discussion among citizens and policy makers. This model is a part of the eGovMon policy design and testing tool. The document contains a brief description of the model objectives and structure. Furthermore, a preliminary model behaviour based on initial guestimated parameters for illustration purposes is included.

Publishable final activity report from the EIAO project (PDF-Document, 677.32 KB)

Final activity report of the EIAO project (European Internet
Accessibility Observatory), a research project co­funded by the European Commission. This document outlines the project, its execution, the results and their use so far and serves as a point of departure for the research in the eGovMon project. For more on the EIAO project see also the EIAO project web site.

Is it possible to predict the manual web accessibility results using the automatic results?

Authors: Carlos Casado, Loïc Martinez and Morten Goodwin Olsen

The most adequate approach for benchmarking web accessibility is manual expert evaluation supplemented by automatic analysis tools. But manual evaluation has a high cost and is impractical to be applied on large web sites. In reality, there is no choice but to rely on automated tools when reviewing large web sites for accessibility. The question is: to what extent the results from automatic evaluation of a web site and individual web pages can be used as an approximation for manual results? This paper presents the initial results of an investigation aimed at answering this question. He have performed both manual and automatic evaluations of the accessibility of web pages of two sites and we have compared the results. In our data set automatically retrieved results could most definitely be used as an approximation manual evaluation results.

Authors: Annika Nietzio, Morten Goodwin Olsen, Mikael Snaprud and Rudolph Brynn

Equal participation for people with disabilities is an important objective of the Information Society. The development of new technologies for eGovernment applications opens up opportunities but also bears the risk of creating new barriers. In this paper, we are looking at the different levels of eGoverment sophistication. For each level, we analyse the potential accessibility barriers. We also investigate how the problems can be identified and present some findings from a survey of Norwegian eGovernment web sites. Apart from the technical perspective, a short overview of the legal background is given.

Benchmarking and improving the quality of Norwegian municipality web sites (PDF-Document, 1.19 MB)

Authors: Morten Goodwin Olsen, Annika Nietzio, Mikael Snaprud and Frank Fardal

Automatic benchmarking can provide a reliable first insight into the accessibility status of a web site. The eGovMon project has developed a tool which can assess web sites according to a statistically sound sampling procedure. Additionally, the tool supports detailed evaluation
of single web pages. This paper describes the process of data acquisition for the case of large scale accessibility benchmarking of Norwegian public web sites. An important contribution is the elaborated approach to communicate the results to the public web site owners which can help them to improve the quality of their web sites. An on-line interface enables them to perform evaluations of single web pages and receive immediate
feedback. The close collaboration with the municipalities has lead to an overall higher quality both of Norwegian public web sites, the eGovMon tool and the underlying methodology.

Automated evaluation alone can not capture the whole picture, and should rather be seen as a complement to manual web accessibility evaluations. The Norwegian Agency for Public Management and eGovernment (DIFI/ Norge.no) carries out an annual web quality survey that includes manual assessment of web accessibility. We present a comparison between
the Norge.no results and the data collected by the eGovMon tool and verify the statistical correlation.

Benchmarking e-government - comparative review of three international benchmarking studies.

Authors: Lasse Berntzen and Morten Goodwin Olsen.

This paper makes a range of comparisons between egovernment developments and performance worldwide. In order to make such comparisons, it is necessary to use a set of indicators. This paper examines the evolution of indicators used by three widely referenced international e-government studies, from the early days of e-government benchmarking until today. Some critical remarks related to the current state-of-the-art are given. The authors conclude that all three studies have their strengths and weaknesses, and propose automatic assessment of e-government services as a potential solution to some of the problems experienced by current benchmarking studies.

Architecture for large-scale automatic web accessibility evaluation based on the UWEM methodology (PDF-Document, 473.16 KB)

Authors: Nils Ulltveit-Moe, Morten Goodwin Olsen, Anand B. Pillai, Christian Thomsen, Terje Gjøsæter and Mikael Snaprud

The European Internet Accessibility Observatory (EIAO) project has developed an observatory for performing large scale automatic web accessibility evaluations of public sector web sites in Europe. The architecture includes a distributed web crawler that crawls web sites for links until either a given budget of web pages have been identified or the web site has been crawled exhaustively. Subsequently, a uniform random subset of the crawled web pages is sampled and sent for accessibility evaluation. The evaluation results are stored in a Resource Description Format (RDF) database that later is loaded into the EIAO data warehouse using an Extract-Transform-Load (ETL) tool. The aggregated indicator results in the data warehouse are finally presented in a Plone based online reporting tool. This paper describes the final version of the EIAO architecture and outlines some of the technical and architectural challenges that the project faced, and the solutions developed towards building a system capable of regular large-scale accessibility evaluations with sufficient capacity and stability. It also outlines some possible future architectural improvements.