KOM2002 overview

Main goal: Produce a web site with psychological and psychiatric advice and information for non-experts.

Objective (not absolute promises)

Assessment, 1 November 2003

Find the right answer to more than 90 % of relevant questions.

Our own manual assessment (100 randomly selected questions and answers):

 
Of all questions
Of relevant questions
Good answer exists and found
43  %
53 %
Answer found, but not so good
4  %
5 %
Answer exists, but was not found
10  %
14 %
No answer exists, irrelevant question
20  %
No answer exists, but should exist
23  %
28 %
Total
100 %
100 %

 

More than 80 % recall.See table above: 43/53 = 81 %
More than 90 % user satisfaction.

Web page questionnaire (78 answers out of 30000 visitors):

not at all useful
8 %
 
not very useful
3 %
 
somewhat useful
29 %
Total satis-
fied 88 %
useful
24 %
very useful
35 %
More than 90 % user satisfaction.

Controlled user testing (11 users):

How satisfied are you with the answer you got?
 
Worthless
1
 
Not useful
1
 
OK
1
Total satis-
fied 81 %
Good
7
Very good
1
Total11 


Objective (not absolute promises)

Assessment, 1 November 2003

More than 10000 visitors per month to our web site.

The English site was opened in the middle of July, 2003.

 AugustSeptemberOctober
Visitors
17277
42663
40307
Hits
341981
779523
648120
FAQ questions
1625
5630
3585

Objective (not absolute promises)

Assessment, 1 November 2003

Hundreds of carefully classified web pages with answers to specific questions in each supported language. Informational pages sourced and peer reviewed by medical partners.On the 1 November we had 679 fully classified and user-available answers. An additional about 130 answers were written but not yet fully entered into the user-available data base.

Objective (not absolute promises)

Assessment, 1 November 2003

Experts in different countries and using different languages should be able to jointly develop information pages with higher quality than each of them can do alone.
PartnerPsycho- therapistSpecialist areas
ABITYesEating disorders, therapy methods, medical quality
EMERGIS(Yes)Sexual disorders, addictive disorders
FH NONYesADHD, Depression, medical quality
FP
Yes
Eating disorders, obesity, relational problems
Ioannina
(Yes)
Mood disorders (depression, etc.), addictive disorders

Parenthesises in the table above indicate that the organisation has therapeutic experience, but that the main author within the organisation is not a psychotherapist.


Objective (not absolute promises)

Assessment, 1 November 2003

Software system which allows them to develop and discuss each informational page.Fully working since November 2002.

Objective (not absolute promises)

Assessment, 1 November 2003

Improve the health of European citizens.Difficult to measure.

Objective (not absolute promises)

Assessment, 1 November 2003

Helping many visitors to our web site with mental health advice which will enable them to improve their own life.Probable, since we have so many visitors and also have answered hundreds of ask-the-expert questions.

Objective (not absolute promises)

Assessment, 1 November 2003

Produce a high quality mental health website in Greek, English, German, Italian, Swedish.Only English site opened, but the German and Swedish sites are close to opening and we have hundreds of written or translated answers also in Italian and Greek.

Objective (not absolute promises)

Assessment, 1 November 2003

High quality medical information.

Internal peer reviewing is done and almost all such reviews are positive.

We get positive external reviews, like for example:

"The Web can bring us into contact with people who do know what they're talking about. Since last summer, a powerful site from Britain called Web4Health has been providing answers to hundreds of questions about post-traumatic stress syndrome, obesity, child guidance, workplace stress, sleeping problems and more. Funded by the European Union, the project fields questions and publishes answers from a team of psychological and psychiatric experts from a number of European countries."

Difficulties encountered and remedial actions undertaken

Problem: The Dutch partner has only 6 personmonths of effort.

Action: There will be no Dutch-language web site, instead the Dutch partner develops information in English, which almost everyone in the Netherlands can easily read. The Dutch partner has in spite of this already done nearly twice as much as contracted, developing 100 answers on sexual disorders and 100 answers on addiction.

Page
Text in the contract
3
...translation of these pages into German, English, French, Italian and
Swedish.
5
Produce a high-quality
mental health website in Dutch, English, German,
Italian, Swedish.
6KOM2002 will produce psychological advice
sites in all languages represented among the
partners: English, German, Italian, Greek and
Swedish.

Problem: The server was down one weekend in September because of NFS problems.

Action: The server will be disconnected from NFS.

Problem: Difficulty of getting statistics and overviews for our own needs on our web site.

Action: Additional table and statistics tools have been developed.

Problem: Incorrect spelling is a common cause why people do not get the right answer from the natural-language question-answering system.

Action: The system should be modified to accept spelling errors.

Problem: There is no good support for moving text from ask-the-experts to the natural-language question-answering system.

Action: Such support should be added.

Information dissemination

Our project has been presented at a number of conferences, and there are links to our web site from a number of other web sites in the same area.

We have a good position in Yahoo and other web directories.

Use of and implication for standards

We have been using the following standards in our project: HTTP, HTML, Java, SMTP, MIME, RFC822/28222, Form-based file upload, ISO 8859-1, ISO 8859-7, Unicode/ISO 10646.

One of our partners has earlier submitted a proposal for a standard for language translation in e-mail to IETF, but got rather little interest from IETF on this.

Intellectual property rights

Consortium contract regulates this, the most important is the following clause:

"16.3 Parties have free of charge access rights, for the performance of this CEC Contract and for future EU-funded or nationally funded research, to all knowledge of other Parties, which they need to perform their tasks within the CEC Contract."

Note that SYSTRAN is excluded from this clause.

Multimedia Content

Our content mainly uses formatted text with HTML-managed user interface graphics. We also have a few pictures in some of our FAQs, and a few video clips are included in some of our FAQ.

Example of an FAQ with pictures: http://web4health.info/en/answers/phobia-treat-snake.htm

Example of an FAQ with a picture which should maybe be removed:http://web4health.info/en/answers/ed-other-complications.htm

Example of an FAQ with video (in Swedish): http://web4health.info/sv/answers/life-food-sugar

Work package statistics

 
Planned PM
Used PM until 30 Sep 2003
WP 0: Coordination, Administration
24,00
17,99
WP 1: Existing content evaluation
12,30
11,81
WP 2: New content development first stage
23,80
34,52
WP 3: New content development second stage
19,50
12,34
WP 4: Own content and usage stepwise refinement
20,00
7,57
WP 5: Forums, chats, ask-the-expert areas, on-line consultation services
15,00
12,79
WP 6: Exploitation and dissemination
11,50
8,78
WP 7: Evaluation and reporting
11,00
3,61
WP 8: Language translation technology
23,60
30,34