{{stepTitle}}

Welcome to the Cognica Evaluation Experiment

You will be asked to read a small “story” (of 3-5 sentences written in a structured natural language form) and then answer in sequence 2-3 questions based on the story and some additional factual information for each question. Your answer will be in the form of choosing one of Yes, No, Maybe together with an associated level of confidence in your chosen answer.

You will then see the answer given by the COGNICA system together with a verbal explanation on how the system is supporting its answer and you will be asked to reconsider your answer: you can change the level of confidence in your previous answer or change your answer altogether.

IMPORTANT NOTES:
  1. You will not be able to go back to previous pages to change your answers.
  2. You will need to fill in all parts in a page in order to activate the NEXT button and proceed.
  3. Please do not click on the refresh or the back button of your browser because it will terminate your session.

This process will be repeated in the same way with seven “stories” in different commonsense contexts.

Please watch the following short (2:11 min) video to see an example of how the process will take place. In particular, the video will explain how to read the system’s explanations for its answers. The video is animated. It does not have sound commentary.

Read the following story

Story 1:Car wash

  • If it does not rain then I will wash my car.

  • If I am too tired to wash my car then I will take it to the car wash.

  • Only if I am not too tired to wash my car then I will wash my car.

    • Story 1:Car wash

  • If it does not rain then I will wash my car.

  • If I am too tired to wash my car then I will take it to the car wash.

  • Only if I am not too tired to wash my car then I will wash my car.


    • Question:1/20

    The following facts hold:

  • It does not rain
  • I am too tired to wash my car

    • Will I wash my car?

    Choose Answer:

    Level of confidence in your chosen answer:

    Story 1:Car wash

  • If it does not rain then I will wash my car.

  • If I am too tired to wash my car then I will take it to the car wash.

  • Only if I am not too tired to wash my car then I will wash my car.


    • Question:1/20

    The following facts hold:

  • It does not rain
  • I am too tired to wash my car

    • Will I wash my car?

    Cognica Answer:No

    Story 1:Car wash

  • If it does not rain then I will wash my car.

  • If I am too tired to wash my car then I will take it to the car wash.

  • Only if I am not too tired to wash my car then I will wash my car.


    • Question:1/20 (Reconsider your answers)

    The following facts hold:

  • It does not rain
  • I am too tired to wash my car

    • Will I wash my car?

    You can change your chosen answer:

    You can change the level of confidence in your previous answer:

    Story 1:Car wash

  • If it does not rain then I will wash my car.

  • If I am too tired to wash my car then I will take it to the car wash.

  • Only if I am not too tired to wash my car then I will wash my car.


    • Question:2/20

    The following facts hold:

  • It does not rain

    • Will I wash my car?

    Choose Answer:

    Level of confidence in your chosen answer:

    Story 1:Car wash

  • If it does not rain then I will wash my car.

  • If I am too tired to wash my car then I will take it to the car wash.

  • Only if I am not too tired to wash my car then I will wash my car.


    • Question:2/20

    The following facts hold:

  • It does not rain

    • Will I wash my car?

    Cognica Answer:Maybe

    Story 1:Car wash

  • If it does not rain then I will wash my car.

  • If I am too tired to wash my car then I will take it to the car wash.

  • Only if I am not too tired to wash my car then I will wash my car.


    • Question:2/20 (Reconsider your answers)

    The following facts hold:

  • It does not rain

    • Will I wash my car?

    You can change your chosen answer:

    You can change the level of confidence in your previous answer:

    Story 1:Car wash

  • If it does not rain then I will wash my car.

  • If I am too tired to wash my car then I will take it to the car wash.

  • Only if I am not too tired to wash my car then I will wash my car.


    • Question:3/20

    The following facts hold:

  • It does not rain
  • I am not too tired to wash my car

    • Will I take it to the car wash?

    Choose Answer:

    Level of confidence in your chosen answer:

    Story 1:Car wash

  • If it does not rain then I will wash my car.

  • If I am too tired to wash my car then I will take it to the car wash.

  • Only if I am not too tired to wash my car then I will wash my car.


    • Question:3/20

    The following facts hold:

  • It does not rain
  • I am not too tired to wash my car

    • Will I take it to the car wash?

    Cognica Answer:No

    Story 1:Car wash

  • If it does not rain then I will wash my car.

  • If I am too tired to wash my car then I will take it to the car wash.

  • Only if I am not too tired to wash my car then I will wash my car.


    • Question:3/20 (Reconsider your answers)

    The following facts hold:

  • It does not rain
  • I am not too tired to wash my car

    • Will I take it to the car wash?

    You can change your chosen answer:

    You can change the level of confidence in your previous answer:

    Next Story

    Story 2: Buy house

    Read the following story

    Story 2:Buy house

  • If I will get a loan then I will buy a new house.

  • If I will not get a loan then I will rent a house.

  • Only if I can repay the loan then I will get a loan.

    • Story 2:Buy house

  • If I will get a loan then I will buy a new house.

  • If I will not get a loan then I will rent a house.

  • Only if I can repay the loan then I will get a loan.


    • Question:4/20

    The following facts hold:

  • I will get a loan

    • Will I buy a new house?

    Choose Answer:

    Level of confidence in your chosen answer:

    Story 2:Buy house

  • If I will get a loan then I will buy a new house.

  • If I will not get a loan then I will rent a house.

  • Only if I can repay the loan then I will get a loan.


    • Question:4/20

    The following facts hold:

  • I will get a loan

    • Will I buy a new house?

    Cognica Answer:Yes

    Story 2:Buy house

  • If I will get a loan then I will buy a new house.

  • If I will not get a loan then I will rent a house.

  • Only if I can repay the loan then I will get a loan.


    • Question:4/20 (Reconsider your answers)

    The following facts hold:

  • I will get a loan

    • Will I buy a new house?

    You can change your chosen answer:

    You can change the level of confidence in your previous answer:

    Story 2:Buy house

  • If I will get a loan then I will buy a new house.

  • If I will not get a loan then I will rent a house.

  • Only if I can repay the loan then I will get a loan.


    • Question:5/20

    The following facts hold:

  • I can repay the loan

    • Will I buy a new house?

    Choose Answer:

    Level of confidence in your chosen answer:

    Story 2:Buy house

  • If I will get a loan then I will buy a new house.

  • If I will not get a loan then I will rent a house.

  • Only if I can repay the loan then I will get a loan.


    • Question:5/20

    The following facts hold:

  • I can repay the loan

    • Will I buy a new house?

    Cognica Answer:Maybe

    Story 2:Buy house

  • If I will get a loan then I will buy a new house.

  • If I will not get a loan then I will rent a house.

  • Only if I can repay the loan then I will get a loan.


    • Question:5/20 (Reconsider your answers)

    The following facts hold:

  • I can repay the loan

    • Will I buy a new house?

    You can change your chosen answer:

    You can change the level of confidence in your previous answer:

    Next Story

    Story 3: Match tickets

    5 more stories left

    Read the following story

    Story 3:Match tickets

  • If I can find tickets then I will go to the match.

  • Only if the available tickets are not too expensive then I will go to the match.

  • If the match is on a work day then always I will watch the match on TV.

    • Story 3:Match tickets

  • If I can find tickets then I will go to the match.

  • Only if the available tickets are not too expensive then I will go to the match.

  • If the match is on a work day then always I will watch the match on TV.


    • Question:6/20

    The following facts hold:

  • I can find tickets
  • The available tickets are not too expensive

    • Will I go to the match?

    Choose Answer:

    Level of confidence in your chosen answer:

    Story 3:Match tickets

  • If I can find tickets then I will go to the match.

  • Only if the available tickets are not too expensive then I will go to the match.

  • If the match is on a work day then always I will watch the match on TV.


    • Question:6/20

    The following facts hold:

  • I can find tickets
  • The available tickets are not too expensive

    • Will I go to the match?

    Cognica Answer:Maybe

    Story 3:Match tickets

  • If I can find tickets then I will go to the match.

  • Only if the available tickets are not too expensive then I will go to the match.

  • If the match is on a work day then always I will watch the match on TV.


    • Question:6/20 (Reconsider your answers)

    The following facts hold:

  • I can find tickets
  • The available tickets are not too expensive

    • Will I go to the match?

    You can change your chosen answer:

    You can change the level of confidence in your previous answer:

    Story 3:Match tickets

  • If I can find tickets then I will go to the match.

  • Only if the available tickets are not too expensive then I will go to the match.

  • If the match is on a work day then always I will watch the match on TV.


    • Question:7/20

    The following facts hold:

  • I can find tickets
  • The available tickets are not too expensive
  • The match is on work day

    • Will I go to the match?

    Choose Answer:

    Level of confidence in your chosen answer:

    Story 3:Match tickets

  • If I can find tickets then I will go to the match.

  • Only if the available tickets are not too expensive then I will go to the match.

  • If the match is on a work day then always I will watch the match on TV.


    • Question:7/20

    The following facts hold:

  • I can find tickets
  • The available tickets are not too expensive
  • The match is on work day

    • Will I go to the match?

    Cognica Answer:No

    Story 3:Match tickets

  • If I can find tickets then I will go to the match.

  • Only if the available tickets are not too expensive then I will go to the match.

  • If the match is on a work day then always I will watch the match on TV.


    • Question:7/20 (Reconsider your answers)

    The following facts hold:

  • I can find tickets
  • The available tickets are not too expensive
  • The match is on work day

    • Will I go to the match?

    You can change your chosen answer:

    You can change the level of confidence in your previous answer:

    Next Story

    Story 4: Hospitalization

    4 more stories left

    Read the following story

    Story 4:Hospitalization

  • If she has the flu then maybe she will go to the hospital.

  • If she has severe flu complications then she will go to the hospital.

  • If she is vaccinated then possibly she has not severe flu complications.

  • If she has difficulty breathing then she has severe flu complications.

    • Story 4:Hospitalization

  • If she has the flu then maybe she will go to the hospital.

  • If she has severe flu complications then she will go to the hospital.

  • If she is vaccinated then possibly she has not severe flu complications.

  • If she has difficulty breathing then she has severe flu complications.


    • Question:8/20

    The following facts hold:

  • She has the flu
  • She is vaccinated
  • She has difficulty breathing

    • Will she go to the hospital?

    Choose Answer:

    Level of confidence in your chosen answer:

    Story 4:Hospitalization

  • If she has the flu then maybe she will go to the hospital.

  • If she has severe flu complications then she will go to the hospital.

  • If she is vaccinated then possibly she has not severe flu complications.

  • If she has difficulty breathing then she has severe flu complications.


    • Question:8/20

    The following facts hold:

  • She has the flu
  • She is vaccinated
  • She has difficulty breathing

    • Will she go to the hospital?

    Cognica Answer:Yes

    Story 4:Hospitalization

  • If she has the flu then maybe she will go to the hospital.

  • If she has severe flu complications then she will go to the hospital.

  • If she is vaccinated then possibly she has not severe flu complications.

  • If she has difficulty breathing then she has severe flu complications.


    • Question:8/20 (Reconsider your answers)

    The following facts hold:

  • She has the flu
  • She is vaccinated
  • She has difficulty breathing

    • Will she go to the hospital?

    You can change your chosen answer:

    You can change the level of confidence in your previous answer:

    Story 4:Hospitalization

  • If she has the flu then maybe she will go to the hospital.

  • If she has severe flu complications then she will go to the hospital.

  • If she is vaccinated then possibly she has not severe flu complications.

  • If she has difficulty breathing then she has severe flu complications.


    • Question:9/20

    The following facts hold:

  • She has the flu
  • She is vaccinated

    • Will she go to the hospital?

    Choose Answer:

    Level of confidence in your chosen answer:

    Story 4:Hospitalization

  • If she has the flu then maybe she will go to the hospital.

  • If she has severe flu complications then she will go to the hospital.

  • If she is vaccinated then possibly she has not severe flu complications.

  • If she has difficulty breathing then she has severe flu complications.


    • Question:9/20

    The following facts hold:

  • She has the flu
  • She is vaccinated

    • Will she go to the hospital?

    Cognica Answer:Maybe

    Story 4:Hospitalization

  • If she has the flu then maybe she will go to the hospital.

  • If she has severe flu complications then she will go to the hospital.

  • If she is vaccinated then possibly she has not severe flu complications.

  • If she has difficulty breathing then she has severe flu complications.


    • Question:9/20 (Reconsider your answers)

    The following facts hold:

  • She has the flu
  • She is vaccinated

    • Will she go to the hospital?

    You can change your chosen answer:

    You can change the level of confidence in your previous answer:

    Next Story

    Story 5: Cook-Delivery

    3 more stories left

    Read the following story

    Story 5:Cook-Delivery

  • If I am hungry then I will cook.

  • If I am too tired to cook then I will order delivery.

  • Only if I am not too tired to cook then I will cook.

    • Story 5:Cook-Delivery

  • If I am hungry then I will cook.

  • If I am too tired to cook then I will order delivery.

  • Only if I am not too tired to cook then I will cook.


    • Question:10/20

    The following facts hold:

  • I am hungry
  • I am too tired to cook

    • Will I cook?

    Choose Answer:

    Level of confidence in your chosen answer:

    Story 5:Cook-Delivery

  • If I am hungry then I will cook.

  • If I am too tired to cook then I will order delivery.

  • Only if I am not too tired to cook then I will cook.


    • Question:10/20

    The following facts hold:

  • I am hungry
  • I am too tired to cook

    • Will I cook?

    Cognica Answer:No

    Story 5:Cook-Delivery

  • If I am hungry then I will cook.

  • If I am too tired to cook then I will order delivery.

  • Only if I am not too tired to cook then I will cook.


    • Question:10/20 (Reconsider your answers)

    The following facts hold:

  • I am hungry
  • I am too tired to cook

    • Will I cook?

    You can change your chosen answer:

    You can change the level of confidence in your previous answer:

    Story 5:Cook-Delivery

  • If I am hungry then I will cook.

  • If I am too tired to cook then I will order delivery.

  • Only if I am not too tired to cook then I will cook.


    • Question:11/20

    The following facts hold:

  • I am hungry

    • Will I cook?

    Choose Answer:

    Level of confidence in your chosen answer:

    Story 5:Cook-Delivery

  • If I am hungry then I will cook.

  • If I am too tired to cook then I will order delivery.

  • Only if I am not too tired to cook then I will cook.


    • Question:11/20

    The following facts hold:

  • I am hungry

    • Will I cook?

    Cognica Answer:Maybe

    Story 5:Cook-Delivery

  • If I am hungry then I will cook.

  • If I am too tired to cook then I will order delivery.

  • Only if I am not too tired to cook then I will cook.


    • Question:11/20 (Reconsider your answers)

    The following facts hold:

  • I am hungry

    • Will I cook?

    You can change your chosen answer:

    You can change the level of confidence in your previous answer:

    Story 5:Cook-Delivery

  • If I am hungry then I will cook.

  • If I am too tired to cook then I will order delivery.

  • Only if I am not too tired to cook then I will cook.


    • Question:12/20

    The following facts hold:

  • I am hungry
  • I am not too tired to cook

    • Will I order delivery?

    Choose Answer:

    Level of confidence in your chosen answer:

    Story 5:Cook-Delivery

  • If I am hungry then I will cook.

  • If I am too tired to cook then I will order delivery.

  • Only if I am not too tired to cook then I will cook.


    • Question:12/20

    The following facts hold:

  • I am hungry
  • I am not too tired to cook

    • Will I order delivery?

    Cognica Answer:No

    Story 5:Cook-Delivery

  • If I am hungry then I will cook.

  • If I am too tired to cook then I will order delivery.

  • Only if I am not too tired to cook then I will cook.


    • Question:12/20 (Reconsider your answers)

    The following facts hold:

  • I am hungry
  • I am not too tired to cook

    • Will I order delivery?

    You can change your chosen answer:

    You can change the level of confidence in your previous answer:

    Next Story

    Story 6: Phone Ringing

    2 more stories left

    Read the following story

    Story 6:Phone Ringing

  • If my son is ringing then always I will answer the call.

  • Only if I am not busy then I will answer the call.

    • Story 6:Phone Ringing

  • If my son is ringing then always I will answer the call.

  • Only if I am not busy then I will answer the call.


    • Question:13/20

    The following facts hold:

  • My son is ringing
  • I am busy

    • Will I answer the call?

    Choose Answer:

    Level of confidence in your chosen answer:

    Story 6:Phone Ringing

  • If my son is ringing then always I will answer the call.

  • Only if I am not busy then I will answer the call.


    • Question:13/20

    The following facts hold:

  • My son is ringing
  • I am busy

    • Will I answer the call?

    Cognica Answer:Maybe

    Story 6:Phone Ringing

  • If my son is ringing then always I will answer the call.

  • Only if I am not busy then I will answer the call.


    • Question:13/20 (Reconsider your answers)

    The following facts hold:

  • My son is ringing
  • I am busy

    • Will I answer the call?

    You can change your chosen answer:

    You can change the level of confidence in your previous answer:

    Story 6:Phone Ringing

  • If my son is ringing then always I will answer the call.

  • Only if I am not busy then I will answer the call.


    • Question:14/20

    The following facts hold:

  • I am busy

    • Will I answer the call?

    Choose Answer:

    Level of confidence in your chosen answer:

    Story 6:Phone Ringing

  • If my son is ringing then always I will answer the call.

  • Only if I am not busy then I will answer the call.


    • Question:14/20

    The following facts hold:

  • I am busy

    • Will I answer the call?

    Cognica Answer:Maybe

    Story 6:Phone Ringing

  • If my son is ringing then always I will answer the call.

  • Only if I am not busy then I will answer the call.


    • Question:14/20 (Reconsider your answers)

    The following facts hold:

  • I am busy

    • Will I answer the call?

    You can change your chosen answer:

    You can change the level of confidence in your previous answer:

    Next Story

    Story 7: Going out

    1 more story left after this one

    Read the following story

    Story 7:Going out

  • If I am tired then I will not go out for a drink with my friends.

  • If it is Saturday then possibly I will go out for a drink with my friends.

  • If it is a holiday then always I will go out for a drink with my friends.

    • Story 7:Going out

  • If I am tired then I will not go out for a drink with my friends.

  • If it is Saturday then possibly I will go out for a drink with my friends.

  • If it is a holiday then always I will go out for a drink with my friends.


    • Question:15/20

    The following facts hold:

  • I am tired
  • It is Saturday

    • Will I go out for a drink with my friends?

    Choose Answer:

    Level of confidence in your chosen answer:

    Story 7:Going out

  • If I am tired then I will not go out for a drink with my friends.

  • If it is Saturday then possibly I will go out for a drink with my friends.

  • If it is a holiday then always I will go out for a drink with my friends.


    • Question:15/20

    The following facts hold:

  • I am tired
  • It is Saturday

    • Will I go out for a drink with my friends?

    Cognica Answer:Maybe

    Story 7:Going out

  • If I am tired then I will not go out for a drink with my friends.

  • If it is Saturday then possibly I will go out for a drink with my friends.

  • If it is a holiday then always I will go out for a drink with my friends.


    • Question:15/20 (Reconsider your answers)

    The following facts hold:

  • I am tired
  • It is Saturday

    • Will I go out for a drink with my friends?

    You can change your chosen answer:

    You can change the level of confidence in your previous answer:

    Story 7:Going out

  • If I am tired then I will not go out for a drink with my friends.

  • If it is Saturday then possibly I will go out for a drink with my friends.

  • If it is a holiday then always I will go out for a drink with my friends.


    • Question:16/20

    The following facts hold:

  • I am tired
  • It is a holiday

    • Will I go out for a drink with my friends?

    Choose Answer:

    Level of confidence in your chosen answer:

    Story 7:Going out

  • If I am tired then I will not go out for a drink with my friends.

  • If it is Saturday then possibly I will go out for a drink with my friends.

  • If it is a holiday then always I will go out for a drink with my friends.


    • Question:16/20

    The following facts hold:

  • I am tired
  • It is a holiday

    • Will I go out for a drink with my friends?

    Cognica Answer:Yes

    Story 7:Going out

  • If I am tired then I will not go out for a drink with my friends.

  • If it is Saturday then possibly I will go out for a drink with my friends.

  • If it is a holiday then always I will go out for a drink with my friends.


    • Question:16/20 (Reconsider your answers)

    The following facts hold:

  • I am tired
  • It is a holiday

    • Will I go out for a drink with my friends?

    You can change your chosen answer:

    You can change the level of confidence in your previous answer:

    Story 7:Going out

  • If I am tired then I will not go out for a drink with my friends.

  • If it is Saturday then possibly I will go out for a drink with my friends.

  • If it is a holiday then always I will go out for a drink with my friends.


    • Question:17/20

    The following facts hold:

  • It is Saturday

    • Will I go out for a drink with my friends?

    Choose Answer:

    Level of confidence in your chosen answer:

    Story 7:Going out

  • If I am tired then I will not go out for a drink with my friends.

  • If it is Saturday then possibly I will go out for a drink with my friends.

  • If it is a holiday then always I will go out for a drink with my friends.


    • Question:17/20

    The following facts hold:

  • It is Saturday

    • Will I go out for a drink with my friends?

    Cognica Answer:Maybe

    Story 7:Going out

  • If I am tired then I will not go out for a drink with my friends.

  • If it is Saturday then possibly I will go out for a drink with my friends.

  • If it is a holiday then always I will go out for a drink with my friends.


    • Question:17/20 (Reconsider your answers)

    The following facts hold:

  • It is Saturday

    • Will I go out for a drink with my friends?

    You can change your chosen answer:

    You can change the level of confidence in your previous answer:

    Next Story

    Story 8: At the sea

    Last story

    Read the following story

    Story 8:At the sea

  • If the sea is hot then possibly I will swim.

  • If the sea is crowded then maybe I will not swim.

  • If the sea is rough then always I will not swim.

    • Story 8:At the sea

  • If the sea is hot then possibly I will swim.

  • If the sea is crowded then maybe I will not swim.

  • If the sea is rough then always I will not swim.


    • Question:18/20

    The following facts hold:

  • The sea is hot
  • The sea is not crowded
  • The sea is rough

    • Will I swim?

    Choose Answer:

    Level of confidence in your chosen answer:

    Story 8:At the sea

  • If the sea is hot then possibly I will swim.

  • If the sea is crowded then maybe I will not swim.

  • If the sea is rough then always I will not swim.


    • Question:18/20

    The following facts hold:

  • The sea is hot
  • The sea is not crowded
  • The sea is rough

    • Will I swim?

    Cognica Answer:No

    Story 8:At the sea

  • If the sea is hot then possibly I will swim.

  • If the sea is crowded then maybe I will not swim.

  • If the sea is rough then always I will not swim.


    • Question:18/20 (Reconsider your answers)

    The following facts hold:

  • The sea is hot
  • The sea is not crowded
  • The sea is rough

    • Will I swim?

    You can change your chosen answer:

    You can change the level of confidence in your previous answer:

    Story 8:At the sea

  • If the sea is hot then possibly I will swim.

  • If the sea is crowded then maybe I will not swim.

  • If the sea is rough then always I will not swim.


    • Question:19/20

    The following facts hold:

  • The sea is not rough

    • Will I swim?

    Choose Answer:

    Level of confidence in your chosen answer:

    Story 8:At the sea

  • If the sea is hot then possibly I will swim.

  • If the sea is crowded then maybe I will not swim.

  • If the sea is rough then always I will not swim.


    • Question:19/20

    The following facts hold:

  • The sea is not rough

    • Will I swim?

    Cognica Answer:Maybe

    Story 8:At the sea

  • If the sea is hot then possibly I will swim.

  • If the sea is crowded then maybe I will not swim.

  • If the sea is rough then always I will not swim.


    • Question:19/20 (Reconsider your answers)

    The following facts hold:

  • The sea is not rough

    • Will I swim?

    You can change your chosen answer:

    You can change the level of confidence in your previous answer:

    Story 8:At the sea

  • If the sea is hot then possibly I will swim.

  • If the sea is crowded then maybe I will not swim.

  • If the sea is rough then always I will not swim.


    • Question:20/20

    The following facts hold:

  • The sea is hot
  • The sea is crowded

    • Will I swim?

    Choose Answer:

    Level of confidence in your chosen answer:

    Story 8:At the sea

  • If the sea is hot then possibly I will swim.

  • If the sea is crowded then maybe I will not swim.

  • If the sea is rough then always I will not swim.


    • Question:20/20

    The following facts hold:

  • The sea is hot
  • The sea is crowded

    • Will I swim?

    Cognica Answer:Maybe

    Story 8:At the sea

  • If the sea is hot then possibly I will swim.

  • If the sea is crowded then maybe I will not swim.

  • If the sea is rough then always I will not swim.


    • Question:20/20 (Reconsider your answers)

    The following facts hold:

  • The sea is hot
  • The sea is crowded

    • Will I swim?

    You can change your chosen answer:

    You can change the level of confidence in your previous answer:

    Thank you for participating in the questionnaire.