“Missing Requirements”
14 hours ago
Wednesday, May 6, 2009
End of Round One
Why this question?
The meaning behind the question was to make you think about the purpose of testing and the way testers handle their problems.
For the Biologist the most typical issue is reproduction - therefore he described the situation from that point of view.
The Mathematicians take things abstractly - so their explanation would be that there is "-1" people in the house.
Or as the Physicists have to prove everything with experiments and measurements - they would explain this as a measurement error.
So I wanted to urge people to think what are the main concerns and tasks of testers?
In my opinion those are:
· Questioning the specifications (is the house really empty?)
· Investigating the situation (Repeating the experiment, does it happen all the time?)
· Analyze the results (Was the house empty? Or what was happening?)
· Report the findings as clearly as possible
Before the discussion the answer nr. 10 was voted the best.
The following are all the answers I received :
(Spelling not corrected.)
Tester 1:
Tester explanation 1:
According to specification XXX, ver.V, from date dd-mm-yyyy, page p, chapter c: ‘While one person goes in the House, then after 30 min comes two persons out.’
So it’s specification and correct behavior.
Tester explanation 2:
Wrong start condition - the House wasn’t empty
How to verify:
TEST SEQUENCE:
1. Reset start condition (clear EEPROM, reset to default)
2. Send one person in the house
EXPECTED RESULTS:
Bit later only one person leaves the House.
Tester explanation 3:
Wrong input - There was actually send two persons in the House not one
How to verify:
Use special tool to be sure that only one person goes in (for example BeoCIM stimulus).
Tester explanation 4:
Wrong output - One person leaves the House, but counted twice
How to verify:
Use log tool to count peoples who comes out of the House
Questions:
Are the persons allowed to enter the House (are they in value range)
Who come out while in the House goes one dog?
o Two dogs or
o One dog and one person
How many persons come out, while in the House goes two persons?
What happened while none person goes in the House and just wait?
Tester 2:
It is probably a synchronization error; The sampling rate of the system (house) was twice as fast as the signal (person). If the person would have entered the building more quickly, there would have been only one person coming out of the house.
Tester 3:
There is only facade with a signboard "EMPTY HOUSE" and behind it a lot of people, as usual.
Tester 4:
There is an error in this situation, report as high classification error
Tester 5:
Alright!!! I am going to report it, this is an A-category bug!
Tester 6:
Situation description is incomplete or we have fault in laws of nature.
Possible verifications:
Where one person went?
From where two persons came from?
Why is there an empty house?
Tester 7:
ERROR!
Illegal person left the building. Buggy house found!
Tester 8:
The situation observer clearly missed one person who sneaked in from a hidden entrance.
Check if there's a tunnel leading to the house for example. If there exists one, then we try to recreate the situation: One person goes in, another one sneaks in from the hidden entrance. When observers don't see the 2nd person going in then they will believe that 1 person became 2 persons inside the house, which is clearly false.
Tester 9:
It's a bug! Not expected output for given input.
Tester 10:
All different inputs/outputs are not considered correctly (or included). There may be another door, window or hole what is missed and where people can enter/exit the building. It would be necessary to inspect the house thoroughly and repeat the experiment.
( If there is only one door and it is possible to send more people in, it would be clever to send two persons in and see if three/four/some other no. of persons come out. After that it would be advised to repeat experiment and send three and after that four persons in and observe how many people are leaving the building later. With this information it is possible to clarify if there are a mathematical formula of people "fissioning". )
Tester 11:
There was a hidden person in the house while it was searched and declared empty. A need for a proper search by tester to make sure it is empty and repeat the situation.
Tester 12:
1. It is black box testing case - input is one and output is two
2. It is white box testing case - man was asking her girl out
3. It is grey box testing case - bo-soft tester win box of beer and asking other to carry it his home
Tester 13:
It all started in 2004 when a child was born. His parents were famous software issues that were responsible for many famous disasters like Mariner 1, Ariane 5 (plus several other NASA issues that cost the US government a lot of money), Therac 25 and even the desynchronization of the valvetronic motors of BMW 745i. Anywhoo, his parents named him simply BUG. Young BUG always knew that he had to live up to his name, with his parents being authorities in their line of work. But BUG was a smart little fellow and he knew exactly what to do. There was a house being built in a really expensive neighbourhood. Since the beginning of the construction he had been hiding inside the house, waiting for the right moment to jump out. John, the lead designer and the current owner of the house was very proud of his work and he was sure that he would get tons of money for the house. When the buyers arrived John stepped in to make final adjustments. When he was exiting the house, with clients already waiting outside, BUG knew it was now or never. He climbed out of his hideout, walked quietly behind John and just as they exited the house he screamed "SURPRISE!". Ofcourse the customers left, and when the rumors spread then noone wanted to buy the house anymore. After some time, the house crumbled, John had no money left and had to live inside a box for the rest of his life. But BUG had made his parents proud.
The meaning behind the question was to make you think about the purpose of testing and the way testers handle their problems.
For the Biologist the most typical issue is reproduction - therefore he described the situation from that point of view.
The Mathematicians take things abstractly - so their explanation would be that there is "-1" people in the house.
Or as the Physicists have to prove everything with experiments and measurements - they would explain this as a measurement error.
So I wanted to urge people to think what are the main concerns and tasks of testers?
In my opinion those are:
· Questioning the specifications (is the house really empty?)
· Investigating the situation (Repeating the experiment, does it happen all the time?)
· Analyze the results (Was the house empty? Or what was happening?)
· Report the findings as clearly as possible
Before the discussion the answer nr. 10 was voted the best.
The following are all the answers I received :
(Spelling not corrected.)
Tester 1:
Tester explanation 1:
According to specification XXX, ver.V, from date dd-mm-yyyy, page p, chapter c: ‘While one person goes in the House, then after 30 min comes two persons out.’
So it’s specification and correct behavior.
Tester explanation 2:
Wrong start condition - the House wasn’t empty
How to verify:
TEST SEQUENCE:
1. Reset start condition (clear EEPROM, reset to default)
2. Send one person in the house
EXPECTED RESULTS:
Bit later only one person leaves the House.
Tester explanation 3:
Wrong input - There was actually send two persons in the House not one
How to verify:
Use special tool to be sure that only one person goes in (for example BeoCIM stimulus).
Tester explanation 4:
Wrong output - One person leaves the House, but counted twice
How to verify:
Use log tool to count peoples who comes out of the House
Questions:
Are the persons allowed to enter the House (are they in value range)
Who come out while in the House goes one dog?
o Two dogs or
o One dog and one person
How many persons come out, while in the House goes two persons?
What happened while none person goes in the House and just wait?
Tester 2:
It is probably a synchronization error; The sampling rate of the system (house) was twice as fast as the signal (person). If the person would have entered the building more quickly, there would have been only one person coming out of the house.
Tester 3:
There is only facade with a signboard "EMPTY HOUSE" and behind it a lot of people, as usual.
Tester 4:
There is an error in this situation, report as high classification error
Tester 5:
Alright!!! I am going to report it, this is an A-category bug!
Tester 6:
Situation description is incomplete or we have fault in laws of nature.
Possible verifications:
Where one person went?
From where two persons came from?
Why is there an empty house?
Tester 7:
ERROR!
Illegal person left the building. Buggy house found!
Tester 8:
The situation observer clearly missed one person who sneaked in from a hidden entrance.
Check if there's a tunnel leading to the house for example. If there exists one, then we try to recreate the situation: One person goes in, another one sneaks in from the hidden entrance. When observers don't see the 2nd person going in then they will believe that 1 person became 2 persons inside the house, which is clearly false.
Tester 9:
It's a bug! Not expected output for given input.
Tester 10:
All different inputs/outputs are not considered correctly (or included). There may be another door, window or hole what is missed and where people can enter/exit the building. It would be necessary to inspect the house thoroughly and repeat the experiment.
( If there is only one door and it is possible to send more people in, it would be clever to send two persons in and see if three/four/some other no. of persons come out. After that it would be advised to repeat experiment and send three and after that four persons in and observe how many people are leaving the building later. With this information it is possible to clarify if there are a mathematical formula of people "fissioning". )
Tester 11:
There was a hidden person in the house while it was searched and declared empty. A need for a proper search by tester to make sure it is empty and repeat the situation.
Tester 12:
1. It is black box testing case - input is one and output is two
2. It is white box testing case - man was asking her girl out
3. It is grey box testing case - bo-soft tester win box of beer and asking other to carry it his home
Tester 13:
It all started in 2004 when a child was born. His parents were famous software issues that were responsible for many famous disasters like Mariner 1, Ariane 5 (plus several other NASA issues that cost the US government a lot of money), Therac 25 and even the desynchronization of the valvetronic motors of BMW 745i. Anywhoo, his parents named him simply BUG. Young BUG always knew that he had to live up to his name, with his parents being authorities in their line of work. But BUG was a smart little fellow and he knew exactly what to do. There was a house being built in a really expensive neighbourhood. Since the beginning of the construction he had been hiding inside the house, waiting for the right moment to jump out. John, the lead designer and the current owner of the house was very proud of his work and he was sure that he would get tons of money for the house. When the buyers arrived John stepped in to make final adjustments. When he was exiting the house, with clients already waiting outside, BUG knew it was now or never. He climbed out of his hideout, walked quietly behind John and just as they exited the house he screamed "SURPRISE!". Ofcourse the customers left, and when the rumors spread then noone wanted to buy the house anymore. After some time, the house crumbled, John had no money left and had to live inside a box for the rest of his life. But BUG had made his parents proud.
Subscribe to:
Posts (Atom)
