CS 49000-020 Software Testing

Fall 2009 (Adaptive) Schedule

In the event of a major campus emergency, course requirements, deadlines and grading percentages are subject to changes that may be necessitated by a revised semester calendar or other circumstances. Any changes in this course will be announced at this site.”

Lecture MW 11:30-12:20 LWSN B134
Group meetings/Presentations F 11:30-12:20 Stewart Center 209
Office Hours

MW 10:30-11:15
(Walk-ins welcome, any day/time LWSN 3144F, email alert preferred
)

LWSN 1177
Video Conference F 11:30-12:20pm

Stew 209 
765-494-2108

TA

There is no TA for this class.


Invited Talks

Bob Jackson
Director - Technology, Fox River Execution, Geneva, IL
Wednesday November 11, 2009, 11:30am
Computer Science Challenges in the Financial Industry
LWSN B134

 

Midterm: Wed 10/07 8:00- 09:30pm LWSN B134. Open Book/Notes.
Final Exam: Thursday December 17, 2009. Open Book

Textbook and powerpoint presentations: Foundations of Software Testing
A sample of software test tools


Fridays will be used for team presentations. During a presentation, a team will summarize (a) progress made towards completion of the term project or (b) demonstrate software testing tools they were assigned to investigate, and (c) ask sponsors for any clarifications.

Week Date Topic Reference Comments
1 M 8/24
  • Course introduction
  • Organizational issues
  • Team formation

Please browse the course web site.
Sponsored project description

(a) Suggested readings:
Ariane 5: Flight 501 Failure

An Investigation of the Therac-25 Accidents," IEEE Computer Applications in Power, July 1993, pp. 18-41.

(b) Peter Shier, Microsoft to describe the Microsoft sponsored project. Network Connected Devices, LWSN B134

(c) Cyberonics to describe their sponsored project.

(d) Pizza get-together with Peter Shier at 6pm HotBoxPizza, Chauncy Mall.

W 8/26 Project discussion Talk by Peter Shier
F 8/28 Project Presentation: Cyberonics  
2 M 8/31

Software testing: Fundamentals-I

Chapter 1.1-1.6  
W 9/2

Software testing: Fundamentals-II

Chapter 1.7-1.15, 1.18, 1.19
F 9/4

Video Conference

Practice. See sample presentation and presentation guidelines  
3 M 9/7

Labor day. Class does not meet.

Try exercises: 1.1, 1.4, 1.10, 1.11
W 9/9

Software testing: Fundamentals-III

Chapter 1.14, 1.6
F 9/11 Video Conference 15 minutes/team: 10 minutes presentattion+5 minutes Q/A. Prepare your slides well. Practice your presentation. At most two members of the team make presentation.
4 M 9/14

Test generation from requirements I

Chapter 2.2, 2.3 JUnit Tool Exercises
Try exercises (preparing for midterm): 2.3, 2.7, 2.8, 2.10
W 9/16

Measuring and Improving Reliability in Microsoft Windows

Talk by Valera Zakharov
F 9/18

Video Conference

 

 
5 M 9/21

Test generation from requirements II

Chapter 2.7 Try exercises (preparing for midterm): 2.27, 2.28, 2.29, 2.30.
If you are theoretically inclined then try: 2.35, 2.37.
W 9/23 Test generation from requirements III Chapter 2.7 (continued)
F 9/25

Video Conference

 

   
6 M 9/28

JUnit quiz
Test generation from requirements IV

 

 

InClassExercisePreFSM (Three Buttons) 9/30
FSM for the Three-Buttons exercise (pdf)
Java Applet for the Three-Button exercise
Erroneous version 1 of Java Applet for the Three-Button exercise
Erroneous version 2 of Java Applet for the Three-Button exercise

W 9/30

Test generation from finite state models I: Strings and FSM basics: FSM Fault model, In-class exercise to illustrate relation between FSM, corresponding program, and fault model.

Interim Report 1 due (Click here for format)
JUnit quiz. 9/28 (click here for solutions, pdf file)
F 10/2

Video Conference

 

 
7 M 10/5 Test generation from finite state models II:  

Readings from the textbook for the midterm: 1.1, 1.2, 1.3, 1.4, 1.5, 1.6, 1.14, 1.15, 1.18. 2.1, 2.2, 2.3, 2.4, 2.7, (only BOR and BRO). 3.1, 3.2.
You are allowed to consult the textbook during the exam.

Please: NO excuse for postponing the mideterm!!

W 10/7

Midterm review

Midterm: Wed 10/07 08:00p - 09:30p LWSN B151.

F 10/9 Video Conference  
8 M 10/12 October break. No meeting.

Bug Tracking Tool Exercises
FogBugz

W 10/14 Midterm solutions
Test generation from finite state models III: k-equivalence tables
Midetrm Solutions (pdf)
F 10/16

Video Conference

 

9 M 10/19 Test generation from finite state models IV: Applications to OO testing. Readings: 3.1, 3.2, 3.3, 3., 3.5, 3.6, 3.9
W 10/21 Test generation from finite state models V: Applications to GUI testing. Control theoretic versus automata theoretic, Wp method
F 10/23 Video Conference

 

20 minutes/team: 15 minutes presentation+5 minutes Q/A. Prepare your slides well. Practice your presentation. At most two members of the team make presentation.

Readings for Combinatoirial designs: 4.1, 4.2, 4.3

 

10 M 10/26 FogBugz Quiz
Test generation: Combinatorial designs I
 
W 10/28
Test generation: Combinatorial designs II
 
F 10/30 Interim Report 2 due
11 M 11/2
Test generation: Combinatorial designs III

FogBugz Quiz (Click here for solutions to Quiz 2, pdf file. Also see FogBugz tutorial for correct answers.)

Readings for combinatorial designs: 4.4, 4.5, 4.6, 4.7, 4.8, 4.8, 4.10
Presentation by Rick Kuhn from NIST on Combinatorial Testing
Tutorial on combinatorial testing by Rick Kuhn from NIST

W 11/4
Test adequacy: Control flow based I
F 11/6 Video Conference

 

Revised Interim Report 2 due  
12 M 11/9 Test adequacy: Control flow based II   Performance and Load Testing Exercise

JMeter (performance and load testing)

W 11/11

Talk by Bob Jackson: Computer Science Challenges in the Financial Industry

 
F 11/13

Video Conference

 

13 M 11/16

Test adequacy: Control flow based III

AETG Quiz
(Click here for solutions to Quiz 3, pdf file. Also see FogBugz tutorial for correct answers.)

Project report outline due.[Click here for a sample in doc format.]

MC/DC case study by Dupuy and Leveson

Readings: 6.1, 6.2.1--6.2.13 (exclude 6.2.7)

 

W 11/18 Test adequacy: Control flow based IV: MC/DC  
F 11/20

Video Conference

 

 
14 M 11/23 Test adequacy: Data flow based-I  

Project report draft V1.0 due.

Readings: 6.3 (exclude 6.3.7, 6.3.8, 6.3.9), 6.4.1--6.4.3, 6.4.6, 6.6

 

W 11/25 Thanksgiving break. No meeting.
F 11/27

Thanksgiving break. No meeting. No video conference.

 

15 M 11/30

Test automation
Saturation effect [Section 1.19 of textbook]

Suggested reading for software test automation: "Software Test Automation" by Mark Fewster and Dorothy Graham, Addison-Wesley, 1999.

Action Words tutorial

JMeter Quiz
Select one of the following tools:
Proteum (Mutation tool for C): Details to come!
Pex (Microsoft) for test generation
GUITAR (GUI Testing from U of Maryland)

W 12/2

Course Review

JMeter Quiz (cancelled)
F 12/4

Video Conference

Final Report draft due  
16 M 12/7

No meeting. (Work on finalizing the project and report.)

Final Presentations:

Presentation: 30 minutes/team including Q/A. Practice your presentation. At most two members of the team make the presentation. Demos (if neeeded) will be a part of this presentation.

W 12/9

No meeting. (Work on finalizing the project and report.)

F 12/11 Video Conference Final Report due prior to the start of the presentations
17 Th 12/17 Final Exam 3:20--5:20pm LWSN B134 Final Exam Quiz Solutions (pdf)

Comprehensive exam (Open textbook)
Readings (from the textbook):
Chapter 1: All excluding 1.15, 1.16, 1.17
Chapter 2: All excluding 2.5, 2.6, 2.7.5.3, 2.7.5.4, 2.7.6,
Chapter 3: 3.1, 3.2, 3.3, 3.4, 3.5, 3.6, 3.9
Chapter 4: All
Chapter 6: 6.1, 6.2 (excluding 6.2.7), 6.3 (excluding 6.6.3.7, 6.3.8, 6.3.9), 6.4.1, 6.4.2, 6.4.3
Action Words: Tutorial

This page last revised: December 2, 2009