測試準則

測試準則，是軟件測試員或軟件工程師用來檢測測試是否通過的一種機制。^[1]測試準則決定在給定的測試用例輸入下產品應有的輸出，從而與被測試系統的輸出做比較。這一術語在威廉·豪登（William Howden）的《測試理論入門》一書中首次被使用和定義。^[2]艾琳·韋約克（英語：Elaine Weyuker）又對不同類型的測試準則給予了拓展。^[3]測試準則經常獨立於被測試系統。^[4] 在自動化測試中後置條件方法是通常被使用的自動化了的測試準則。^[5]測試準則問題往往比看起來要難得多，同時會連帶要求解決可控性和可觀測性問題。^[6]

常見的測試準則包括：

設計規格和軟件文檔^[7]^[8]
其它產品（例如：作為一個軟件程序的測試準則，有可能是使用不同算法計算同一個數學表達式的其它程序）
為一組少量測試輸入提供近似或準確結果的"啟發式準則"^[9]
使用統計學特徵的"統計式準則"^[10]
由相似性比較一個測試執行結果而產生的"一致性準則"^[11]
由使用相同模型而產生和確認系統行為的"基於模型的準則"^[12]
人工準則（例如：由手工分析來確定被測試系統的正確性）^[6]

參考資料

^ Kaner, Cem; A Course in Black Box Software Testing （頁面存檔備份，存於網際網路檔案館）, 2004
^ Miller, Edward; and Howden, William E.; Software Testing and Validation Techniques, Long Beach, CA: IEEE Computer Society Press, 1978 (first edition), pp. 16-19
^ Weyuker, Elaine J.; "The Oracle Assumption of Program Testing", in Proceedings of the 13th International Conference on System Sciences (ICSS), Honolulu, HI, January 1980, pp. 44-49
^ Jalote, Pankaj; An Integrated Approach to Software Engineering, Springer/Birkhäuser, 2005, ISBN 0-387-20881-X
^ Meyer, Bertrand; et al.; "Programs that Test Themselves", IEEE Computer, 42:9 (September 2009), pp. 46-55
^ ^6.0 ^6.1 Ammann, Paul; and Offutt, Jeff; "Introduction to Software Testing", Cambridge University Press, 2008, ISBN 978-0-521-88038-1
^ Peters, Dennis K. Generating a Test Oracle from Program Documentation (M. Eng.論文). McMaster University. 1995. CiteSeerX: 10.1.1.69.4331 .
^ Peters, Dennis K.; Parnas, David L. Generating a Test Oracle from Program Documentation (PDF). Proceedings of the 1994 International Symposium on Software Testing and Analysis. ISSTA. ACM Press: 58–65. [2014-07-30]. （原始內容 (PDF)存檔於2015-09-24）.
^ Hoffman, Douglas; Heuristic Test Oracles （頁面存檔備份，存於網際網路檔案館）, Software Testing & Quality Engineering Magazine, 1999
^ Mayer, Johannes; and Guderlei, Ralph; Test Oracles Using Statistical Methods （頁面存檔備份，存於網際網路檔案館）
^ Hoffman, Douglas; Analysis of a Taxonomy for Test Oracles （頁面存檔備份，存於網際網路檔案館）, Quality Week, 1998
^ Robinson, Harry; Finite State Model-Based Testing on a Shoestring （頁面存檔備份，存於網際網路檔案館）, STAR West 1999

參見

Binder, Robert V. (1999). "Chapter 18 - Oracles" in Testing Object-Oriented Systems: Models, Patterns, and Tools, Addison-Wesley Professional, 7 November 1999, ISBN 978-0-201-80938-1

[1] Kaner, Cem; A Course in Black Box Software Testing （頁面存檔備份，存於網際網路檔案館）, 2004

[2] Miller, Edward; and Howden, William E.; Software Testing and Validation Techniques, Long Beach, CA: IEEE Computer Society Press, 1978 (first edition), pp. 16-19

[3] Weyuker, Elaine J.; "The Oracle Assumption of Program Testing", in Proceedings of the 13th International Conference on System Sciences (ICSS), Honolulu, HI, January 1980, pp. 44-49

[038720881X-4] Jalote, Pankaj; An Integrated Approach to Software Engineering, Springer/Birkhäuser, 2005, ISBN 0-387-20881-X

[5] Meyer, Bertrand; et al.; "Programs that Test Themselves", IEEE Computer, 42:9 (September 2009), pp. 46-55

[ammann-intro-6] 6.0 ^6.1 Ammann, Paul; and Offutt, Jeff; "Introduction to Software Testing", Cambridge University Press, 2008, ISBN 978-0-521-88038-1

[7] Peters, Dennis K. Generating a Test Oracle from Program Documentation (M. Eng.論文). McMaster University. 1995. CiteSeerX: 10.1.1.69.4331 .

[8] Peters, Dennis K.; Parnas, David L. Generating a Test Oracle from Program Documentation (PDF). Proceedings of the 1994 International Symposium on Software Testing and Analysis. ISSTA. ACM Press: 58–65. [2014-07-30]. （原始內容 (PDF)存檔於2015-09-24）.

[9] Hoffman, Douglas; Heuristic Test Oracles （頁面存檔備份，存於網際網路檔案館）, Software Testing & Quality Engineering Magazine, 1999

[10] Mayer, Johannes; and Guderlei, Ralph; Test Oracles Using Statistical Methods （頁面存檔備份，存於網際網路檔案館）

[11] Hoffman, Douglas; Analysis of a Taxonomy for Test Oracles （頁面存檔備份，存於網際網路檔案館）, Quality Week, 1998

[12] Robinson, Harry; Finite State Model-Based Testing on a Shoestring （頁面存檔備份，存於網際網路檔案館）, STAR West 1999

[1]

[2]

[3]

[4]

[5]

[6]

[7]

[8]

[9]

[10]

[11]

[12]