Orange3

Orange3 is a tool to test C compilers with randomly generated programs.

It mainly targets arithmetic optimization such as constant folding.

Please also see Orange4.

Download

Please download from http://github.com/ishiura-compiler/Orange3

latest release: Release_30 (22 Dec 2014)

Bugs detected by Orange3

GCC-6.0.0(experimental)

x86_64-unknown-linux-gnu

error program - 2015-10-20 [bugzilla]
error program - 2015-05-27 [bugzilla]

LLVM+Clang-3.7.0

x86_64-unknown-linux-gnu

error program - 2015-05-27 [bugzilla]
error program - 2015-05-27 [bugzilla]

GCC-5.0.0

x86_64-unknown-linux-gnu

error program - 2014-09-26 [bugzilla]
error program - 2014-09-26 [bugzilla]

LLVM+Clang-3.5

x86_64-unknown-linux-gnu

error program - 2014-09-26 [bugzilla]
error program - 2014-05-02 [bugzilla]

GCC-4.10.0

x86_64-unknown-linux-gnu

error program - 2014-05-03 [bugzilla]
error program - 2014-04-30 [bugzilla]
error program - 2014-04-23 [bugzilla]

GCC-4.9.2

x86_64-unknown-linux-gnu

error program - 2014-11-19 [bugzilla]

GCC-4.9.0

i686-pc-linux-gnu

error program - 2013-08-05 [bugzilla]

x86_64-unknown-linux-gnu

error program - 2013-07-05 [bugzilla]

GCC-4.8.2

i686-pc-linux-gnu

error program - 2013-06-19 [bugzilla]

LLVM+Clang-3.4

i386-pc-linux-gnu

error program - 2013-05-21 [bugzilla]

x86_64-unknown-linux-gnu

error program - 2013-05-09 [bugzilla]
error program - 2013-05-09 [bugzilla]
error program - 2013-05-09 [bugzilla]

GCC-4.8.1

i686-pc-linux-gnu

error program - 2013-05-01 [bugzilla]

x86_64-unknown-linux-gnu

error program - 2013-04-26 [bugzilla]

GCC-4.8.0

i686-linux-gnu

error program - 2013-04-10 [bugzilla]
error program - 2013-03-08 [bugzilla]

LLVM+Clang-4.2.1

x86_64-apple-darwin10

error program - 2013-02-20 [bugzilla]

GCC-4.7.2

x86_64-apple-darwin10

error program - 2013-02-10 [bugzilla]
error program - 2012-12-09
error program - 2012-12-09

GCC-4.4.4

i686-linux-gnu

error program - 2012-04-12
error program - 2012-04-12

GCC-4.4.1

m32r-elf-linux

error program - 2012-04-12
error program - 2012-04-12
error program - 2012-04-12
error program - 2012-04-12
error program - 2012-04-12

h8300-elf-linux

error program - 2012-04-12
error program - 2012-04-12
error program - 2012-04-12
error program - 2012-04-12

GCC-4.3.4

i686-pc-cygwin

error program - 2011-09-03
error program - 2011-09-03
error program - 2011-09-03

GCC-4.2.1

i686-apple-darwin10

error program - 2011-09-03
error program - 2011-09-03
error program - 2011-09-03
error program - 2011-09-03

Bibliography

A. Hashimoto and N. Ishiura: "Detecting Arithmetic Optimization Opportunities for C Compilers by Randomly Generated Equivalent Programs," IPSJ Transactions on System LSI Design Methodology, vol. 9, pp. 21-29 (Feb. 2016). [link]
E. Nagai, A. Hashimoto, and N. Ishiura: "Reinforcing Random Testing of Arithmetic Optimization of C Compilers by Scaling up Size and Number of Expressions," IPSJ Transactions on System LSI Design Methodology, vol. 7, pp. 91-100 (Aug. 2014). [link]
E. Nagai, A. Hashimoto, and N. Ishiura: "Scaling up Size and Number of Expressions in Random Testing of Arithmetic Optimization of C Compilers," in Proc. the Workshop on Synthesis And System Integration of Mixed Information Technologies (SASIMI 2013), R2-3, pp. 88-93 (Oct. 2013). [pdf]
橋本淳史, 石浦菜岐佐: "Cコンパイラの算術最適化のランダムテストにおける浮動小数点演算の導入," 電子情報通信学会ソサイエティ大会, A-3-9, (Sep. 2013). [pdf]
永井絵里子, 橋本淳史, 石浦菜岐佐: "Ｃコンパイラの算術最適化のランダムテストにおける式生成の強化," 電子情報通信学会技術研究報告, VLD2012-117, (Jan. 2013). [pdf]
E. Nagai, H. Awazu, N. Ishiura, and N. Takeda: "Random Testing of C Compilers Targeting Arithmetic Optimization," in Proc. the Workshop on Synthesis And System Integration of Mixed Information Technologies (SASIMI 2012), R1-10, pp. 48-53 (Mar. 2012). [pdf]
永井絵里子, 石浦菜岐佐: "Cコンパイラの算術式を対象としたランダムテストにおけるエラープログラムの最小化," 電子情報通信学会ソサイエティ大会, A-3-4, (Sep. 2011). [pdf]
武田直哉, 粟津裕亘, 石浦菜岐佐: "定数畳み込みを対象としたC コンパイラのランダムテスト," 情報処理学会関西支部大会, A-13, (Sep. 2009). [pdf]
粟津裕亘, 石浦菜岐佐: "算術式の最適化を対象としたCコンパイラのランダムテスト," 電子情報通信学会技術研究報告, VLD2008-127, pp. 7-10 (Mar. 2009). [pdf]

Email

mailto