Results for arith-context.test.sh

statusbashdashashzshmkshkshtoyshsushbrushosh
pass 1314789610614
ok 1003000000
N-I 0001200000
BUG 0003400000
FAIL 013100058480
total14141414141414141414
casebashdashashzshmkshkshtoyshsushbrushoshdescription
0pass FAIL FAIL N-I pass pass FAIL pass FAIL pass Multiple right brackets inside expression
detailsdetailsdetailsdetailsdetails
1pass FAIL pass pass pass pass pass pass pass pass Slicing of string with constants
details
2pass FAIL pass pass pass pass FAIL pass pass pass Slicing of string with variables
detailsdetails
3pass FAIL FAIL ok pass pass FAIL pass pass pass Array index on LHS of assignment
detailsdetailsdetailsdetails
4pass FAIL FAIL ok pass pass FAIL pass FAIL pass Array index on LHS with indices
detailsdetailsdetailsdetailsdetails
5pass FAIL pass BUG BUG pass pass pass pass pass Slicing of string with expressions
detailsdetailsdetails
6pass FAIL FAIL BUG BUG FAIL pass pass FAIL pass Ambiguous colon in slice
detailsdetailsdetailsdetailsdetailsdetails
7pass FAIL FAIL pass pass pass FAIL pass pass pass Triple parens should be disambiguated
detailsdetailsdetails
8pass FAIL FAIL pass pass pass FAIL pass pass pass Quadruple parens should be disambiguated
detailsdetailsdetails
9pass FAIL FAIL pass N-I FAIL pass FAIL FAIL pass ExprSub $[] happens to behave the same on simple cases
detailsdetailsdetailsdetailsdetailsdetails
10pass FAIL FAIL pass pass pass pass pass FAIL pass Empty expression (( )) $(( ))
detailsdetailsdetails
11pass FAIL FAIL pass N-I FAIL FAIL FAIL FAIL pass Empty expression for (( ))
detailsdetailsdetailsdetailsdetailsdetailsdetails
12pass FAIL FAIL BUG BUG FAIL FAIL FAIL FAIL pass Empty expression in ${a[@]: : }
detailsdetailsdetailsdetailsdetailsdetailsdetailsdetails
13ok pass pass ok BUG FAIL pass FAIL FAIL pass Empty expression a[]
detailsdetailsdetailsdetailsdetailsdetails
78 passed, 4 OK, 3 not implemented, 7 BUG, 48 failed, 0 timeouts, 0 cases skipped

Details on runs that didn't PASS

dash0 Multiple right brackets inside expression

[dash stdout] Expected '2 3\n', got ''
[dash status] Expected 0, got 2

stdout: 
stderr: 


dash: 1: Syntax error: "(" unexpected

ash0 Multiple right brackets inside expression


[ash stdout] Expected '2 3\n', got ''

[ash status] Expected 0, got 2



stdout: 


stderr: 


ash: syntax error: unexpected "("

zsh0 Multiple right brackets inside expression


stdout: 


stderr: 


toysh0 Multiple right brackets inside expression


[toysh stdout] Expected '2 3\n', got ''

[toysh status] Expected 0, got 2



stdout: 


stderr: 


main: line 1: sh: syntax error: 1

brush0 Multiple right brackets inside expression


[brush stdout] Expected '2 3\n', got '${a[a[0]]} ${a[a[a[0]]]}\n'



stdout: 


${a[a[0]]} ${a[a[a[0]]]}

stderr: 


dash1 Slicing of string with constants


[dash stdout] Expected 'abcd abcd b\n', got ''

[dash status] Expected 0, got 2



stdout: 


stderr: 


dash: 2: Bad substitution

dash2 Slicing of string with variables


[dash stdout] Expected 'abcd abcd b\n', got ''

[dash status] Expected 0, got 2



stdout: 


stderr: 


dash: 4: Bad substitution

toysh2 Slicing of string with variables


[toysh stdout] Expected 'abcd abcd b\n', got ''

[toysh status] Expected 0, got 1



stdout: 


stderr: 


main: line 4: sh: bad $zero} @ 0

dash3 Array index on LHS of assignment


[dash stdout] Expected '1 X 3\n', got ''

[dash status] Expected 0, got 2



stdout: 


stderr: 


dash: 1: Syntax error: "(" unexpected

ash3 Array index on LHS of assignment


[ash stdout] Expected '1 X 3\n', got ''

[ash status] Expected 0, got 2



stdout: 


stderr: 


ash: syntax error: unexpected "("

zsh3 Array index on LHS of assignment


stdout: 


X 2 3

stderr: 


toysh3 Array index on LHS of assignment


[toysh stdout] Expected '1 X 3\n', got ''

[toysh status] Expected 0, got 2



stdout: 


stderr: 


main: line 1: sh: syntax error: 1

dash4 Array index on LHS with indices


[dash stdout] Expected '1 2 X\n', got ''

[dash status] Expected 0, got 2



stdout: 


stderr: 


dash: 1: Syntax error: "(" unexpected

ash4 Array index on LHS with indices


[ash stdout] Expected '1 2 X\n', got ''

[ash status] Expected 0, got 2



stdout: 


stderr: 


ash: syntax error: unexpected "("

zsh4 Array index on LHS with indices


stdout: 


X 2 3

stderr: 


toysh4 Array index on LHS with indices


[toysh stdout] Expected '1 2 X\n', got ''

[toysh status] Expected 0, got 2



stdout: 


stderr: 


main: line 1: sh: syntax error: 1

brush4 Array index on LHS with indices


[brush stdout] Expected '1 2 X\n', got '1 2 3\n'



stdout: 


1 2 3

stderr: 


a[a[1]]=X: command not found

dash5 Slicing of string with expressions


[dash stdout] Expected 'abcd abcd b\n', got ''

[dash status] Expected 0, got 2



stdout: 


stderr: 


dash: 3: Bad substitution

zsh5 Slicing of string with expressions


stdout: 


stderr: 


zsh: unrecognized modifier `z'

mksh5 Slicing of string with expressions


stdout: 


stderr: 


mksh: <stdin>[3]: ${s:zero}: bad substitution

dash6 Ambiguous colon in slice


[dash stdout] Expected '2\nc\n', got '2\n'

[dash status] Expected 0, got 2



stdout: 


2

stderr: 


dash: 3: Bad substitution

ash6 Ambiguous colon in slice


[ash stdout] Expected '2\nc\n', got '2\n'

[ash status] Expected 0, got 2



stdout: 


2

stderr: 


ash: malformed ?: operator

zsh6 Ambiguous colon in slice


stdout: 


2

stderr: 


zsh: bad math expression: ':' expected

mksh6 Ambiguous colon in slice


stdout: 


2

stderr: 


mksh: <stdin>[3]: ${s: 0 < 1 ? 2 : 0 : 1}: bad substitution

ksh6 Ambiguous colon in slice


[ksh stdout] Expected '2\nc\n', got '2\n'

[ksh status] Expected 0, got 1



stdout: 


2

stderr: 


E: ksh: <stdin>[3]: ${s: 0 < 1 ? 2 : 0 : 1}: bad substitution

brush6 Ambiguous colon in slice


[brush stdout] Expected '2\nc\n', got '2\n${s: 0 <1 ? 2 : 0 : 1}\n'



stdout: 


2
${s: 0 <1 ? 2 : 0 : 1}

stderr: 


dash7 Triple parens should be disambiguated


[dash stdout] Expected '7 7\n', got ''

[dash status] Expected 0, got 2



stdout: 


stderr: 


dash: 1: Syntax error: "(" unexpected (expecting ")")

ash7 Triple parens should be disambiguated


[ash stdout] Expected '7 7\n', got ''

[ash status] Expected 0, got 2



stdout: 


stderr: 


ash: syntax error: unexpected "(" (expecting ")")

toysh7 Triple parens should be disambiguated


[toysh stdout] Expected '7 7\n', got '0 7\n'



stdout: 


0 7

stderr: 


dash8 Quadruple parens should be disambiguated


[dash stdout] Expected '15 15\n', got ''

[dash status] Expected 0, got 2



stdout: 


stderr: 


dash: 1: Syntax error: "(" unexpected (expecting ")")

ash8 Quadruple parens should be disambiguated


[ash stdout] Expected '15 15\n', got ''

[ash status] Expected 0, got 2



stdout: 


stderr: 


ash: syntax error: unexpected "(" (expecting ")")

toysh8 Quadruple parens should be disambiguated


[toysh stdout] Expected '15 15\n', got '0 15\n'



stdout: 


0 15

stderr: 


dash9 ExprSub $[] happens to behave the same on simple cases


[dash stdout] Expected '3 12\n', got '$[1 + 2] $[3 * 4]\n'



stdout: 


$[1 + 2] $[3 * 4]

stderr: 


ash9 ExprSub $[] happens to behave the same on simple cases


[ash stdout] Expected '3 12\n', got '$[1 + 2] $[3 * 4]\n'



stdout: 


$[1 + 2] $[3 * 4]

stderr: 


mksh9 ExprSub $[] happens to behave the same on simple cases


stdout: 


$[1 + 2] $[3 * 4]

stderr: 


ksh9 ExprSub $[] happens to behave the same on simple cases


[ksh stdout] Expected '3 12\n', got '$[1 + 2] $[3 * 4]\n'



stdout: 


$[1 + 2] $[3 * 4]

stderr: 


sush9 ExprSub $[] happens to behave the same on simple cases


[sush stdout] Expected '3 12\n', got '$[1 + 2] $[3 * 4]\n'



stdout: 


$[1 + 2] $[3 * 4]

stderr: 


brush9 ExprSub $[] happens to behave the same on simple cases


[brush stdout] Expected '3 12\n', got '$[1 + 2] $[3 * 4]\n'



stdout: 


$[1 + 2] $[3 * 4]

stderr: 


dash10 Empty expression (( ))  $(( ))


[dash stdout] Expected 'status=1\n0\n', got ''

[dash status] Expected 0, got 2



stdout: 


stderr: 


dash: 1: Syntax error: ")" unexpected

ash10 Empty expression (( ))  $(( ))


[ash stdout] Expected 'status=1\n0\n', got ''

[ash status] Expected 0, got 2



stdout: 


stderr: 


ash: syntax error: unexpected ")"

brush10 Empty expression (( ))  $(( ))


[brush stdout] Expected 'status=1\n0\n', got 'status=1\n'



stdout: 


status=1

stderr: 


ERROR error: arithmetic evaluation error: failed to parse expression: ' '

dash11 Empty expression for (( ))


[dash stdout] Expected 'one\n', got ''

[dash status] Expected 0, got 2



stdout: 


stderr: 


dash: 1: Syntax error: Bad for loop variable

ash11 Empty expression for (( ))


[ash stdout] Expected 'one\n', got ''

[ash status] Expected 0, got 2



stdout: 


stderr: 


ash: syntax error: bad for loop variable

mksh11 Empty expression for (( ))


stdout: 


stderr: 


mksh: <stdin>[1]: syntax error: '((' unexpected

ksh11 Empty expression for (( ))


[ksh stdout] Expected 'one\n', got ''

[ksh status] Expected 0, got 1



stdout: 


stderr: 


E: ksh: <stdin>[1]: syntax error: unexpected '(('

toysh11 Empty expression for (( ))


[toysh stdout] Expected 'one\n', got ''

[toysh status] Expected 0, got 2



stdout: 


stderr: 


main: line 1: sh: syntax error: ;

sush11 Empty expression for (( ))


[sush stdout] Expected 'one\n', got ''



stdout: 


stderr: 


brush11 Empty expression for (( ))


[brush stdout] Expected 'one\n', got ''



stdout: 


stderr: 


dash12 Empty expression in ${a[@]: : }



[dash stdout]
Expected 'slice a b c d e f\nstatus=0\n\nslice\nstatus=0\n\nslice\nstatus=0\n'
Got      ''


[dash status] Expected 0, got 2



stdout: 


stderr: 


dash: 1: Syntax error: "(" unexpected

ash12 Empty expression in ${a[@]: : }



[ash stdout]
Expected 'slice a b c d e f\nstatus=0\n\nslice\nstatus=0\n\nslice\nstatus=0\n'
Got      ''


[ash status] Expected 0, got 2



stdout: 


stderr: 


ash: syntax error: unexpected "("

zsh12 Empty expression in ${a[@]: : }


stdout: 


slice a b c d e f
status=0

slice
status=0


stderr: 


zsh: closing brace expected

mksh12 Empty expression in ${a[@]: : }


stdout: 


stderr: 


mksh: <stdin>[3]: ${a[@]: }: bad substitution

ksh12 Empty expression in ${a[@]: : }



[ksh stdout]
Expected 'slice a b c d e f\nstatus=0\n\nslice\nstatus=0\n\nslice\nstatus=0\n'
Got      ''


[ksh status] Expected 0, got 1



stdout: 


stderr: 


E: ksh: <stdin>[3]: ${a[@]: }: bad substitution

toysh12 Empty expression in ${a[@]: : }



[toysh stdout]
Expected 'slice a b c d e f\nstatus=0\n\nslice\nstatus=0\n\nslice\nstatus=0\n'
Got      ''


[toysh status] Expected 0, got 2



stdout: 


stderr: 


main: line 1: sh: syntax error: a

sush12 Empty expression in ${a[@]: : }



[sush stdout]
Expected 'slice a b c d e f\nstatus=0\n\nslice\nstatus=0\n\nslice\nstatus=0\n'
Got      'slice a b c d e f\nstatus=0\n\nslice\nstatus=0\n\nstatus=1\n'




stdout: 


slice a b c d e f
status=0

slice
status=0

status=1

stderr: 


/home/andy/git/oils-for-unix/oils/../../shells/rusty_bash/target/release/sush: line 11: `': bad substitution

brush12 Empty expression in ${a[@]: : }



[brush stdout]
Expected 'slice a b c d e f\nstatus=0\n\nslice\nstatus=0\n\nslice\nstatus=0\n'
Got      'status=1\n\nstatus=1\n\nstatus=1\n'




stdout: 


status=1

status=1

status=1

stderr: 


ERROR error: arithmetic evaluation error: failed to parse expression: ' '
ERROR error: arithmetic evaluation error: failed to parse expression: ' '
ERROR error: arithmetic evaluation error: failed to parse expression: ' '

bash13 Empty expression a[]


stdout: 


status=1
1 2 3
status=1

stderr: 


bash: line 3: a[]: bad array subscript
bash: line 7: ${a[]}: bad substitution

zsh13 Empty expression a[]


stdout: 


stderr: 


zsh: not an identifier: a[]

mksh13 Empty expression a[]


stdout: 


status=0
42 2 3
42
status=0

stderr: 


ksh13 Empty expression a[]


[ksh stdout] Expected '', got 'status=0\n1 2 3\n1\nstatus=0\n'

[ksh status] Expected 2, got 0



stdout: 


status=0
1 2 3
1
status=0

stderr: 


sush13 Empty expression a[]


[sush stdout] Expected '', got 'status=1\n1 2 3\nstatus=1\n'

[sush status] Expected 2, got 0



stdout: 


status=1
1 2 3
status=1

stderr: 


/home/andy/git/oils-for-unix/oils/../../shells/rusty_bash/target/release/sush: line 3: `a': not a valid index
/home/andy/git/oils-for-unix/oils/../../shells/rusty_bash/target/release/sush: line 7: `': not a valid index

brush13 Empty expression a[]


[brush stdout] Expected '', got 'status=0\n42 2 3\n42\nstatus=0\n'

[brush status] Expected 2, got 0



stdout: 


status=0
42 2 3
42
status=0

stderr: