Results for toysh-posix.test.sh

statusbashmkshkshtoyshsushbrushosh
pass 18191912141516
ok 2400002
BUG 3000000
FAIL 00411985
total23232323232323
casebashmkshkshtoyshsushbrushoshdescription
0pass pass pass FAIL FAIL pass pass Fatal error
detailsdetails
1BUG pass pass FAIL FAIL FAIL ok setting readonly var (bash is only one where it's non-fatal)
detailsdetailsdetailsdetailsdetails
2ok pass pass FAIL FAIL FAIL ok readonly with temp binding
detailsdetailsdetailsdetailsdetails
3BUG ok FAIL pass FAIL pass pass Failed redirect in assignment, vs. export
detailsdetailsdetailsdetails
4ok pass pass FAIL FAIL FAIL FAIL Evaluation order of redirect and ${undef?error}
detailsdetailsdetailsdetailsdetails
5pass pass pass FAIL pass pass pass Function def in pipeline
details
6pass pass pass pass pass pass pass dynamic glob - http://landley.net/notes.html#08-05-2020
7pass pass pass FAIL FAIL pass pass no shebang
detailsdetails
8pass pass pass pass pass pass pass IFS
9pass ok FAIL pass pass pass pass shift is fatal at top level?
detailsdetails
10pass pass pass pass pass pass pass var and func - http://landley.net/notes.html#19-03-2020
11pass pass pass FAIL pass FAIL FAIL IFS - http://landley.net/notes.html#05-03-2020
detailsdetailsdetails
12pass pass pass FAIL pass FAIL FAIL IFS=x and '' and unquoted $@ - reduction of case above - copied into spec/word-split
detailsdetailsdetails
13pass pass pass pass FAIL pass pass for loop parsing - http://landley.net/notes.html#04-03-2020
details
14pass pass pass pass pass pass pass Parsing $(( ))
15pass pass pass pass pass FAIL FAIL IFS - http://landley.net/notes.html#15-02-2020 (TODO: osh)
detailsdetails
16pass pass pass pass pass pass FAIL IFS 2 - copied into spec/word-split
details
17pass pass pass pass pass FAIL pass IFS 3
details
18BUG pass pass FAIL FAIL pass pass IFS 4
detailsdetailsdetails
19pass pass pass pass pass pass pass IFS 5
20pass ok FAIL pass pass pass pass Can't parse extra }
detailsdetails
21pass ok FAIL FAIL FAIL FAIL pass Command Sub Syntax Error
detailsdetailsdetailsdetailsdetails
22pass pass pass FAIL pass pass pass Pipeline - http://landley.net/notes-2019.html#16-12-2019
details
113 passed, 8 OK, 0 not implemented, 3 BUG, 37 failed, 0 timeouts, 0 cases skipped
5 failed under osh

Details on runs that didn't PASS

toysh0 Fatal error

[toysh stdout] Expected u'', got 'blah\n'
[toysh status] Expected 1, got 0

stdout: 
blah
stderr: 
main: line 1: sh: a: bc
sush0 Fatal error

[sush stdout] Expected u'', got 'blah\n'
[sush status] Expected 1, got 0

stdout: 
blah
stderr: 
/home/andy/git/oils-for-unix/oils/../../shells/rusty_bash/target/release/sush: line 1: a: bc
bash1 setting readonly var (bash is only one where it's non-fatal)

stdout: 
status=1
stderr: 
bash: line 2: abc: readonly variable
toysh1 setting readonly var (bash is only one where it's non-fatal)

[toysh stdout] Expected u'', got 'status=0\n'
[toysh status] Expected 2, got 0

stdout: 
status=0
stderr: 
sh: readonly: No such file or directory
sush1 setting readonly var (bash is only one where it's non-fatal)

[sush stdout] Expected u'', got 'status=1\n'
[sush status] Expected 2, got 0

stdout: 
status=1
stderr: 
/home/andy/git/oils-for-unix/oils/../../shells/rusty_bash/target/release/sush: line 2: abc: readonly variable
brush1 setting readonly var (bash is only one where it's non-fatal)

[brush stdout] Expected u'', got 'status=1\n'
[brush status] Expected 2, got 0

stdout: 
status=1
stderr: 
ERROR error: cannot mutate readonly variable
osh1 setting readonly var (bash is only one where it's non-fatal)

stdout: 
stderr: 


  abc=def
  ^~~~
[ stdin ]:2: fatal: Can't assign to readonly value 'abc'

bash2 readonly with temp binding


stdout: 


one
status=0
hello

stderr: 


bash: line 2: abc: readonly variable
bash: line 5: /does/not/exist: No such file or directory

toysh2 readonly with temp binding


[toysh stdout] Expected u'', got 'one\nstatus=0\nhello\n'

[toysh status] Expected 2, got 0



stdout: 


one
status=0
hello

stderr: 


sh: readonly: No such file or directory
sh: /does/not/exist: No such file or directory

sush2 readonly with temp binding


[sush stdout] Expected u'', got 'status=1\nhello\n'

[sush status] Expected 2, got 0



stdout: 


status=1
hello

stderr: 


/home/andy/git/oils-for-unix/oils/../../shells/rusty_bash/target/release/sush: line 2: abc: readonly variable
/home/andy/git/oils-for-unix/oils/../../shells/rusty_bash/target/release/sush: line 5: /does/not/exist: entity not found

brush2 readonly with temp binding


[brush stdout] Expected u'', got 'one\nstatus=0\nhello\n'

[brush status] Expected 2, got 0



stdout: 


one
status=0
hello

stderr: 


error: failed to redirect to /does/not/exist: No such file or directory (os error 2)

osh2 readonly with temp binding


stdout: 


one
status=0
hello

stderr: 


  echo potato < /does/not/exist || echo hello
              ^
[ stdin ]:5: Can't open '/does/not/exist': No such file or directory
[ stdin ]:5: I/O error applying redirect: No such file or directory

bash3 Failed redirect in assignment, vs. export


stdout: 


abc=def
abc=def

stderr: 


bash: line 1: /does/not/exist1: No such file or directory
bash: line 4: /does/not/exist2: No such file or directory

mksh3 Failed redirect in assignment, vs. export


stdout: 


abc=

stderr: 


mksh: <stdin>[1]: can't create /does/not/exist1: No such file or directory
mksh: <stdin>[4]: can't create /does/not/exist2: No such file or directory

ksh3 Failed redirect in assignment, vs. export


[ksh stdout] Expected 'abc=\nabc=\n', got 'abc=\n'

[ksh status] Expected 0, got 1



stdout: 


abc=

stderr: 


W: ksh: <stdin>[1]: /does/not/exist1: create: No such file or directory
W: ksh: <stdin>[4]: /does/not/exist2: create: No such file or directory
E: ksh: <stdin>[4]: redirection failure

sush3 Failed redirect in assignment, vs. export


[sush stdout] Expected 'abc=\nabc=\n', got 'abc=def\nabc=def\n'



stdout: 


abc=def
abc=def

stderr: 


/home/andy/git/oils-for-unix/oils/../../shells/rusty_bash/target/release/sush: line 4: /does/not/exist2: entity not found

bash4 Evaluation order of redirect and ${undef?error}


stdout: 


stderr: 


rm: cannot remove '_tmp': Is a directory
bash: line 1: x: bc
bash: line 1: a: bc

toysh4 Evaluation order of redirect and ${undef?error}


[toysh stdout] Expected 'exists1\n', got 'exists1\nexists2\n'



stdout: 


exists1
exists2

stderr: 


rm: cannot remove '_tmp': Is a directory
-c: line 1: sh: x: bc
-c: line 1: sh: a: bc

sush4 Evaluation order of redirect and ${undef?error}


[sush stdout] Expected 'exists1\n', got ''



stdout: 


stderr: 


rm: cannot remove '_tmp': Is a directory
/home/andy/git/oils-for-unix/oils/../../shells/rusty_bash/target/release/sush: line 1: x: bc
/home/andy/git/oils-for-unix/oils/../../shells/rusty_bash/target/release/sush: line 1: a: bc

brush4 Evaluation order of redirect and ${undef?error}


[brush stdout] Expected 'exists1\n', got 'exists1\nexists2\n'



stdout: 


exists1
exists2

stderr: 


rm: cannot remove '_tmp': Is a directory
ERROR error: expansion error: bc
ERROR error: expansion error: bc

osh4 Evaluation order of redirect and ${undef?error}


[osh stdout] Expected 'exists1\n', got 'exists1\nexists2\n'



stdout: 


exists1
exists2

stderr: 


rm: cannot remove '_tmp': Is a directory
  X=${x?bc} > walrus
      ^
[ -c flag ]:1: fatal: Var x is unset: 'bc'
  >walrus echo ${a?bc}
                 ^
[ -c flag ]:1: fatal: Var a is unset: 'bc'

toysh5 Function def in pipeline


[toysh status] Expected 0, got 127



stdout: 


ha

stderr: 


sh: hello: No such file or directory

toysh7 no shebang


[toysh status] Expected 0, got 139



stdout: 


hello
hello
hello 123

stderr: 


sush7 no shebang


[sush stdout] Expected 'hello\nhello\nhello 123\n', got 'hello\nhello\nhello\n'



stdout: 


hello
hello
hello

stderr: 


mksh9 shift is fatal at top level?


stdout: 


stderr: 


mksh: shift: nothing to shift

ksh9 shift is fatal at top level?


[ksh stdout] Expected 'hello\n', got ''

[ksh status] Expected 0, got 1



stdout: 


stderr: 


E: ksh: shift: nothing to shift

toysh11 IFS - http://landley.net/notes.html#05-03-2020



[toysh stdout]
Expected '=one=\n=abc=\n=d f=\n=ghi=\n---\n=one=\n==\n=two=\n'
Got      ''


[toysh status] Expected 0, got -6



stdout: 


stderr: 


munmap_chunk(): invalid pointer

brush11 IFS - http://landley.net/notes.html#05-03-2020



[brush stdout]
Expected '=one=\n=abc=\n=d f=\n=ghi=\n---\n=one=\n==\n=two=\n'
Got      '=one=\n=abc=\n=d=\n=f=\n=ghi=\n---\n=one=\n=two=\n'




stdout: 


=one=
=abc=
=d=
=f=
=ghi=
---
=one=
=two=

stderr: 


osh11 IFS - http://landley.net/notes.html#05-03-2020



[osh stdout]
Expected '=one=\n=abc=\n=d f=\n=ghi=\n---\n=one=\n==\n=two=\n'
Got      '=one=\n=abc=\n=d f=\n=ghi=\n---\n=one=\n=two=\n'




stdout: 


=one=
=abc=
=d f=
=ghi=
---
=one=
=two=

stderr: 


toysh12 IFS=x and '' and unquoted $@ - reduction of case above - copied into spec/word-split


[toysh stdout] Expected "['one', '', 'two']\n-one-\n--\n-two-\n", got '[]\n'



stdout: 


[]

stderr: 


sh: setopt: No such file or directory
set: bad --

brush12 IFS=x and '' and unquoted $@ - reduction of case above - copied into spec/word-split


[brush stdout] Expected "['one', '', 'two']\n-one-\n--\n-two-\n", got "['one', 'two']\n-one-\n-two-\n"



stdout: 


['one', 'two']
-one-
-two-

stderr: 


setopt: command not found

osh12 IFS=x and '' and unquoted $@ - reduction of case above - copied into spec/word-split


[osh stdout] Expected "['one', '', 'two']\n-one-\n--\n-two-\n", got "['one', 'two']\n-one-\n-two-\n"



stdout: 


['one', 'two']
-one-
-two-

stderr: 


  setopt SH_WORD_SPLIT
  ^~~~~~
[ stdin ]:1: Command 'setopt' not found (OILS-ERR-100)

sush13 for loop parsing - http://landley.net/notes.html#04-03-2020


[sush stdout] Expected 'one\ntwo\nthree\n0\ncannot-parse\n', got '2\ncannot-parse\n'



stdout: 


2
cannot-parse

stderr: 


/home/andy/git/oils-for-unix/oils/../../shells/rusty_bash/target/release/sush: line 4: Unexpected token: in
/home/andy/git/oils-for-unix/oils/../../shells/rusty_bash/target/release/sush: line 5: Unexpected token: do
/home/andy/git/oils-for-unix/oils/../../shells/rusty_bash/target/release/sush: line 6: Unexpected token: done

/home/andy/git/oils-for-unix/oils/../../shells/rusty_bash/target/release/sush: line 2: Unexpected token: in

brush15 IFS - http://landley.net/notes.html#15-02-2020 (TODO: osh)


[brush stdout] Expected '==\n=abc=\n==\n\n==\n=abc=\n=def=\n==\n', got '=abc=\n\n==\n=abc=\n=def=\n==\n'



stdout: 


=abc=

==
=abc=
=def=
==

stderr: 


osh15 IFS - http://landley.net/notes.html#15-02-2020 (TODO: osh)


[osh stdout] Expected '==\n=abc=\n==\n\n==\n=abc=\n=def=\n==\n', got '==\n=abc=\n==\n\n=abc=\n=def=\n'



stdout: 


==
=abc=
==

=abc=
=def=

stderr: 


osh16 IFS 2 - copied into spec/word-split


[osh stdout] Expected '=x=\n=abc=\n=def=\n==\n', got '=x=\n=abc=\n=def=\n'



stdout: 


=x=
=abc=
=def=

stderr: 


brush17 IFS 3


[brush stdout] Expected 'one two  three\n', got 'one two three\n'



stdout: 


one two three

stderr: 


bash18 IFS 4


stdout: 


/ /
--

/x/
-=-
-=-

stderr: 


bash: line 1: setopt: command not found

toysh18 IFS 4


[toysh stdout] Expected '/ /\n\n/x/\n-=-\n-=-\n', got '//\n\n/x/\n-==-\n'



stdout: 


//

/x/
-==-

stderr: 


sh: setopt: No such file or directory

sush18 IFS 4


[sush stdout] Expected '/ /\n\n/x/\n-=-\n-=-\n', got '/ /\n--\n\n/x/\n-=-\n-=-\n'



stdout: 


/ /
--

/x/
-=-
-=-

stderr: 


/home/andy/git/oils-for-unix/oils/../../shells/rusty_bash/target/release/sush: line 1: setopt: command not found

mksh20 Can't parse extra }


stdout: 


stderr: 


123: syntax error: '}' unexpected

ksh20 Can't parse extra }


[ksh status] Expected 2, got 1



stdout: 


stderr: 


E: 123: syntax error: unexpected '}'

mksh21 Command Sub Syntax Error


stdout: 


stderr: 


mksh: <stdin>[1]: syntax error: ')' unexpected

ksh21 Command Sub Syntax Error


[ksh status] Expected 2, got 1



stdout: 


stderr: 


E: ksh: <stdin>[1]: syntax error: unexpected ')'

toysh21 Command Sub Syntax Error


[toysh stdout] Expected u'', got '\n0\n\n0\n'

[toysh status] Expected 2, got 0



stdout: 


0

0

stderr: 


main: line 1: sh: syntax error: unexpected end of file

sush21 Command Sub Syntax Error


[sush stdout] Expected u'', got '2\n\n0\n'

[sush status] Expected 2, got 0



stdout: 


2

0

stderr: 


/home/andy/git/oils-for-unix/oils/../../shells/rusty_bash/target/release/sush: line 2: Unexpected token: )


brush21 Command Sub Syntax Error


[brush stdout] Expected u'', got '\n0\n\n0\n'

[brush status] Expected 2, got 0



stdout: 


0

0

stderr: 


ERROR main: syntax error at end of input

toysh22 Pipeline - http://landley.net/notes-2019.html#16-12-2019


[toysh stdout] Expected 'hello\n-@hello@-\n', got '\n'



stdout: 


stderr: 


sh: read: No such file or directory
sh: read: No such file or directory
sh: read: No such file or directory