Results for toysh-posix.test.sh

statusbashdashashzshmkshkshtoyshsushbrushosh
pass 18171910191912141516
ok 2324400002
N-I 0101000000
BUG 3228000000
FAIL 00000411985
total23232323232323232323
casebashdashashzshmkshkshtoyshsushbrushoshdescription
0pass ok ok pass pass pass FAIL FAIL pass pass Fatal error
detailsdetailsdetailsdetails
1BUG pass pass ok pass pass FAIL FAIL FAIL ok setting readonly var (bash is only one where it's non-fatal)
detailsdetailsdetailsdetailsdetailsdetails
2ok pass pass ok pass pass FAIL FAIL FAIL ok readonly with temp binding
detailsdetailsdetailsdetailsdetailsdetails
3BUG ok ok pass ok FAIL pass FAIL pass pass Failed redirect in assignment, vs. export
detailsdetailsdetailsdetailsdetailsdetails
4ok pass pass pass pass pass FAIL FAIL FAIL FAIL Evaluation order of redirect and ${undef?error}
detailsdetailsdetailsdetailsdetails
5pass pass pass pass pass pass FAIL pass pass pass Function def in pipeline
details
6pass pass pass BUG pass pass pass pass pass pass dynamic glob - http://landley.net/notes.html#08-05-2020
details
7pass pass pass pass pass pass FAIL FAIL pass pass no shebang
detailsdetails
8pass N-I pass BUG pass pass pass pass pass pass IFS
detailsdetails
9pass ok pass pass ok FAIL pass pass pass pass shift is fatal at top level?
detailsdetailsdetails
10pass pass pass pass pass pass pass pass pass pass var and func - http://landley.net/notes.html#19-03-2020
11pass BUG BUG N-I pass pass FAIL pass FAIL FAIL IFS - http://landley.net/notes.html#05-03-2020
detailsdetailsdetailsdetailsdetailsdetails
12pass BUG BUG BUG pass pass FAIL pass FAIL FAIL IFS=x and '' and unquoted $@ - reduction of case above - copied into spec/word-split
detailsdetailsdetailsdetailsdetailsdetails
13pass pass pass pass pass pass pass FAIL pass pass for loop parsing - http://landley.net/notes.html#04-03-2020
details
14pass pass pass pass pass pass pass pass pass pass Parsing $(( ))
15pass pass pass BUG pass pass pass pass FAIL FAIL IFS - http://landley.net/notes.html#15-02-2020 (TODO: osh)
detailsdetailsdetails
16pass pass pass BUG pass pass pass pass pass FAIL IFS 2 - copied into spec/word-split
detailsdetails
17pass pass pass BUG pass pass pass pass FAIL pass IFS 3
detailsdetails
18BUG pass pass BUG pass pass FAIL FAIL pass pass IFS 4
detailsdetailsdetailsdetails
19pass pass pass BUG pass pass pass pass pass pass IFS 5
details
20pass pass pass ok ok FAIL pass pass pass pass Can't parse extra }
detailsdetailsdetails
21pass pass pass ok ok FAIL FAIL FAIL FAIL pass Command Sub Syntax Error
detailsdetailsdetailsdetailsdetailsdetails
22pass pass pass pass pass pass FAIL pass pass pass Pipeline - http://landley.net/notes-2019.html#16-12-2019
details
159 passed, 17 OK, 2 not implemented, 15 BUG, 37 failed, 0 timeouts, 0 cases skipped
5 failed under osh

Details on runs that didn't PASS

dash0 Fatal error

stdout: 
stderr: 


dash: 1: a: bc

ash0 Fatal error


stdout: 


stderr: 


ash: a: bc

toysh0 Fatal error


[toysh stdout] Expected u'', got 'blah\n'

[toysh status] Expected 1, got 0



stdout: 


blah

stderr: 


main: line 1: sh: a: bc

sush0 Fatal error


[sush stdout] Expected u'', got 'blah\n'

[sush status] Expected 1, got 0



stdout: 


blah

stderr: 


/home/andy/git/oils-for-unix/oils/../../shells/rusty_bash/target/release/sush: line 1: a: bc

bash1 setting readonly var (bash is only one where it's non-fatal)


stdout: 


status=1

stderr: 


bash: line 2: abc: readonly variable

zsh1 setting readonly var (bash is only one where it's non-fatal)


stdout: 


stderr: 


zsh: read-only variable: abc

toysh1 setting readonly var (bash is only one where it's non-fatal)


[toysh stdout] Expected u'', got 'status=0\n'

[toysh status] Expected 2, got 0



stdout: 


status=0

stderr: 


sh: readonly: No such file or directory

sush1 setting readonly var (bash is only one where it's non-fatal)


[sush stdout] Expected u'', got 'status=1\n'

[sush status] Expected 2, got 0



stdout: 


status=1

stderr: 


/home/andy/git/oils-for-unix/oils/../../shells/rusty_bash/target/release/sush: line 2: abc: readonly variable

brush1 setting readonly var (bash is only one where it's non-fatal)


[brush stdout] Expected u'', got 'status=1\n'

[brush status] Expected 2, got 0



stdout: 


status=1

stderr: 


ERROR error: cannot mutate readonly variable

osh1 setting readonly var (bash is only one where it's non-fatal)


stdout: 


stderr: 


  abc=def
  ^~~~
[ stdin ]:2: fatal: Can't assign to readonly value 'abc'

bash2 readonly with temp binding


stdout: 


one
status=0
hello

stderr: 


bash: line 2: abc: readonly variable
bash: line 5: /does/not/exist: No such file or directory

zsh2 readonly with temp binding


stdout: 


stderr: 


zsh: read-only variable: abc

toysh2 readonly with temp binding


[toysh stdout] Expected u'', got 'one\nstatus=0\nhello\n'

[toysh status] Expected 2, got 0



stdout: 


one
status=0
hello

stderr: 


sh: readonly: No such file or directory
sh: /does/not/exist: No such file or directory

sush2 readonly with temp binding


[sush stdout] Expected u'', got 'status=1\nhello\n'

[sush status] Expected 2, got 0



stdout: 


status=1
hello

stderr: 


/home/andy/git/oils-for-unix/oils/../../shells/rusty_bash/target/release/sush: line 2: abc: readonly variable
/home/andy/git/oils-for-unix/oils/../../shells/rusty_bash/target/release/sush: line 5: /does/not/exist: entity not found

brush2 readonly with temp binding


[brush stdout] Expected u'', got 'one\nstatus=0\nhello\n'

[brush status] Expected 2, got 0



stdout: 


one
status=0
hello

stderr: 


error: failed to redirect to /does/not/exist: No such file or directory (os error 2)

osh2 readonly with temp binding


stdout: 


one
status=0
hello

stderr: 


  echo potato < /does/not/exist || echo hello
              ^
[ stdin ]:5: Can't open '/does/not/exist': No such file or directory
[ stdin ]:5: I/O error applying redirect: No such file or directory

bash3 Failed redirect in assignment, vs. export


stdout: 


abc=def
abc=def

stderr: 


bash: line 1: /does/not/exist1: No such file or directory
bash: line 4: /does/not/exist2: No such file or directory

dash3 Failed redirect in assignment, vs. export


stdout: 


abc=

stderr: 


dash: 1: cannot create /does/not/exist1: Directory nonexistent
dash: 4: cannot create /does/not/exist2: Directory nonexistent

ash3 Failed redirect in assignment, vs. export


stdout: 


abc=

stderr: 


ash: can't create /does/not/exist1: nonexistent directory
ash: can't create /does/not/exist2: nonexistent directory

mksh3 Failed redirect in assignment, vs. export


stdout: 


abc=

stderr: 


mksh: <stdin>[1]: can't create /does/not/exist1: No such file or directory
mksh: <stdin>[4]: can't create /does/not/exist2: No such file or directory

ksh3 Failed redirect in assignment, vs. export


[ksh stdout] Expected 'abc=\nabc=\n', got 'abc=\n'

[ksh status] Expected 0, got 1



stdout: 


abc=

stderr: 


W: ksh: <stdin>[1]: /does/not/exist1: create: No such file or directory
W: ksh: <stdin>[4]: /does/not/exist2: create: No such file or directory
E: ksh: <stdin>[4]: redirection failure

sush3 Failed redirect in assignment, vs. export


[sush stdout] Expected 'abc=\nabc=\n', got 'abc=def\nabc=def\n'



stdout: 


abc=def
abc=def

stderr: 


/home/andy/git/oils-for-unix/oils/../../shells/rusty_bash/target/release/sush: line 4: /does/not/exist2: entity not found

bash4 Evaluation order of redirect and ${undef?error}


stdout: 


stderr: 


rm: cannot remove '_tmp': Is a directory
bash: line 1: x: bc
bash: line 1: a: bc

toysh4 Evaluation order of redirect and ${undef?error}


[toysh stdout] Expected 'exists1\n', got 'exists1\nexists2\n'



stdout: 


exists1
exists2

stderr: 


rm: cannot remove '_tmp': Is a directory
-c: line 1: sh: x: bc
-c: line 1: sh: a: bc

sush4 Evaluation order of redirect and ${undef?error}


[sush stdout] Expected 'exists1\n', got ''



stdout: 


stderr: 


rm: cannot remove '_tmp': Is a directory
/home/andy/git/oils-for-unix/oils/../../shells/rusty_bash/target/release/sush: line 1: x: bc
/home/andy/git/oils-for-unix/oils/../../shells/rusty_bash/target/release/sush: line 1: a: bc

brush4 Evaluation order of redirect and ${undef?error}


[brush stdout] Expected 'exists1\n', got 'exists1\nexists2\n'



stdout: 


exists1
exists2

stderr: 


rm: cannot remove '_tmp': Is a directory
ERROR error: expansion error: bc
ERROR error: expansion error: bc

osh4 Evaluation order of redirect and ${undef?error}


[osh stdout] Expected 'exists1\n', got 'exists1\nexists2\n'



stdout: 


exists1
exists2

stderr: 


rm: cannot remove '_tmp': Is a directory
  X=${x?bc} > walrus
      ^
[ -c flag ]:1: fatal: Var x is unset: 'bc'
  >walrus echo ${a?bc}
                 ^
[ -c flag ]:1: fatal: Var a is unset: 'bc'

toysh5 Function def in pipeline


[toysh status] Expected 0, got 127



stdout: 


ha

stderr: 


sh: hello: No such file or directory

zsh6 dynamic glob - http://landley.net/notes.html#08-05-2020


stdout: 


*

stderr: 


rm: cannot remove '_tmp': Is a directory
zsh: no matches found: **.?z

toysh7 no shebang


[toysh status] Expected 0, got 139



stdout: 


hello
hello
hello 123

stderr: 


sush7 no shebang


[sush stdout] Expected 'hello\nhello\nhello 123\n', got 'hello\nhello\nhello\n'



stdout: 


hello
hello
hello

stderr: 


dash8 IFS


stdout: 


stderr: 


dash: 1: Bad substitution

zsh8 IFS


stdout: 


agd
{x,y,z}="${x,y,z}"

stderr: 


dash9 shift is fatal at top level?


stdout: 


stderr: 


dash: 1: shift: can't shift that many

mksh9 shift is fatal at top level?


stdout: 


stderr: 


mksh: shift: nothing to shift

ksh9 shift is fatal at top level?


[ksh stdout] Expected 'hello\n', got ''

[ksh status] Expected 0, got 1



stdout: 


stderr: 


E: ksh: shift: nothing to shift

dash11 IFS - http://landley.net/notes.html#05-03-2020


stdout: 


=one=
=abc=
=d f=
=ghi=
---
=one=
=two=

stderr: 


ash11 IFS - http://landley.net/notes.html#05-03-2020


stdout: 


=one=
=abc=
=d f=
=ghi=
---
=one=
=two=

stderr: 


zsh11 IFS - http://landley.net/notes.html#05-03-2020


stdout: 


stderr: 


toysh11 IFS - http://landley.net/notes.html#05-03-2020



[toysh stdout]
Expected '=one=\n=abc=\n=d f=\n=ghi=\n---\n=one=\n==\n=two=\n'
Got      ''


[toysh status] Expected 0, got -6



stdout: 


stderr: 


munmap_chunk(): invalid pointer

brush11 IFS - http://landley.net/notes.html#05-03-2020



[brush stdout]
Expected '=one=\n=abc=\n=d f=\n=ghi=\n---\n=one=\n==\n=two=\n'
Got      '=one=\n=abc=\n=d=\n=f=\n=ghi=\n---\n=one=\n=two=\n'




stdout: 


=one=
=abc=
=d=
=f=
=ghi=
---
=one=
=two=

stderr: 


osh11 IFS - http://landley.net/notes.html#05-03-2020



[osh stdout]
Expected '=one=\n=abc=\n=d f=\n=ghi=\n---\n=one=\n==\n=two=\n'
Got      '=one=\n=abc=\n=d f=\n=ghi=\n---\n=one=\n=two=\n'




stdout: 


=one=
=abc=
=d f=
=ghi=
---
=one=
=two=

stderr: 


dash12 IFS=x and '' and unquoted $@ - reduction of case above - copied into spec/word-split


stdout: 


['one', 'two']
-one-
-two-

stderr: 


dash: 1: setopt: not found

ash12 IFS=x and '' and unquoted $@ - reduction of case above - copied into spec/word-split


stdout: 


['one', 'two']
-one-
-two-

stderr: 


ash: setopt: not found

zsh12 IFS=x and '' and unquoted $@ - reduction of case above - copied into spec/word-split


stdout: 


['one', 'two']
-one-
-two-

stderr: 


toysh12 IFS=x and '' and unquoted $@ - reduction of case above - copied into spec/word-split


[toysh stdout] Expected "['one', '', 'two']\n-one-\n--\n-two-\n", got '[]\n'



stdout: 


[]

stderr: 


sh: setopt: No such file or directory
set: bad --

brush12 IFS=x and '' and unquoted $@ - reduction of case above - copied into spec/word-split


[brush stdout] Expected "['one', '', 'two']\n-one-\n--\n-two-\n", got "['one', 'two']\n-one-\n-two-\n"



stdout: 


['one', 'two']
-one-
-two-

stderr: 


setopt: command not found

osh12 IFS=x and '' and unquoted $@ - reduction of case above - copied into spec/word-split


[osh stdout] Expected "['one', '', 'two']\n-one-\n--\n-two-\n", got "['one', 'two']\n-one-\n-two-\n"



stdout: 


['one', 'two']
-one-
-two-

stderr: 


  setopt SH_WORD_SPLIT
  ^~~~~~
[ stdin ]:1: Command 'setopt' not found (OILS-ERR-100)

sush13 for loop parsing - http://landley.net/notes.html#04-03-2020


[sush stdout] Expected 'one\ntwo\nthree\n0\ncannot-parse\n', got '2\ncannot-parse\n'



stdout: 


2
cannot-parse

stderr: 


/home/andy/git/oils-for-unix/oils/../../shells/rusty_bash/target/release/sush: line 4: Unexpected token: in
/home/andy/git/oils-for-unix/oils/../../shells/rusty_bash/target/release/sush: line 5: Unexpected token: do
/home/andy/git/oils-for-unix/oils/../../shells/rusty_bash/target/release/sush: line 6: Unexpected token: done

/home/andy/git/oils-for-unix/oils/../../shells/rusty_bash/target/release/sush: line 2: Unexpected token: in

zsh15 IFS - http://landley.net/notes.html#15-02-2020 (TODO: osh)


stdout: 


stderr: 


zsh: xabcxx= not found

brush15 IFS - http://landley.net/notes.html#15-02-2020 (TODO: osh)


[brush stdout] Expected '==\n=abc=\n==\n\n==\n=abc=\n=def=\n==\n', got '=abc=\n\n==\n=abc=\n=def=\n==\n'



stdout: 


=abc=

==
=abc=
=def=
==

stderr: 


osh15 IFS - http://landley.net/notes.html#15-02-2020 (TODO: osh)


[osh stdout] Expected '==\n=abc=\n==\n\n==\n=abc=\n=def=\n==\n', got '==\n=abc=\n==\n\n=abc=\n=def=\n'



stdout: 


==
=abc=
==

=abc=
=def=

stderr: 


zsh16 IFS 2 - copied into spec/word-split


stdout: 


stderr: 


zsh: x   abc   def   = not found

osh16 IFS 2 - copied into spec/word-split


[osh stdout] Expected '=x=\n=abc=\n=def=\n==\n', got '=x=\n=abc=\n=def=\n'



stdout: 


=x=
=abc=
=def=

stderr: 


zsh17 IFS 3


stdout: 


onextwoxxthree

stderr: 


brush17 IFS 3


[brush stdout] Expected 'one two  three\n', got 'one two three\n'



stdout: 


one two three

stderr: 


bash18 IFS 4


stdout: 


/ /
--

/x/
-=-
-=-

stderr: 


bash: line 1: setopt: command not found

zsh18 IFS 4


stdout: 


/ /
--
--

/x/
-=-
-=-

stderr: 


toysh18 IFS 4


[toysh stdout] Expected '/ /\n\n/x/\n-=-\n-=-\n', got '//\n\n/x/\n-==-\n'



stdout: 


//

/x/
-==-

stderr: 


sh: setopt: No such file or directory

sush18 IFS 4


[sush stdout] Expected '/ /\n\n/x/\n-=-\n-=-\n', got '/ /\n--\n\n/x/\n-=-\n-=-\n'



stdout: 


/ /
--

/x/
-=-
-=-

stderr: 


/home/andy/git/oils-for-unix/oils/../../shells/rusty_bash/target/release/sush: line 1: setopt: command not found

zsh19 IFS 5


stdout: 


stderr: 


cc: = not found

zsh20 Can't parse extra }


stdout: 


stderr: 


zsh:1: parse error near `}'

mksh20 Can't parse extra }


stdout: 


stderr: 


123: syntax error: '}' unexpected

ksh20 Can't parse extra }


[ksh status] Expected 2, got 1



stdout: 


stderr: 


E: 123: syntax error: unexpected '}'

zsh21 Command Sub Syntax Error


stdout: 


stderr: 


zsh: parse error near `true'
zsh: parse error in command substitution

mksh21 Command Sub Syntax Error


stdout: 


stderr: 


mksh: <stdin>[1]: syntax error: ')' unexpected

ksh21 Command Sub Syntax Error


[ksh status] Expected 2, got 1



stdout: 


stderr: 


E: ksh: <stdin>[1]: syntax error: unexpected ')'

toysh21 Command Sub Syntax Error


[toysh stdout] Expected u'', got '\n0\n\n0\n'

[toysh status] Expected 2, got 0



stdout: 


0

0

stderr: 


main: line 1: sh: syntax error: unexpected end of file

sush21 Command Sub Syntax Error


[sush stdout] Expected u'', got '2\n\n0\n'

[sush status] Expected 2, got 0



stdout: 


2

0

stderr: 


/home/andy/git/oils-for-unix/oils/../../shells/rusty_bash/target/release/sush: line 2: Unexpected token: )


brush21 Command Sub Syntax Error


[brush stdout] Expected u'', got '\n0\n\n0\n'

[brush status] Expected 2, got 0



stdout: 


0

0

stderr: 


ERROR main: syntax error at end of input

toysh22 Pipeline - http://landley.net/notes-2019.html#16-12-2019


[toysh stdout] Expected 'hello\n-@hello@-\n', got '\n'



stdout: 


stderr: 


sh: sh: read: No such file or directoryread: No such file or directory

sh: read: No such file or directory