Shell Compatibility Reports

These reports are based on spec tests written for Oils.

Here are some summary tables. Click on the column headers to sort:

Total Passing
- Each shell gets 1 point for each case we marked passing.
- Our assertions are usually based on a survey of bash, dash, mksh, zsh, and other shells. Assertions from 2016-2018 may favor OSH, but there shouldn't be many of them.
Delta bash
- Compare each shell's passing count vs. bash
Delta OSH
- Compare each shell's passing count vs. OSH

Some tests may fail for innocuous reasons, e.g. printing '$' versus \$
- Shell authors are welcome to use our test suite, and add assertions.
OSH has some features that bash doesn't have.
- e.g. I removed spec/strict-options so shells aren't penalized for not having these features.
- But I left spec/errexit-osh in because I think new shells should provide alternatives to the bugs in POSIX: YSH Fixes Shell's Error Handling (errexit)
- I also think shells should adopt Simple Word Evaluation in Unix Shell (i.e. deprecate $IFS, more so than zsh)
Other ideas
- We could add a "majority agreement" metric, for a more neutral report.
- We could add the Smoosh test suite. Results are published on our quality page.

GNU bash
- https://www.gnu.org/software/bash/
- running fixed version built for Oils
mksh - shell on Android, derivative of pdksh
- http://www.mirbsd.org/mksh.htm
- running fixed version built for Oils
AT&T ksh
- https://github.com/ksh93/ksh
- running distro package
toysh
- https://landley.net/toybox/
- running tarball release
sush
- https://github.com/shellgei/rusty_bash
- running git HEAD
brush
- https://github.com/reubeno/brush
- running git HEAD
osh
- https://github.com/oils-for-unix/oils
- running git HEAD

TODO: Add other shells, and be more specific about versions.

Possibly TODO

Binary size
Build times
Lines of code?
- Oils has a "compressed" implementation
Memory safety
Oils has many other:
- test suites - test/gold, test/wild, ...
- benchmarks - parse time, runtime, ...

We know about these gaps: