The Transterpreter Project

Concurrency, everywhere.


Test Suite, continued

A little more work on Christian's part, and by the end of the day the Transterpreter was passing even more of the CG test suite. While the number of tests that have Crashed seems awfully high, it is important to note that we handle a huge proportion of the "typical" cases, and the crashing cases almost always involve instructions which have not been implemented yet. So, while the number of suites that crash seems high, passing 3920 tests in the CG suite is no small accomplishment. It means the machine is sound in the general case, and we simply need to implement or debug individual (and uncommon) instructions to improve our conformance to the test suite. Completely Passed:
  • cgtest01.occ
  • cgtest02.occ
  • cgtest03.occ
  • cgtest04.occ
  • cgtest05.occ
  • cgtest16.occ
  • cgtest27.occ
Passed: 3920 Failed: 11
  • cgtest00.occ (TAB2 R10 E6)
  • cgtest07.occ (M200)
  • cgtest08.occ (TA5 TA3)
  • cgtest57.occ (FNARR24 FNARR23 FNARR22 FNARR13)
  • cgtest67.occ (xxx)
Crashed 27 (Oh, and we can run the suite now and walk away. That, too, is a good thing. It downloads the entire source of the project, compiles it, and then builds and runs each program in the test suite. I believe that's the way you want it to work.)

Metadata

  • Posted: February 5, 2005
  • Author: Matthew Jadud
  • Comments: None
  • Tags: None