6

GitHub - onnokort/semu-c64: Linux on a Commodore C64

 1 year ago
source link: https://github.com/onnokort/semu-c64
Go to the source link to view the article. You can view the picture content, updated content and better typesetting reading experience. If the link is broken, please click the button below to view the snapshot at that time.
neoserver,ios ssh client

Running Linux on a Commodore C-64

"But does it run Linux?" can now be finally and affirmatively answered for the Commodore C64!

Booted

There is a catch (rather: a couple) of course: It runs extremely slowly and it needs a RAM Expansion Unit (REU), as there is no chance to fit it all into just 64KiB.

It even emulates virtual memory with an MMU.

I have not tested it on real hardware yet, that's the next challenge .. for you. So please send me a link to a timelapse video of an original unit with REU booting Linux :D

ChangeLog / Updates

Aug 28th 2023, Optimizations!

First of all, I like to correct a mistake: The measurement of 300 RISCV32-Mcycles of boot time which I stated on reddit is rather inaccurate. I measured it by a simple manual checking when to stop the emulation (with a limit on the vm.insn_count variable) and checked it to "about when I could" login with the PC build of the simulator. That is, of course, more than just "boot time" and also includes actual run time after boot and I underestimated the time it would take me to kill the PC emulator. IOW, I didn't intend to throw dirt onto Linux :D

I have changed the code now to optionally enable a stop when the string buildroot login: is encountered on the simulated UART. This is of course, not really an elegant way to do it, but it works and it gives 100% repeated cycle count numbers when the boot process is emulated on PC. I really like semu as an emulator (and have other ideas what one could do to with it which are more practically oriented), however there is a lot of additional tooling which could be implemented around it.

Measuring the new way, I now get: VM RISCV insn count: 137085690

for the "v0.0.1 release" (LOL), so 140Mcycles. With enabling cramfs (and I hope also with XIP, though one should check that), this melts down considerably, to:

VM RISCV insn count: 94748399

about 95Mcycles which is a nice 30% improvement on the 'guest side'. With the rough cycle count ratio which I posted on reddit of about 1500 6510 ticks for each RISCV32 instruction, boot time with the V0.0.1 semu and the new kernel on a real C64 should now be close to 142.5ksec, or 1.65 days.

Then, I further set the compiler flag -O3 instead of -Os, which surprisingly also does what one expect even for llvm-mos, and I got another improvement of about 5.3% runtime on the emulator side, albeit with a considerable code size increase.

This reduces further by about 4.2% using a recent git of llvm-mos where the author fixed a subexpression elimination bug when doing bit shifts on long words (which the emulator does - a lot).

A further nice ~3.9% improvement could be had by moving key emulator variables to the zero page. But this means that the codebase can not be easily kept in sync with upstream anymore, for the time being, I'll push that to a branch named hackopt.

I believe these are about the lowest hanging fruit there are to get the figures better, but pull requests are welcome of course. Taken together, this should speed up everything to about 59% of V0.0.1 with V0.0.2 now, or about 1d 10.5h.

I further noticed during tests that my MMU cache implementation ironically does not really work for the C64 (though was inspired by it), as llvm seems to miss a few key cross-function optimizations. So this needs improvement and the C-64 is now stuck at the adhoc single-level MMU-lookup cache for fetch, store, load that it already has.

Note further that, though I have checked the initial release to run through to the prompt on Vice, though might not do this for the sake of my own sanity for each and every release I post here. Consider all of them highly experimental and not fit for production work ;-)

Building it

Just use make. You need mos-c64-clang.

Change the single C64 variable at the top of the Makefile and you should be able to switch between a x86_64 and an llvm-mos-6502 build of the code.

The notes from the original README apply for the most part. The kernel configuration is different, though, as the kernel from the original semu is too bloated with huge section alignments. A more fitting kernel configuration can be found in the config subfolder. Finally, to assemble it all into the REU image needed for the VICE emulator, use the mk_linux_reu.py script. It still uses the original initrd image, as that works just well.

Running it

To run it, simply create a .d64 file containing the compiled semu executable (or simply select the correct path for a virtual disk drive in the emulator). Then (in VICE EMU), go to Preferences | Settings | Cartridges | RAM Expansion Module, enable it and select the file reufile.linux, and make sure to select the correct size (16MiB) as well. If you started x64 from the console, a message that it loaded successfully should appear.

Then, do LOAD "SEMU",8,1 and run and ... wait ... (hours!). With "warp mode" enabled in the emulator, the first boot messages should appear within a few minutes, though.

You can also use the PC semu binary with the -k option to load the reufile.linux into the PC emulator and you should get a 100% identical boot sequence, as everything should be deterministic until the first keypress.

I plan to add an archive with all the neccessary premade binaries as soon as I figured out how to do that on github. Look for something on the "Releases" tab.

Further notes

  • The screenshots took VICE a couple hours in "warp mode" (activate it with Alt-W) to generate. So, as is, a real C64 should be able to boot Linux within a week or so.

  • The compiled 6502 code is not really optimized yet, and it might be realistic to squeeze a factor 10x of performance out of this. Maybe even a simple form of JIT compilation? It should also be possible to implement starting a checkpointed VM (quickly precomputed on x86-64) to avoid the lengthy boot process. Maybe X on an emulated framebuffer device in 320x200 graphics mode? VIC-II DRI? :D

  • I also tested a minimal micropython port (I can clean it up and post it on github if there is interest), that one does not use the MMU and is almost barely remotely usable with lots of optimism at 100% speed...

  • The generated semu executable is a generic RISCV32 emulator and it simply assumes that the REU maps to the address range 0x00000000 .. 0x01000000. You should be able to compile any (embedded, bare-bones) RISCV32 executable that uses just the emulated UART, fill it up to a size of 16MiB, load it as a REU-image into VICE and run it using the same semu 6510 binary.

  • Likewise, I made a simple kernalemu fork with "REU support" which seems to run a lot faster than Vice.

  • The emulated UART does upper-/lowercase PETSCII<->ASCII translation. That could use a lot of improvement, though ...

Thanks

This is in essence a fork of the very nicely minimalist RISC-V32 emulator named semu, compiled and ported using the new llvm-mos and would not have been possible without all that previous work.

(Boot animation)

(Boot animation)

Time not to scale.


About Joyk


Aggregate valuable and interesting links.
Joyk means Joy of geeK