A 64-bit x86 teaching kernel that carries its own toolchain. You can write a C program inside the running system, compile it, link it and execute it without leaving the machine.
I have implemented a primitive desktop environment within MiniOS that operates independently of the serial console. This subsystem provides a graphical user interface (GUI) with window management, mouse support, and scrollable terminal emulation.
- Shell in VGA: Handles basic shell and focus in VGA mode to avoid serial mode
- Mouse Integration: Full PS/2 mouse driver support with hardware cursor rendering.
- Scrollable Terminal: A virtual terminal emulator capable of handling large buffers and scrollback history via mouse wheel or keyboard shortcuts.
- Speaker's Sound: Sound support to speaker
The desktop now supports PNG icons (via stb_image) that can be placed and launched from the graphical shell. Immediate-mode UI is powered by Nuklear, giving windows, buttons and widgets without a retained-mode toolkit. A low-code tool lets you author CVM modules in a simplified form that compile straight to bytecode and run natively on the CVM (with the existing JIT). Additional support includes xxHash for fast hashing and experimental TFT display output alongside the VESA framebuffer.
VGA-mode behaviour (the mouse cursor, window drag, title-bar buttons, the
desktop compositor, and the return-to-desktop transition after a ring-3
program) must be exercised with tools/minios_gui.py, never headless.
Headless boots cannot observe or trigger these events, so a GUI bug verified
by hand or assumed from code is not reproduced.
tools/minios_gui.py boots QEMU with the emulated std VGA device (the
linear framebuffer the desktop renders into), a QMP socket to inject PS/2
mouse motion, clicks and keyboard, and a pty serial console to drive the
shell. After each action it saves the current framebuffer to a PNG via QMP
screendump, so a crashed desktop, a vanished cursor or a corrupted window
is visible:
python3 tools/minios_gui.py send "doomgeneric.elf" sleep 10 \
key esc key down key down key down key down key down key ret key y \
dump after_doom
Actions: send LINE, mouse DX DY, click, key QCODE, dump NAME,
sleep SECS. The serial console is on a pty; the kernel's gfx/gfx pixel x y commands probe the framebuffer state over serial (mouse present,
position, palette index at a pixel), which is the text backstop when an
image viewer is unavailable.
miniOS> edit src/p.c
edit> a
int main(void) { return 7; }
edit> x
miniOS> run objects/minigcc.o src/p.c > asm/p.s
miniOS> run objects/ld.o -f elf -o bin/p.elf asm/p.s
miniOS> run objects/ld.o -f cvm -o cvm/p.cvm asm/p.s
miniOS> run bin/p.elf
exit code: 7
miniOS> run cvm/p.cvm
exit code: 7
miniOS>
The bottom taskbar is a live status strip, not a hint line:
- Clock: reads the CMOS RTC (
rtc.c) and showsHH:MM:SS, redrawn when the second changes. A failed RTC read leaves the clock region blank rather than showing a stale time. The shelldatebuiltin prints the same clock over the serial console. - Volume: a master volume
0..100(pcspk.c). The PC speaker has no hardware amplitude and the kernel does not drive a PWM carrier, so the volume is a mute switch: the tone opens the speaker only when the volume is above 0 (identical to the pre-volume driver), and at 0 the speaker is silent. A click on the speaker icon toggles mute; the-/+buttons step the volume. The shellvol [0-100]builtin reads and sets the same state, so the desktop and the serial console can never disagree.
Alt is the WM modifier. From the desktop:
| Shortcut | Action |
|---|---|
| Alt+Enter / F11 | toggle fullscreen |
| Alt+Arrow keys | snap the window to a screen half |
| Alt+Home / Alt+End | snap to the top-left / bottom-right quadrant |
Alt+[ / Alt+] |
shrink / grow width |
Alt+- / Alt+= |
shrink / grow both dimensions |
| Alt+0 / F5 | reset the window to its default position (and size) |
| Ctrl+Arrow keys | nudge the window by one cell |
The window keeps its size across redraws, so a snap or resize persists instead of snapping back to the default.
The shell runs in a titled, movable window on the desktop, not on the whole screen:
- Title bar ("MiniOS Terminal"): drag it with the left mouse button to move the window, it stays under the pointer, and the terminal content and prompt survive the move.
- Scrollbar on the window's right edge: the mouse wheel scrolls through the scrollback history, and a left click on the scrollbar jumps the view to that position.
- Adaptive content: the terminal keeps its whole history as logical lines and re-wraps them at the current window width on every draw, so resizing or snapping re-flows the text instead of clipping it. A long wrapped line is stored whole and re-wraps cleanly at any width, and the live screen and the scrollback view always agree (no artifacts when scrolling over existing output).
- Move and resize from the mouse: Alt+
[/]change the width, Alt+-/=change both dimensions, and the arrow/Home/End tiling keys above re-position and re-size the window. Alt+0 / F5 reset it to the default geometry. - Fullscreen with F11 or Alt+Enter.
Moving, snapping and resizing never lose the current screen: the prompt and any typed or echoed text are re-rendered from the logical buffer at the new position and size.
MiniOS is one of four projects that together make up the system. This repository holds the kernel, the boot path and the ramdisk; the toolchain it carries lives next door.
| Repository | Role |
|---|---|
| miniOS | this repository: kernel, two-stage boot path, ramdisk, shell, editor |
| miniGCC | C compiler: C to x86-64 AT&T assembly |
| ld | assembler and linker: assembly to a Linux ELF or a CVM module |
| cvm | the CVM / cvm2 bytecode interpreter |
The ramdisk ships prebuilt objects in progs/, so make produces a bootable
image with nothing else installed. To build the whole system from source
instead, clone the other three next to this one:
make sources # clone the missing repositories from GitHub
make toolchain # build minigcc, ld and cvm2 from those sources
make # rebuild every ramdisk object and os.imgmake sources never touches a directory that already exists, so a checkout
with local work is left alone. make sources-update pulls the latest commit
of each before rebuilding, and make sources-status shows which revision
each one is sitting on.
Expected layout: the directory holding this repository can have any name:
src/
├── miniOS/ (this repository)
├── miniGCC/
├── ld/
└── cvm/ with cvm/cvm2 inside
Point the build somewhere else with MINIGCC_DIR=, LD_DIR=,
CVM_REPO_DIR= or CVM_DIR=; change where make sources clones from with
MINIGCC_URL=, LD_URL= or CVM_URL=.
Everything on the ramdisk is regenerated from source by make: objects/minigcc.o,
objects/ld.o and objects/cvm.o are compiled from the sibling checkouts, and
the demo programs (fib, w1, minigcc) are compiled from this repository's
own C sources in progs/src/ through the full miniGCC-to-ld chain. Nothing in
the image is a binary you have to take on trust.
The compiler on the ramdisk is self-hosted: bin/minigcc.elf was compiled by
minigcc itself (generation 3) and linked by ld (no GNU as/ld anywhere after
generation 1), and make selfhost verifies the bootstrap fixed point on the
host. Inside the OS the self-hosted compiler drives the same edit/compile/
link/run loop as objects/minigcc.o.
make # builds os.img
make run # boots it in QEMU with a display
make run-kvm # boots it with KVM acceleration
make run-headless # boots it headless on the serial console (no GUI window)
make serial # boots it headless on the serial console
make test # behavioural suite (QEMU + serial console)
make selfhost # compile minigcc with minigcc, link with ld, check fixed pointThe default make run uses no acceleration (TCG). Use make run-kvm for
KVM. There is a real trade-off, and it is deliberately left to the user:
| Workload | TCG (make run) |
KVM (make run-kvm) |
|---|---|---|
CPU-bound (ring-3 GUI: piano --bench) |
~20 fps | ~60 fps |
| IDE disk I/O (loading DOOM's WAD) | seconds | ~30 s |
KVM makes pure CPU-bound work much faster, but every IDE PIO port access becomes a VM-exit, so disk-heavy loads are slower than under TCG, which handles port I/O inline. The IDE driver was optimized to reduce those exits (see below), which took DOOM's load from ~5 minutes to ~30 s under KVM, but the remaining data-transfer reads are inherent to PIO.
The image is attached as an IDE disk. The boot path uses INT 13h extended (LBA) reads, which floppy emulation does not provide.
- IDE PIO driver (
ide.c):ide_delayused to read the IDE control register 1000 times per call as a crude timer, andide_select_drivecalled it twice per sector. Under KVM that turned a 4 MB WAD load into millions of VM-exits (~5 minutes). It is now a short CPU pause loop, which cut DOOM's load to ~30 s under KVM while keeping TCG fast. - Block cache (
block.c): a direct-mapped write-through cache of recently-read disk blocks. MiniFS's directory iteration re-reads the same directory block for every entry (lsfswas O(entries x blocks) in disk reads); the cache turns that into one read per directory block plus one per touched inode. - Console output (
vga_fb.c): the windowed terminal redrew the whole active line for every printable character (100 000 chars took ~14 s). It now draws only the changed cell, solsand all console output are fast. - SB16 DMA buffers (
sb16.c,stage2.S,bootdefs.h): the DMA ring[0x90000, 0x94000)is marked uncacheable (PCD) in the boot page tables so the 8237 DMA controller reads freshly written PCM instead of stale cache. The DSP write wait no longer burns a 100 000-iteration port-read spin on the wrong status bit. - SB16 timer watchdog (
sb16.c,sched.c): DMA completion is driven by the SB16 IRQ and a timer-ISR watchdog (sb16_poll). QEMU raises the completion IRQ only once its audio engine consumes a transfer, so a host backend that never consumes left the 7-slot ring filled forever and every later submit refused (the piano buzzed / fell silent). The watchdog re-arms on elapsed guest time, andsb16_armrate-limits both paths to one re-arm per buffer, so the ring always drains at the declared rate. Thesb16builtin reports the counters (irq_arms,poll_arms,submits,drops). - Syscall trace flood (
kernel.c):trace onno longer printsSYS_TIME/SYS_KBD/SYS_MOUSE(clock/poll reads a pacing loop hammers thousands of times a second). Tracing those made an interactive program a 100 ms-per-syscall crawl under TCG; the rest are traced one-to-one. - Multi-sector IDE PIO (
ide.c):ide_read_sectors/ide_write_sectorsissue one command withSECCOUNT = countinstead ofcountsingle-sector commands, cutting the per-sector command-setup port traffic of bulk loads. Data is still pulled word-by-word through the PIO data port, so the remaining minifs load time is bounded by QEMU's 16-bit-only IDE port.
The kernel owns an rtl8139 NIC under QEMU user networking (slirp): Ethernet,
ARP, IPv4, ICMP echo, UDP, DNS and a client TCP (SYN handshake, stop-and-wait
with retransmissions, FIN teardown). net shows the counters and
net ping 10.0.2.2 sends one ICMP echo.
On top of TCP the kernel speaks TLS 1.2 as a client
(tls_handshake/tls_send/tls_recv, MiniOS syscalls 201-203):
ECDHE-RSA/ECDSA with AES-128-GCM, certificate chains verified down to 8
embedded public roots, hostnames checked against SAN or CN with
single-label wildcards. Real-world browsing works from the shell:
miniOS> run bin/freedom https://duckduckgo.com
miniOS> run bin/freedom mini os kernel # DuckDuckGo search over https
miniOS> run bin/freedom https://en.wikipedia.org/wiki/Mini
miniOS> run bin/freedom --dump-dom https://example.com
miniOS> run bin/freedom --dump-css https://example.com
bin/freedom is the headless text browser: a curlfree-style HTTP engine
with a FreeDom-style omnibox (an argument that is not a URL is a DuckDuckGo
search; bare hosts are fetched as https://), redirect chasing, chunked
decoding, an HTML-to-text filter, and --dump-css/--dump-dom headless
dumps. The crypto and the roots are host-tested by make test-tls (fixed
vectors plus full TLS 1.2 handshakes against OpenSSL-driven servers,
including the negative set).
| Command | Purpose |
|---|---|
help |
command summary |
ls |
list directory entries |
cat <file> |
print file contents |
echo <text> |
print text to the console |
mkdir <name> |
create a directory entry |
rm <file> |
delete a ramdisk file |
pwd |
print the current working directory |
cd [dir] |
change directory (bare cd goes to root) |
edit <file> |
line editor |
load <file> |
load an ELF (.o relocatable, or a Linux executable) |
run <name|file> [args] |
run a program, an ELF or a .cvm module |
<cmd> [args] |
run an ELF from bin/<cmd>: the Linux-style command path |
<cmd> > <file> |
redirect command output to a ramdisk file |
<cmd> >> <file> |
append command output to a ramdisk file |
date |
print the CMOS clock (HH:MM:SS), the same clock the taskbar shows |
vol [0-100] |
print the PC-speaker volume; with an argument, set it |
net |
network status (MAC, IP, counters) |
net ping <ip> |
send one ICMP echo |
net dns <host> |
resolve a DNS A record |
catfs <file> |
print a file from the MiniFS filesystem |
lsfs |
list files on the MiniFS filesystem |
hash <file> |
print XXH64 checksum of a file |
ps |
list registered programs (name, kind, entry address) |
sb16 |
Sound Blaster 16 diagnostics (presence, mode, ring fill, counters) |
trace / trace on / trace off |
enable or disable syscall tracing |
wm state |
print window manager state |
wm minimize |
minimize the terminal window |
wm maximize |
toggle fullscreen |
wm close |
close the active window |
piano |
FM piano GUI (--selftest for headless, --bench for fps) |
topogpt3 |
TopoGPT3 transformer inference engine (-i for interactive) |
clear / poweroff |
console and power |
Redirection captures what the command writes, not what the shell reports
about it, so run objects/minigcc.o p.c > asm/p.s yields assembly a linker
can consume.
bin/cp is a command-path utility: cp src/fib.c x.txt copies a ramdisk
file without run or load. It is compiled from this repository's own
progs/src/cp.c through the miniGCC-to-ld chain, and the source ships on
the ramdisk as src/cp.c, so the utility can be rebuilt inside the OS by
the OS.
bin/lzss and bin/unlzss are the Okumura LZSS (de)compression tools, both
built from a single progs/src/lzss.c: lzss rep.txt rep.lzs compresses,
unlzss rep.lzs rep.out decompresses, and the binary picks its mode from
argv[0] (unlzss decodes; -d forces decode). The on-disk format is a
fail-closed LZS1 magic plus the original size; decoding rejects a bad
magic, a truncated stream and any declared size beyond the expansion bound
derived from the input length, so a hostile header can never drive an
oversized allocation.
bin/lz4 and bin/unlz4 are the LZ4 (de)compression tools, also built from a
single progs/src/lz4.c: lz4 rep.txt rep.lz4 compresses and unlz4 rep.lz4 rep.out decompresses, with the same argv[0]/-d dispatch as
lzss. The codec lives in the kernel (lz4_kernel.c, the same one MiniFS
uses), so the tools are thin front-ends over the MiniOS syscalls 216/217 and
the on-disk block is exactly the MiniFS LZ4 block format: a 4-byte
little-endian original size followed by the raw LZ4 stream, so lz4 output
interops with the filesystem's own blocks.
bin/aes and bin/unaes are AES-256-CTR file encryption tools built from a
single progs/src/aes.c, shipped on MiniFS like DOOM and MicroPython:
aes <key-hex64> <nonce-hex32> <src> <dst> encrypts and the matching
unaes ... decrypts. The S-box is generated procedurally from the GF(2^8)
inverse plus the FIPS-197 affine transform (no magic tables), the mode is
CTR with no padding, and the fail-closed AES1 container detects bad magic,
truncation and size tampering. CTR gives confidentiality only, pair it
with a MAC if you need integrity.
unzip and zip are shell builtins that read and write ZIP archives through
the miniz library (vendored as third_party/miniz/). zip <out.zip> <file...>
stores files with default compression; unzip <archive.zip> [dir] extracts
into a directory (default cwd); unzip -l <archive.zip> lists entries. Entry
names hostile data: traversal paths, absolute paths and empty components are
all rejected, so a crafted archive can never write outside the target
directory.
json (progs/src/json.c) is a self-contained JSON validator, pretty-printer
and query tool. json <file> validates and pretty-prints; json <file> <path>
prints the value at a dotted path (.a.b, .a.3). The parser is fail-closed:
truncated input, unbalanced braces and unknown escapes all produce a diagnostic
and exit 1.
edit <file> opens a line editor over a ramdisk file.
| Key | Action |
|---|---|
h |
help |
l |
list the buffer |
p N |
print line N |
e N |
replace line N with the next line typed |
a |
append the next line typed |
i N |
insert before line N |
d N |
delete line N |
w |
save |
x |
save and quit |
q |
quit, refusing to discard unsaved changes |
q! |
quit, discarding changes |
A file too large for the buffer is loaded read-only: the editor refuses to write it back rather than silently dropping the part it never read.
MiniOS runs three kinds of program:
- Relocatable objects (
.o): linked at load time against the kernel's libc symbol table. They run at ring 0 as kernel extensions.objects/minigcc.o,objects/ld.oandobjects/cvm.oship this way. - Linux executables (
ET_EXEC/ET_DYN): static binaries run unmodified through the x86-64syscallABI at ring 3 under hardware page protection. A binary built on the host can be used simply by copying it onto the ramdisk. This is how DOOM, Quake 2, Lua, MicroPython, and TopoGPT3 run. - CVM modules (
.cvm): stack bytecode produced byld -f cvmand executed by the cvm2 interpreter inobjects/cvm.o. An x86-64 JIT compiler compiles each module to native code at load time; the output is identical to the interpreter and the JIT is transparent to the user.
Every .cvm module is compiled to native x86-64 code at load time by a
baseline JIT. The JIT is transparent: output is byte-identical to the
interpreter, and the full miniGCC compiler (minigcc.cvm) runs correctly
under JIT inside the OS.
The JIT compiles each function independently into a native code buffer on the kernel heap (executable via 2 MB pages). Cross-function control flow (CALL/RET) uses the interpreter's frame stack, so the ABI is unchanged. If JIT initialization fails, the interpreter takes over transparently.
On the host the JIT buffer uses mmap (RWX); inside MiniOS it uses
malloc (the kernel heap is already executable). Source files:
cvm_jit.c (compiler), cvm_jit_x86.c (x86-64 emitter),
cvm_jit_help.c (runtime helpers).
The ramdisk ships organized by kind, and the shell's ls <dir> lists each
directory:
| Directory | Contents |
|---|---|
objects/ |
ET_REL toolchain: minigcc.o, ld.o, cvm.o, demo .o |
bin/ |
Linux ELFs + command-path utilities (cp, freedom, micropython, topogpt3) |
cvm/ |
CVM modules: fib.cvm, w1.cvm, minigcc.cvm |
src/ |
C sources for every program on the ramdisk |
asm/ |
miniGCC assembly (*.s) for the toolchain-built programs |
docs/ |
HTML and other documentation fixtures |
topogpt3/ |
TopoGPT3 model: topogpt3.c, topogpt3.fp16 (47 MB weights), vocab.bin |
The ramdisk is flat, the / in a name is data, and mkramdisk.py derives
each name from the path relative to progs/.
MiniOS ships a doomgeneric port that runs DOOM as a static Linux ELF at
ring 3. The engine compiles from progs/doomgeneric/ with the platform
layer in doomgeneric_minios.c. The desktop runs on a VESA linear
framebuffer (800x600x8 by default, falling back to 640x480 and Mode 13h);
DOOM renders its 320x200 frame into a kernel back-buffer and the kernel
composites it onto the desktop in a titled window (SYS_DOOM_FRAME, 211),
centered on the screen, so the shell window stays visible while you play.
The shareware WAD (doom1.wad) is bundled on the minifs.
miniOS> run doomgeneric.elf
| Key | Action |
|---|---|
| WASD | move |
| Ctrl | fire |
| Space | use / open |
| Arrow keys | turn / strafe |
| 1-7 | weapon select |
| Shift | run |
| Esc | menu |
Sound effects play through the QEMU PC speaker: the kernel drives PIT
channel 2 (ports 0x42/0x43) plus the gate bit on port 0x61, and the sound
module in i_minios_sound.c maps each DP lump (1-byte frequency index +
1-byte duration in 70 Hz ticks, after a 2-byte priority) through the
original Doom PC-speaker frequency table. QEMU must wire the PC speaker
to the audio backend, -machine pc,pcspk-audiodev=<id> in addition to
-audiodev <backend>,id=<id> (the run target sets both via
QEMU_AUDIO). A bare -audiodev alone routes nothing, so the beeps are
silent without the machine option.
The level music also plays on the same PC speaker with NES-style
pseudo-polyphony. A music_pcspeaker_module in i_minios_sound.c decodes
each MUS lump (the Doom music format, D_E1M1 etc. at the stock 140
ticks/sec) straight from its interleaved event stream, splits the sounding
notes the way a NES split its voices: the lowest bass note becomes a
sustained pedal (the triangle voice) while only the top few melody notes
are fast-arpeggiated round-robin, holding each for 7 ms. The ear hears a
strummed chord with a solid bass foundation instead of every voice chopped
at equal length, the chiptune broke-chord trick, applied so dense
arrangements stay clear. The module is
picked when snd_musicdevice is the PC speaker, and S_UpdateSounds was
re-enabled in d_main.c so both the sfx note sequencer and the music
decoder are advanced each frame (they were previously never polled).
The binary is built with the host toolchain (static, no-pie) and placed
at bin/doomgeneric.elf on the minifs. To rebuild from source:
make doomgeneric.elf # or just `make` to rebuild everythingThe kernel provides four custom syscalls for the port: time_ms (204),
kbd (205), palette (206) and kbd_raw_mode (207). VGA Mode 13h is
entered through sys_vga_mode (208), which tells the kernel to stop
touching VGA text hardware while the game runs.
MiniOS ships a quake2generic port that runs Quake 2 as a static Linux ELF at
ring 3. The engine compiles from progs/quake2generic/ with the platform
layer in q2generic_minios.c. It reuses the DOOM back-buffer infrastructure:
the software renderer writes 320x200 8-bit paletted pixels into the kernel
back-buffer at DOOM_BACKBUF_ADDR (0x0B000000), and SYS_DOOM_FRAME (211)
composites it onto the desktop as a titled window. The window title is set to
"Quake 2" via SYS_Q2G_SET_TITLE (223).
miniOS> run bin/quake2generic.elf +set basedir .
The engine requires baseq2/pak0.pak on the MiniFS. This image ships the
full retail pak (184 MB, 3307 files), so every campaign mission (Outer
Base, Warehouse, Installation, Command, Boss1/2, Fact, Hangar, Jail, Mine,
Power) and every weapon, item and monster model is present and playable. The
retail player model ships separately as pak1.pak. A small pak2.pak that
aliased the shareware demo maps as base1/2/3 was removed once the full pak
made it redundant.
Controls: WASD to move, Ctrl to fire, Space to use/open, arrow keys to
turn/strafe, the mouse to look, Shift to run, Esc for the menu. Sound is
stubbed (the engine runs silently); the SB16 PCM path could be wired in the
future. Rebuild from source with make progs/bin/quake2generic.elf.
Getting Quake 2 to run was less about the game and more about the memory model the kernel had to grow into. This is the story of those decisions and of the two subtle bugs they uncovered, because they are the kind of bug that only exists after you move a memory map.
Why Quake needs so much memory. The retail Quake 2 loads an entire level's worth of data up front: the BSP world, every model and sprite the mission references, the collision and drawing caches, plus the game's own hunk/zone allocations. With the full 184 MB pak the game reaches for roughly 150-180 MB of the user window while loading a mission. The original layout gave ring-3 programs a 128 MB window and parked the graphics back-buffer inside it at 124 MB, which left the game roughly 120 MB to mmap into. That was never going to be enough, and it failed in the honest way: the game ran out of the window and the loader rejected further allocations.
So the window grew. USER_LOAD_END went from 128 MB to 192 MB, and the
kernel heap moved up to sit right above it (192 MB to 384 MB). Growing the
window has a cascade of costs that all had to be paid together:
- More page tables. The user window runs on eager 4 KB page tables so the
no-execute bit works. A 192 MB window needs 94 page tables (one 4 KB table
per 2 MB PD slot). The page-table zone grew from 256 KB to 384 KB
(
PT_USER_TABLES_BYTES), living at[0x10000, 0x70000), below the kernel image. This zone is the single most dangerous address range in the kernel: it is dedicated, so nothing else may claim a page inside it. - Move the back-buffer up. The DOOM/Quake back-buffer was inside the
window at 124 MB, exactly where the game wants to mmap. It moved up to
176 MB (
DOOM_BACKBUF_ADDR), and the allocators are capped just below it so the game can never mmap over the pages the kernel maps for rendering. - Move KASLR up. The kernel image's random physical base must sit above
the window and the heap.
KASLR_MIN_ADDRrose to 0x1A000000 so the kernel can never land inside either. - More RAM. A 192 MB window, a 192 MB heap and a KASLR range that tops out
near 600 MB simply do not fit in the old 512 MB guest. The image boots with
1 GB (
-m 1G, mirrored intest_bdd.shand the MCP bridge). - A bigger filesystem. The full retail pak is 184 MB. MiniFS grew from 128 MB to 256 MB to hold it, the engine, DOOM and MicroPython together.
With the memory in place the game stopped crashing on allocation and started loading missions. Two bugs remained, and both were invisible until the map grew, which is exactly why they are worth writing down.
Bug one: the syscall trampoline silently downgraded the game to ring 0.
The syscall entry decides how to return by inspecting the restored stack
pointer: if it lies inside the user window it returns to ring 3 with
sysretq, otherwise it returns to ring 0 with jmp *%rcx (the contract for
the ring-0 .o toolchain). The window bounds for that decision,
USER_WIN_HI, were still 0x07400000 (116 MB) after the window grew to
192 MB. The game's stack sits at the top of the window, near 192 MB, so
every syscall saw rsp >= USER_WIN_HI and took the ring-0 return path. The
game ran in supervisor mode for its whole life. The tell was the crash dump:
cs=8 (kernel) with a user stack pointer, a combination that is impossible
for a real ring-3 fault, and it could only mean the game had been running at
ring 0. The fix was a one-line correction: USER_WIN_HI to 0x0C000000.
This matters beyond Quake: any ring-3 program whose stack sits high in a
grown window would silently lose its protection.
Bug two: the LAPIC page directory erased the user window's page tables.
Every boot, smp_init parks a dedicated page directory for the local APIC
and zeroes it. It was parked at physical 0x60000, which the comment called
"the dead boot staging buffer." It had been dead, until the page-table zone
grew. Index 82's user page table (the slot that maps roughly 165 MB of the
window) now lives at exactly 0x60000. So on every boot smp_init wrote
zeros over the very page tables that made the game's 165 MB usable, and the
game faulted on a "page not present" the moment its mmap reached that region.
Diagnosis needed three steps: a page-table walk at the fault showed pte=0
while the boot-time dump showed it present; boot-step instrumentation isolated
the zeroing to smp_init; and reading the code found the collision. The fix
moved LAPIC_PD_ADDR to 0x70000, just above the page-table zone and below
the syscall kernel stack. The lesson is the one the memory-map hazard contract
already warned about: the page-table zone is a jigsaw, and a fixed low-memory
address that was "dead" stays dead only until the map grows into it.
The regression that taught the rule. After Quake worked, DOOM showed a
black window while the game ran fine (you could hear it and drive the menu).
Quake and DOOM share the back-buffer infrastructure, so the back-buffer
mapping was not the problem, the address DOOM wrote to was. The kernel and
Quake had moved to 0x0B000000, but DOOM's platform layer still rendered into
the old address 0x7C00000, so the kernel composited an empty buffer. Every
consumer of a moved address has to move together; the fix was one constant in
doomgeneric_minios.c.
The takeaway is not the constants, it is why they are the way they are. A window sized for the biggest ring-3 program, a page-table zone nothing else may touch, a back-buffer above the mmap ceiling, a KASLR range above the heap, and RAM and a filesystem large enough for the payload are not independent tuning knobs. They are one layout, and changing any of them means re-checking every fixed low-memory address that assumed it was alone.
MiniOS ships a ring-3 Nuklear piano that plays through the Sound Blaster 16 driver. The synth is Nuked-OPL3 (a cycle-accurate Yamaha chip emulator), streaming 8-bit mono PCM at 22050 Hz to the kernel's SB16 DMA path via the MiniOS PCM syscalls (221 open, 222 submit). On top of the FM engine the piano adds expressive control: velocity (the click's vertical position sets the carrier output level), a sustain pedal, octave shift, a master volume, and live DSP effects on the mix (echo/delay, tremolo and soft clip), all from an on-screen control bar.
miniOS> piano # GUI: click the keys to play
miniOS> piano --selftest # headless regression hook
miniOS> piano --bench # headless render-loop benchmark (~fps)
--selftest exercises the velocity mapping, sustain hold/release, octave
clamp, every FX stage and the audio pacing constants, and prints
piano: selftest ok. --bench runs the UI render loop for two seconds and
reports frames per second. Audio is rendered for the full wall-clock time
elapsed per frame (clamped to the SB16 ring's ~650 ms backlog) so slow frames
never under-render and starve the ring into a buzz.
MiniOS ships a ring-3 OPL3 FM synthesizer (opl3) built from
progs/src/opl3.c. It is a Nuked-OPL3 (cycle-accurate Yamaha chip emulator)
that streams 8-bit mono PCM at 22050 Hz to the kernel's SB16 DMA path via
SYS_SB16_PCM_OPEN (221) and SYS_SB16_PCM_SUBMIT (222). The demo plays a
scale melody (A3 through C5 and back down) using a 2-operator FM instrument.
miniOS> run bin/opl3
This is a standalone demo of the FM synth engine that powers the piano. It runs headless, produces audio through the SB16, and exits when the melody completes.
mmreuse (progs/src/mmreuse.c) is a ring-3 stress test for the kernel's
mmap and munmap implementation. It maps and unmaps 8 MB regions 64 times and
reports whether the address space leaked. Exit 0 means pass (no leak);
exit 1 means a map failed (address space exhausted).
miniOS> run bin/mmreuse.elf
exit code: 0
perf is a shell builtin that measures raw CPU speed, the sys_time clock
and console output throughput, pinpointing where guest time goes. sbtone
is a headless ring-3 program that streams a clean 440 Hz sine to the SB16
and reports submit throughput, isolating the audio path from any GUI. sb16
prints the SB16 driver counters (IRQ arms, watchdog poll arms, submits,
drops) and the ring fill, so ring health is observable over the serial
console without ears.
MiniOS ships Lua 5.4 as a static Linux ELF at ring 3, built from the upstream
reference interpreter with a custom entry point (progs/lua/lua_main.c) and a
minios module (progs/lua/minios.c) that exposes kernel services to Lua
scripts. The binary is linked with gcc -static -no-pie, exactly like DOOM
and MicroPython.
miniOS> lua -e "print(6 * 7)"
42
miniOS> lua src/test.lua # run the in-OS test suite
miniOS> lua # interactive REPL
> print(minios.time_ms())
12345
> print(minios.rtc())
8 30 15
> print(minios.fb_info())
800 600 800
> exit()
miniOS>
The minios module provides the following functions:
| Function | Purpose |
|---|---|
minios.time_ms() |
milliseconds since boot |
minios.rtc() |
returns hour, minute, second from the CMOS clock |
minios.fb_info() |
returns framebuffer width, height, pitch |
minios.vol([v]) |
get or set PC-speaker volume (0..100) |
minios.pal(buf) |
load a 768-byte VGA DAC palette |
minios.pcspeaker(freq, ms) |
play a tone at freq Hz for ms milliseconds |
minios.run(path [,args] [,redirect]) |
run a ramdisk program, preserving the interpreter |
minios.run invokes SYS_SPAWN (215), which runs a child program while
preserving the Lua interpreter state (user window, file descriptors, brk and
mmap cursors). This lets Lua scripts orchestrate the toolchain from inside
the OS:
miniOS> lua -e "minios.run('objects/minigcc.o', 'src/fib.c', nil, '>', 'asm/fib.s')"
miniOS> lua -e "minios.run('objects/ld.o', '-f', 'elf', '-o', 'bin/fib.elf', 'asm/fib.s')"
miniOS> lua -e "minios.run('bin/fib.elf')"
exit code: 0
The interpreter resolves through the command path (bin/lua) like cp and
freedom, so both lua and run lua.elf work. Scripts are opened through
the unified filesystem (ramdisk first, MiniFS fallback), and the interactive
REPL reads from the serial console. The in-OS test suite (src/test.lua)
exercises every minios binding, the filesystem, and the compression and
encryption tools.
Build from source:
make sources # clones the Lua repository if missing
make # builds lua.elf and packs it into MiniFSMiniOS ships MicroPython as a static Linux ELF at ring 3, built from the
upstream unix port with a custom MiniOS variant. The variant enables floats,
the compiler, the os module and computed-goto, and disables readline
(the kernel handles echo and line editing), sockets, threading, SSL, FFI,
termios and native emitters. The binary is linked with gcc -static -no-pie,
exactly like DOOM.
miniOS> micropython -c "print(6 * 7)"
42
miniOS> micropython -c "print(1.5 * 2)"
3.0
miniOS> micropython src/hello.py
hello from python
miniOS> micropython
>>> print(40 + 2)
42
>>> exit()
miniOS>
MicroPython resolves through the command path (bin/micropython) like cp
and freedom, so both micropython and run micropython.elf work. Scripts
are opened through the unified filesystem (ramdisk first, MiniFS fallback),
and the interactive REPL reads from the serial console.
The kernel provides several syscalls for glibc-static compatibility:
getcwd (79) returns the shell working directory, newfstatat (262) reports
S_IFREG/S_IFDIR with file sizes from the unified filesystem, and
readlink (89) returns EINVAL (MiniOS has no symlinks) so glibc's
realpath() treats every path as a regular file and keeps resolving. A
script's realpath() and directory traversal work without needing a full
VFS layer.
MicroPython previously crashed on exit (EXCEPTION 14). The root cause was
that k_exec_user did iretq to the ELF entry without zeroing the initial
registers, unlike Linux. glibc's _start does mov %rdx,%r9 to obtain
rtld_fini; the leftover kernel value in rdx was a base-less function
pointer, which __libc_start_main registered as an exit handler and then
__run_exit_handlers demangled and called on exit, a wild jump. The fix
zeroes rdi, rsi and rdx before iretq, so rtld_fini is NULL and
every glibc binary exits cleanly.
MicroPython ships with a minios C module (progs/micropython/variants/minios/minios_module.c)
that exposes kernel services: time_ms(), rtc(), fb_info(), vol(),
pal(), pcspeaker() and run(). run(path, args, redirect) invokes the
kernel SYS_SPAWN (215) boundary, which runs a ramdisk program from the
interpreter while preserving it, so scripts can chain toolchain commands.
Three scripts on the ramdisk use this:
miniOS> micropython src/build.py # minigcc -> ld -> run, every target
miniOS> micropython src/shell.py # pybash: variables, capture, run
miniOS> micropython src/test.py # in-OS test suite (kernel + toolchain)
build.py orchestrates the self-hosted toolchain (ET_REL minigcc.o and
ld.o run at ring 0 via SYS_SPAWN and work), shell.py is a Python shell
layer with variables and output capture, and test.py verifies the kernel
bindings and the toolchain from inside the machine.
Build from source:
make sources # clones micropython if missing
make # builds mpy-cross, the unix port, and packs the ELFThe variant files live in progs/micropython/variants/minios/; the build
runs entirely on the host and copies the resulting ELF into progs/bin/.
MiniOS ships TopoGPT3 as a static Linux ELF at ring 3. TopoGPT3 is a 24.5M parameter complex-valued autoregressive language model for code, built with quaternion-inspired spectral operators and a Mixture-of-Experts transformer. The C inference engine is a self-contained single-file implementation (~2000 lines) that loads flat binary weight files and runs the full forward pass: GQA attention with RoPE, sliding window, RMSNorm, SwiGLU MoE with top-2 routing, and quaternion torus spectral layers.
miniOS> topogpt3 -w topogpt3.fp16 -v vocab.bin -p "def fibonacci(n):" -n 30
miniOS> topogpt3 -w topogpt3.fp16 -v vocab.bin -i
The engine supports three operating modes: headless (-p for a single
prompt), interactive (-i for a REPL-style session), and file-based (-f to
read a prompt from a file). The interactive mode provides commands for
adjusting temperature, top-k, repetition penalty, and max tokens at runtime.
Interactive session example:
miniOS> topogpt3 -w topogpt3.fp16 -v vocab.bin -i
TopoGPT3 Inference Engine
Model: small (d=256, heads=8, layers=6, kv=2)
Loading weights from: topogpt3.fp16
Loaded vocab: 50257 tokens (321428 bytes)
Loading 380 tensors (fp16 v2)...
Layer 0 loaded
...
Weights loaded successfully (fp16).
Ready.
interactive mode. /help for commands.
> def bubble_sort(arr):
n = len(arr)
for i in range(n):
for j in range(0, n-i-1):
if arr[j] > arr[j+1]:
arr[j], arr[j+1] = arr[j+1], arr[j]
return arr
> /temp 0.1
Temperature set to 0.10
> /topk 20
Top-k set to 20
> /status
Model: small (d=256, heads=8, layers=6, kv=2, experts=4, topk=2)
Context: 32 tokens
Parameters: temp=0.10 topk=20 rep=1.10 max=256
> /quit
Interactive mode commands:
| Command | Purpose |
|---|---|
/help |
show available commands |
/quit |
exit interactive mode |
/clear |
clear the prompt buffer |
/temp N |
set temperature |
/topk N |
set top-k |
/rep N |
set repetition penalty |
/newtokens N |
set max new tokens |
/status |
show current settings and model info |
The binary is built with the host toolchain (gcc -static -no-pie) and
placed at bin/topogpt3.elf on the MiniFS. The model weights
(topogpt3.fp16, 47 MB) and vocabulary (vocab.bin, 422 KB) are also
shipped on the MiniFS.
Weight loading supports two formats, auto-detected at load time: float32
(TG3W, 94 MB) and float16 (TG16, 47 MB). The float16 format is used for
MiniOS to keep the filesystem footprint small.
Performance depends on the execution environment:
| Platform | Speed |
|---|---|
| Linux host (KVM) | 17-29 tok/s |
| MiniOS QEMU (no KVM) | 0.80 tok/s |
| MiniOS QEMU (with KVM) | 17-29 tok/s |
Build from source:
make progs/bin/topogpt3.elf # compile the C engine
make minifs.bin # rebuild MiniFS with weights + vocab
make os.img # rebuild the full disk imageThe source lives in progs/topogpt3/topogpt3.c with the weights and
vocabulary alongside it. The convert_weights_minios.py script in the
TopoGPT3 repository converts safetensors checkpoints to the float16 binary
format.
User-mode binaries (ET_EXEC / ET_DYN) run at ring 3 with hardware
no-execute (NX) page protection. The kernel builds eager 4 KB page tables
for the whole user window and sets EFER.NXE at boot; every user page starts
non-executable and load_exec_elf clears NX only on the pages a program's
executable segments occupy. A program cannot execute from its stack, heap
or .data, a jump into a non-executable page faults and the machine
resets, never silently running shellcode (proven by the nx.elf probe in
the BDD suite). The kernel heap keeps its 2 MB executable pages, because
the .o toolchain programs execute from there at ring 0 by contract.
The kernel image's physical base is randomized per boot (KASLR). Stage 2
mixes the TSC with the CMOS clock (hours, minutes, seconds fed into
separate bytes) and slides the kernel into one of 64 aligned 2 MB slots in
[0x6000000, 0xE000000). The kernel always executes at virtual 0x100000;
the boot banner reports its randomized physical base. Disable with
make ENABLE_KASLR=0 for deterministic physical layout.
kfread and kfwrite compute size * n before accessing the buffer. A
ring-3 program passing size=0xFFFFFFFF, n=2 would cause the product to
wrap to 0xFFFFFFFE, smaller than the intended allocation, bypassing the
bytes > RD_DATA_MAX check. Both functions now reject the call when
n != 0 && size > ULONG_MAX / n, returning 0 before any buffer access.
setup_user_stack writes argv strings downward from the stack top. Without
a bounds check, a program with many large argv entries could write below
the stack base and corrupt kernel memory. Each iteration now checks that
the string fits in the remaining space and returns NULL on overflow.
k_exec_user checks the return value and refuses to enter ring 3 with a
NULL stack pointer.
A ring of 4096 lines that scrolled off the top of the 25-row VGA screen.
Captured lazily from vga_scroll() and viewable with PageUp/PageDown.
- PageUp (
\x1b[5~serial, or PS/2 E0-49) scrolls upward through history. - PageDown (
\x1b[6~serial, or PS/2 E0-51) scrolls downward. - The view hides the VGA cursor; any key other than the opposite page key exits and re-injects that key for the readline layer.
- Internally,
sb_ringis a kmalloc'd circular buffer ofSCROLLBACK_ROWS * VGA_COLSbytes, updated every time a full row leaves the screen viasb_capture_row0().SCROLLBACK_ROWSis 4096; the ring never wraps silently, it drops oldest entries when full. - Serial PageUp/PageDown work natively. PS/2 extended keys (E0-prefixed
make codes) are translated into the same CSI sequences (
ESC [ 5 ~/ESC [ 6 ~) bykbd_read()inkernel.c:298, theKEY_E0flag is now tested before the release‑bit check so that0xE0is not swallowed by the high‑bit handler.
| File | Role |
|---|---|
bootdefs.h |
every constant shared by the boot path |
stage1.S |
512-byte boot sector: loads stage 2 over LBA |
stage2.S |
loads the kernel above 1 MB, enters long mode |
kernel.c / kernel.h |
kernel: console, heap, ramdisk, loaders, shell, editor |
net.c / net.h |
rtl8139 driver, ARP/IP/ICMP/UDP/DNS/TCP |
tls.c / tls_crypto.c / tls_x509.c |
kernel TLS 1.2 client, crypto, X.509 |
tls_roots_src/ + mkroots.sh |
the 8 embedded CA roots and their generator |
tls_test.py / tls_test.c |
host TLS suite: vectors + full handshakes |
cvm_host.c |
CVM interpreter + JIT integration in MiniOS |
progs/lua/lua_main.c |
Lua 5.4 entry point (REPL, -e, -l, script modes) |
progs/lua/minios.c |
Lua bindings for MiniOS kernel services |
progs/topogpt3/topogpt3.c |
TopoGPT3 C inference engine (~2000 lines) |
progs/topogpt3/topogpt3.fp16 |
TopoGPT3 float16 model weights (47 MB) |
progs/topogpt3/vocab.bin |
GPT-2 BPE vocabulary (50257 tokens, 422 KB) |
progs/ |
ramdisk contents organized by kind: objects/, bin/, cvm/, src/, asm/, docs/ |
mkramdisk.py |
packs progs/ into the ramdisk image |
test_bdd.sh / test_http_server.py |
behavioural suite and its HTTP fixture |
mcp/minios_mcp.py |
MCP bridge: boots the OS and exposes its console as tools |
mcp/test_minios_mcp.py |
unit + QEMU BDD suite for the bridge |
mcp/mutate_mcp.sh |
mutation testing for the bridge |
skills/minios/SKILL.md |
agent skill: the edit/compile/link/run workflow over the bridge |
mutate.sh |
mutation testing |
mcp/minios_mcp.py exposes a running MiniOS as MCP tools: minios_boot,
minios_status, minios_send, minios_expect, minios_snapshot,
minios_write, minios_cat, minios_poweroff. On top of the shell it adds
minios_python (run a ramdisk .py script with MicroPython) and
minios_py_eval (evaluate a one-liner). The server owns the QEMU
child and a pty-backed serial console; the companion skill
(skills/minios/SKILL.md) teaches the edit/compile/link/run workflow, so an
agent can write a C program inside the OS, build it with objects/minigcc.o and
objects/ld.o, run it and read exit code: N, or drive the in-OS Python
toolchain (build.py, shell.py, test.py) or the Lua toolchain
(test.lua), all without leaving the machine.
python3 -m unittest -v mcp/test_minios_mcp.py # unit + QEMU BDD (skips without QEMU)
mcp/mutate_mcp.sh # every bridge mutant must dieThe bridge is driven over stdio JSON-RPC, uses only the Python standard
library, validates every input before a byte reaches the console (path
whitelist, printable ASCII, editor line and buffer limits), and never leaks
a QEMU process: the pid file under the system temp dir reaps stale
instances and every exit path terminates the child. See CLAUDE.md for the
full contract.
| Target | Purpose |
|---|---|
all (default) |
build os.img |
sources |
clone the missing toolchain repositories from GitHub |
sources-update |
pull the latest commit of each one |
sources-status |
show the revision each checkout is on |
toolchain |
build minigcc, ld and cvm2 from those sources |
selfhost |
compile minigcc with minigcc, link with ld, verify the bootstrap fixed point |
test-tls |
host TLS suite: crypto vectors + full handshakes |
run |
boot the image in QEMU with a display (TCG by default) |
run-kvm |
boot it with KVM acceleration (faster CPU, slower IDE I/O) |
run-headless |
boot it headless on the serial console (no GUI window) |
serial / debug |
boot the image in QEMU |
test |
behavioural suite |
progs/bin/topogpt3.elf |
build the TopoGPT3 C inference engine |
minifs.bin |
rebuild MiniFS image (includes TopoGPT3 weights and vocab) |
clean |
remove every build product |
See CLAUDE.md for the full engineering contract.
This project has been analyzed by ReadMenator, a zero-token polyglot static analysis tool. A comprehensive knowledge base is available:
- KNOWLEDGE_BASE.md -- Architecture reference with all classes, functions, imports, dependency graphs, UML class diagrams, security audit findings, community analysis, and more.
AI agents and developers: Read KNOWLEDGE_BASE.md for full project context
without LLM token cost.