GPU Timesharing with Nix

ai disclaimer: all prose here written solely by me

I.

in the process of working on another project, i ended up with the problem that i wanted to run a lot of small, asychronous AI jobs involving multiple models on my workstation. the way to accomplish that is to write something called a "scheduler" and schedulers need to have certain properties. the basic job of a scheduler is to ensure that jobs never get "stuck" in a way that prevents them from ever being completed, and the job of a good scheduler is to minimize the worst-case-execution-time of each job they recieve so, in every single case, they get completed more or less as fast as possible without compromising on the property that no job ever gets left behind.

II.

i

release: /workspace/webdiary/build/www