comparsion of gpt models

a table of evaluation metrics for gpt models
updated 2022-02-06: added entry for gpt-neox-20B intro i put together a table of various metrics for all the main gpt models.
more (200 words) →

micro-finetuning gpt2

notes on finetuning gpt2 with a tiny dataset
introduction disclaimer i am primarily a software engineer, and thus am quite an amateur at machine learning.
more (1900 words) →

irre-tools devlog

working project notes collection
Goals TODO completely rewrite compiler to replace clang-leg TODO test device driver functionality Plans Compiler rewrite (clang-leg to vbcc) Problems with clang-leg (why rewrite?
more (500 words) →

duckmind ai engine, part 1

overview and core concepts of ducia
overview duckmind is a collection of projects that are based on Sor's AI engine, and provides its game-playing AI functionality as a reusable library.
more (900 words) →

keras on amd with plaidml

setup for amd gpu acceleration for keras
intro this week i wanted to revisit one of my old machine learning projects. that project used the excellent keras library for building the model.
more (300 words) →

sōr devlog

original devlog notes for sor
Progress Graphical juice An interesting way to make the graphics look cooler that I discovered accidentally; mixing the color channels (for example, swapping red and blue) will give it a cool effect.
more (3800 words) → on linux

using in rider on linux
nowadays, the latest pipelines can be found on the azure dev page: in particular, the oss package. from there, go to linux artifacts (example).
more (200 words) →

better native monogame

using .net core tools to build smaller, better native bundles
intro since .NET Core was released, its native publishing options have improved significantly. it is now possible to build a MonoGame application and build it into a fully native, self-contained release that is less (sometimes significantly less!
more (500 words) →

headless monogame

tweaking desktop monogame to run headlessly
goals i've been working on a networking layer for my game engine, which is based on MonoGame. since i already have the physics code written, i figured that if i could get MonoGame to run headlessly, i could share the same code and the same assembly between the client and the server.
more (700 words) →

headless xnez

tweaking nez (on monogame) to run headlessly
see the other post on headless monogame as well. headless sdl2 we want to be able to automatically enable headless compatibility using SDL2's video driver override feature (see the section on SDL_VIDEODRIVER in the docs for envvar).
more (400 words) →

duck intelligence

decisions, planning, and personality modeling in Sor
this is a condensed form of a presentation going over a lot of the ai workings in my game Sor.
more (900 words) →