Of Notes

World Models in Coding Agents

1 min read · revised 25 September 2026 · referred to by 1 note · ·

The idea is something I called CodeJEPA.

  • We have a given solution we want to implement
  • A coding agent takes multiple turns where each turn consists of a diff which we can represent indexed over some catalogue of files
    • where is the file in the catalog and it's represented at time and is transformed into with some function
    • is some instruction or direction in which a diff should take the full solution, which is often currently represented in natural language
  • The proposal is to create a model that is able to take the current state and generate candidate solutions in latent space via an auto-encoder like in JEPA models …
    • Given , predict ; sample candidates externally; select (see JEPA)

image(14).png

Figure 1: Diagram

/ or Ctrl K
search; empty, it shows notes to revise and lately read
m
mark this note to revise, or unmark it
c
cover maths, proofs and solutions to test yourself
n
uncover the next covered item
y
copy this note’s org-roam link
e
copy this note as markdown, LaTeX kept as TeX
p
the next problem to work; there h hints, s shows the solution, x passes it for today
→ ← j k space
turn the page, when reading in pages
l
on the map, trace the greatest distance, then the longest path
double-click
a formula, to copy its TeX
rest on maths
bind a part of a formula and open the wheel of notes it comes from; scroll or ↑ ↓ widens it, 1–6 goes
?
this card