Alright, i think what would really improve the flow of this are the following multiple axes of attack:
toss the idea of .defs entirely in favor of the global glossary (adjacent blogpost, needs cleaning up but should be a part of this one). So, as you say, these definitions are a nice touch in principle if this were a bon fide textbook, but it’s not and most of the defs are chosen by claude when writing the prose. the prose changes way too often for me to keep track of this and so the user may get the wrong set of concepts highlited. It’s just not useful at this stage of prototyping the text. A lot of this should be in the glossary anyway that we will make the main place for concept definitions that’s a separate document to which we link.
The infrastructure for displaying something on the right side is useful though, don’t toss it out (see next point).
Prose style and organization + side-callouts: better separation between textbook exposition + concept presentation vs elaboration, examples and description. I’m pretty happy with how quickly we are accumulating content here, but full disclosure, these blog pages are often the results of one or multiple long sessions of dicsussing a concept or a bunch of papers with claude during which i often ask clarifying questions and go on tangents that later – when i paste the session to be made into a blogpost or ask claude to summarize – trickle through into the blogpost. At the velocity at which im going through this it’s often hard to keep track, separate and collate what should actually make the cut in the blogpost and what can be deemed superflous exposition or examples (useful or not). So i want to do two things about it:
- let us repurpose the callouts infrastructure from above to basically be able to click on the concept or paragraph or a sentence that is actually the meat of the post and serves our definition of the format and on the right side we can just display an additional subservient blocks of text/paragraphs that clarify or provide context that is secondary to it.
- lets codify this as a rule for reorganizing existing blogposts and creating new ones so main prose is actually just good condensed and informative content, never vague rambling and tangents
Blog organization: separation between two tracks: Ensemble representation + forward operator infrastructure. At this point i feel like we have a few big topics going on here and chapters sprawl over them in an overlapping manner. That is fine since we were adding chapter by chapter but i hope you can see a coherent whole emerging in a modular manner: two “Tracks” each that services a different concern, the different heterogneiety regimes and materialization modes in the ifrst track: the bespoke encoding and evaluaton model. These are the core of what we are building and they should be the foremost citizens when we consider the representation and chapter organization of our material. That is to say, i’d like to reorganize the whole blog such that these things are given foregroudn and chpaters like “Problems with mmcif”, “annotations”, “tech survey”, “ml-native access patterns” all go into a separate section that is equally important to our mission but is secondary to the main Duino concepts in their capacity to address the heterogeneity problem with the mmcif. That’s to say, there are fundamentals of what we are presenting (the core of Duino) and then there are nice-to-haves. Let’s separate those organaizationally. We are of course free to link from the core concept chapters to the secondary chapters to call problems out, motivate our choices or offer elabarations, but im just saying let’s not pollute the main text with them.
immedieately following the re-organization above i would actually at this point like to have a pictorial/graphical “map” of the duino concepts as latex figure that is a high-level overview of all of the core concepts so the new user can orient themselves in this sea of new concepts and reorganization/suggestions. It would be amazing if its text is also clickalbe and linkable so we direct the person from the figure straight to the relevant chapter or section. Don’t try to over-optimize this at first because i’m not quite sure just how the system looks like in the end anyway, we have not come even close to standardizign the style of the figures across the blogpost and i’m also not quite sure where we should display this “map” – on every page as a tooltip or maybe upfront on the blogpost homepage.. by “map” i mean actual concpets represented pictorially, at least for the duino core. let’s see a prototype of this and then iterate.. when we do this however, it would be great if we could design this in such a way that modular pieces of latex and style can be reused throughout the blogpost for other figures as well so we maintain some continuity of style.
my last peeve, which is actually getting to be quite a big sore has nothing to do with our material, but more with the “quarto development workflow”. That is, right now i paste shit from claude there, run preview, read the whole blogpost and then go back to markdown to edit the things i like and dislike/finalize. Then run preview again and notice something else etc etc. This is getting to be quite a huge bottleneck given the velocity at which cluade can spit out decent sound prose and the markdown soruce just isn’t navigable enough for me to do this quickly. So i just want to ask what do you think i can do better? The ideal workflow for me, at least for text, would be if i could edit text directly on the page of the quarto preview render (in the browser page, when it is rendered nicely) and save it so i don’t have to do two passses over it..
Whatever we agree on in this session – please start accumulating it in claude.md and adding conventiosn there so we are on the same page in further sessions.