Seems more than good enough for a live model though! I can imagine this demo being extended to be a lot nicer to play with. You can just feed the model engine analysis and it can make as high of quality moves as needed. No longer any correlation between the model's understanding of the position and the moves that would be made but I think that's still a really nice improvement when thinking about this as adding live voice interaction to existing chess vs computer functionality rather than adding chess to possible interactions with the latest live voice model.
Great summary! I would just add that cherry on top though -- that HuggingFace tried using the top commercial models in response but couldn't because of the cybersecurity restrictions so they had to use GLM 5.2 instead
"When we started the log analysis, we first used frontier models behind commercial APIs. This did not work: the analysis requires submitting large volumes of real attack commands, exploit payloads, and C2 artifacts, and these requests were blocked by the providers' safety guardrails, which cannot distinguish an incident responder from an attacker. We ran the forensic analysis instead on GLM 5.2, an open-weight model, on our own infrastructure. This had a second benefit: no attacker data, and none of the credentials it referenced, left our environment."
For me, primarily the performance tbh. Chatto just flies and Slack feels incredibly sluggish. And from the "vibes" it just feels better designed, I like the overall user experience, it feels technologically solid but also looks nice and works how I feel it should. Hard to put my finger on it exactly.
Heh after reading that title card I thought this was going to be a mosquito based software bug analogy. I expected a description of how to write software that resulted in more "good bugs" that might facilitate finding other bugs somehow. Now I'm a little disappointed
It’s just a basic IntelliJ plugin which provides an infinite canvas to add code bookmarks to. I work on a large code base and often have to take on tasks involving lots of unfamiliar areas of code and components which influence each other only through long chains of indirection. Having a visual space to lay things out, draw connections, and quickly jump back into the code has been really helpful
The canvas and UI is built using Java AWT since that’s what IntelliJ plugins are built on, but it occurred to me that I could just throw in a web view and use any of the existing JS libraries for working on an infinite canvas. React Flow has seemed like the best option with tldraw being what I’d fallback to.
But then.. if the canvas is built with web technology then there’s no reason to keep it just within an IntelliJ plugin vs just a standalone web app with the ability to contain generic content that might open files in IntelliJ or any other editor. I’m pretty sure the “knowledge database on a canvas” thing has been done a number of times already so I want to also see if there are existing open source projects that it’d be easy enough to just add a special node type to
See also this recent post about Mercury-Coder from Inception Labs. There's a "diffusion effect" toggle for their chat interface but I have no idea if that's an accurate representation of the model's diffusion process or just some randomly generated characters showing what the diffusion process looks like
Just about every line of code for this was written by Claude 3.7 via Claude Code. I never gave the other AI development tools like Cursor and Aider a fair shake so I may have just been behind the times on what's possible with agentic editors, but I found Claude Code to be extremely impressive. The API costs did end up being something around $15 though and this is a really small project, so I imagine cost goes up quite a bit to do any non-trivial work on a project of a decent size
This was great for me though because this is something I've had in mind for a while but never considered quite useful enough to be worth the time it'd take to learn about IntelliJ plugin development + the Java AWT knowledge required to create a canvas app like this
lol yeah I tried to get it to whisper too. And talk faster or slower or do accents. It seemed to be able to kind of do each of those things but only very slightly. Enough to see that there was some successful interpretation of the request but lack of flexibility to fully execute on it. OpenAI's model still has this beat on that front imo (talking quietly / slower / faster)
Yeah after a few interactions, the repetition of the mannerisms that initially added to the sense of life-likeness started to break the illusion a bit. The "you got me" response shows up a bit too often. The creativity remains impressive though
reply