Journals for

2022-12-23

🔗

I've been doing a lot of work on the Ergo dataflow node UI. Ended up doing both the dragging and the connector code totally from scratch to get them just how I liked, which was a fun diversion. The line drawing code takes some pains to not interact with the source and destination boxes. There's more work to do there but I'm happy with it for now.

The demos right now are mostly videos and it's a bit of a hassle to post videos here. Here's one though:

Next up will be to integrate the actual editors and things into that UI.

But for now, it's holiday research project time! I'll be diving into semantic search, trying to build Perceive, a search engine for my local computer and expanding to browser history if I can.

The core will be in Rust, starting with a CLI interface and adding a Tauri app and Svelte GUI if I have the time.

I'm using rust-bert for running the embedding models. There are a couple small tricks to get it running on an M1 Mac, which I'll publish soon.

The persistent data store will be sqlite3. Postgres provides a nice pgvector extension for vector search, but it's more difficult to ship something self-contained that uses Postgres, so I think SQLite is the way to go here.

So far I've built a REPL that does a simple embedding comparison. More to come!

And if you're on Mastodon, you can follow the tag #PerceiveProject to see the progress in real-time.


Thanks for reading! If you have any questions or comments, please send me a note on Twitter.