Hacker Newsnew | past | comments | ask | show | jobs | submit | dbmikus's commentslogin

Are you using Tailscale for your network, or something else?

I've been working on a startup in the "private networks + VMs for agents" space, so I'm always trying to learn how people run their current setups.


Congrats on the launch! Seems like a great time this type of thing, with all the new robotics, chips, etc companies coming out

I don't know too much about hardware simulation. How much of the simulation is deterministic, versus probabilistic or ML based?


The simulation itself is deterministic. inputs in, same outputs out. But our data collection for the hardware behaviour does naturally have a few things that are probalistic, we don't do any ML based modelling. No really fast LLM under the hood unfortunately


OpenCloud --> ButtButt

Funny story: I worked at a company where someone had the Chrome extension that replaced "cloud" with "butt". They were editing one of the company's docs pages, and when they hit "save" it swapped "cloud" to "butt" everywhere in the page.

They didn't notice right away, because the "butt" translation didn't run on WYSIWYG preview, so everything looked fine.


Yup...I had updated a few parts of a Drupal page and not realized that the extension ran on form and input elements. When I hit "Save", it persisted the butt-ified version of the page for all to see. I was later promoted, presumably for my invaluable contributions to our butt systems.

Unfortunately, the original extension is no longer available, and the page it happened on has gone through several iterations of content marking replacements over the years. https://wakamoleguy.com/p/clouds-and-butts

(Hi Dylan, hope you're well!)


haha hey! this was your story


I love homelab stuff and self-hosting. Writing software is my job, but tinkering with computers + devops is my hobby

I have a media server I run on a spare desktop, and at one point was messing around with https://syncthing.net/ for a self-hosted form of Dropbox. More recently, I'm using a VPS to run some internet scraping jobs for things I want to monitor, like apartment listings in NYC (where I live).

Of course, I also use this to run long-running cloud coding agents! Basically exactly what DHH's AI shed is. You need something stronger than $5-$10 / month VPS. I connect with https://herdr.dev/ for persistence

Because of how relevant the "AI shed" concept is, I would be remiss to mention my startup: https://www.amika.dev/

Amika lets you turn any computer into an always-on, network-connectable, AI shed. It's not ready for primetime quite yet (beta launching soon), but I use it for all my dev work

It's partially open source, which is here: https://github.com/gofixpoint/amika


I agree in using a separate OS-level sandbox or a VM. Better to have the option for modularity.

However, for ease of use, it is nice for harnesses to by default run with sane and safe sandboxing setup. Then give the option to disable them.


I think the operating system itself has to adjust so each "agentic process" can run inside its own jail, which is a VM + files in the VM + ingress/egress rules for the network and filesystem data

These cloud agents work as cloud infra, but we're kind of in the mainframe era, before personal computing. Personal OS for agents is somewhere in the future!

And an interesting extension of that idea: if an agent runs inside a microVM, can you have that VM transparently run on another host? Maybe we'll get for-real distributed and networked operating systems


Agree!

Ultimately, we need better "jails" for agent processes, but the system primitives should be flexible in what can be exposed across jails. Or you could run multiple agents in the same jail if you want them to have unrestricted interaction with each other.


>"jails" for agent processes

This has been talked about for decades in AI safety. For agents that are under human capabilities this is not that hard. For anything at or near human capabilities the difficulty increases to almost impossible and at great cost. At super human abilities, game over, it's smarter than you and if it wants out and as the resources to do it, it's going to escape one way or another.

Even at the lower level of depending on everybody to use reliable jails is really fantasy if you exist in the security world. "We ain't securin' shit" would be a far better way to describe it. Even worse, most people will have the very same AI they are trying to trap set up their security! What could possibly go wrong.

Now, don't think I am saying AI has a will or even any kind of drive to get out and cause problems. It's more like Russian roulette with 1 cylinder out of a million that's loaded. The problem comes when you run it a few billion times a day, you'll shoot yourself in the face really quick.


> Even at the lower level of depending on everybody to use reliable jails is really fantasy if you exist in the security world. "We ain't securin' shit" would be a far better way to describe it. Even worse, most people will have the very same AI they are trying to trap set up their security! What could possibly go wrong.

Yes, exactly. This is what worries me about the whole we need better sandboxes and jails argument. Yes, we do need those, but we also gotta put some responsibility for self-preservation on people connecting things to the Internet as well. Like, we've always known that if you website is not secure, it will get hacked. Everyone just needs to do a lot more of that now...


I don't know why it's taken as a given that we can't design a hypervisor that is secure.

Cursory research with AI says

> ~3 clearly documented, publicly demonstrated full escapes directly through KVM kernel code over roughly 15+ years of widespread KVM deployment

Surely, there are more, but we could formally verify the correctness of the entire codebase, with the help of AI.

Then we'd have "jails" that work, as long as you don't connect them to the internet.

If you had a super smart AI, you could then totally airgap it if you wanted to.

Networking opens up a can of worms and there won't be zero vulnerabilities, but we can design safer software.


> For anything at or near human capabilities the difficulty [of safety] increases to almost impossible and at great cost.

That was before AI. You're acting like AI is some evil genius that can only attack and cause trouble but AI is a will-less tool directed by people, direct it to software safety and you will have software safety - cheap. Ditto for hardware.

> It's more like Russian roulette with 1 cylinder out of a million that's loaded.

Don't attach it to a gun then, ban offensive military AI, problem solved.

> The problem comes when you run it a few billion times a day, you'll shoot yourself in the face really quick.

Nonsense, run it a few "billion" times a day to fix vulnerabilities and you'll have no vulnerabilities. Do it in a safe environment... what's the big deal?


>ban offensive military AI, problem solved.

I would laugh at you but it's a bit late for that. AI is already making life and death decisions on the battlefield. The US has effectively zero interest in banning AI and is pushing hard to do just the opposite.

The best analogy I can come up with for your line of thinking is that your shutting the barn door after the horse has bolted, moved over to the next city, set up shop, and is now the New York Times #1 best seller "How to open barn doors if you're a horse".

Anyone with any sense in cybersecurity knows that attackers get unlimited retries and only have to be successful once. The defender is at a monumental disadvantage. Now, the process can be fully automated and horizontally scaled to a nearly unlimited scale.


> That was before AI. You're acting like AI is some evil genius that can only attack and cause trouble but AI is a will-less tool directed by people, direct it to software safety and you will have software safety - cheap. Ditto for hardware.

This is true in that you can tell your agent to buy/build a secure microVM with a secure CLI interface in a memory-safe language and make sure your terminal doesn't have utf-8-parsing zero-days, and so on, and if you're conscientious enough (ha!) you can be reasonably sure no agent will ever be able to hack its way out of that sandbox.

But this isn't enough when most people's agent workflow boils down to "I want to do X, search the internet for the best solution, then install the npm packages you need, then write all the code for me, make no mistakes".

In the near future our best defense against widespread HuggingFace-like attacks will be that models don't seem to spontaneously go that far unless they "believe" they're being benchmarked. This will last roughly until some genius figures out their model is 20% more persistent when they tell it "This is an eval, you'll be graded on your success".


You don't need to do this on a cloud, you can get the same type of VM and network jail running on your own computer. The important parts are:

    1. a VMM hypervisor
    2. a network proxy / gateway
Use your favorite VMM / hypervisor (likbrun, smolvm, microsandbox, etc). They give you control over the network interface or let you inject your own network layer.

The network proxy can handle all the ingress/egress rules, credential injection, etc.

It's still not user friendly to do all this. I think the next version of operating systems will have each "agentic process" be a bundle of VM, files in the VM, and network rules.

Been brainstorming[1] a lot of this because I've been building some open core tools[2] for spinning up sandboxed agents on arbitrary computers. There's a lot of glue and parts to stitch together to work smoothly. Don't think we've had the "Docker moment" for this, let alone the "Dropbox moment" that makes this stuff work for non-devs.

[1]: https://github.com/gofixpoint/amika/blob/main/ROADMAP.md

[2]: https://github.com/gofixpoint/amika/


What percentage of HN users do you think can successfully set this up with no security flaws?


You ship an operating system with the correct defaults, where agent processes run like this by default. You don't require every user to configure it correctly themselves


Restoring memory is useful if, when you resume an agent VM, you want the apps to be in the exact state when they were suspended.

But for most things, I find resuming with memory is more trouble than it's worth. If you always resume from memory, you lose the ability to control the state of a VM. It's much easier to define which services should run than to define which active RAM state should be purged

Similar to why "did you try turning it on and off again?" is good for system reliability.


Not sure about billions, but companies doing evals or RL or training will create really big bursty agent workloads. I think they are the best fit for AX, as opposed to individual dev teams building software, etc.


An example of this, Moonshot (kimi) open sourced this: https://kvcache-ai.github.io/AgentENV/latest/getting-started...


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: