All posts
Behind the build

An AI desktop assistant you can talk to while you work

July 20, 2026 · 6 min read

I spend a lot of my day doing work that should take thirty seconds and somehow takes a few minutes.

Looking something up, drafting a reply, creating an event on the fly, saving a detail I’ll need later. Turning an email into a follow-up, asking a question about something already open on my screen and having it walk me through it. All of that is small, but it adds up.

AI can help with all of that. But using it usually means stopping what you’re doing, opening another tab, explaining the context, copying things over, then switching back.

That still feels like work.

So I built Aura: a voice-first AI companion that sits on your screen and works in real time. It can see what you’re looking at, help with the small things that pile up, and remember what matters so you don’t have to repeat yourself. Not a chatbot you open for one task and close, but something you can genuinely ask anything, any time, any day.

Aura is built around Buddy, a companion you talk to out loud with one click. Buddy remembers what matters to you, checks in on its own, and helps you through your day. Less a tool you open and forget, more like someone who’s around.

Hit Ctrl twice (bam bam). Say what you need. Buddy is there.

The computer already has the context. Why should you repeat it?

Most desktop AI tools still begin with a blank chat box.

You type a question. You paste an email. You explain who the person is, what you’re working on, and what kind of response you want. By the time the AI understands the situation, you’ve already done half the job yourself.

Buddy is built around a different idea: the assistant should meet you where the work is happening.

With your permission, Buddy can look at what’s on your screen and use it as context. You can ask him to help draft a response to the email you’re reading, explain something in a document, find information without breaking your flow, or save something for later.

You don’t need to write a perfect prompt. You literally just talk.

“Draft a friendly reply to this.”

“Save this so I can come back to it later.”

“What does this mean? What do I do next?”

“Surf this site and walk me through this scenario.”

“Remind me to follow up with them next week.”

That’s the interaction I wanted. Less operating software. More asking for help in real-time.

Voice is not a feature. It’s the interface.

I’m building Aura on my own, full-time, and I keep coming back to one thing: people don’t naturally think in prompts.

They think out loud.

When you’re trying to get through a busy day, you don’t want to stop and write a carefully structured request. You want to say, “Can you handle this?” and keep moving.

That’s why Aura Desktop opens with one hotkey and starts with a real conversation. It’s not text with a voice button bolted on afterward. The voice is the main way in. Buddy listens, responds in real time, and helps with the small things that quietly pile up during the day.

Ask it about whatever’s in front of you

Buddy isn’t a one-trick tool. Because it can see the screen you’ve chosen to share, you can point at almost anything and just ask.

Stuck on a UI bug? Talk it through and it guides you down with the prompt. Reading a dense contract or a pull request? Ask what it could do. Understanding an important concept? Learning something new? Ask it to break it down like you’re five. It’s less “run this command” and more the way you’d ask a smart friend sitting next to you.

Drafting is just one of the things it’s good at. Reading a cold email and need a reply? It writes one that fits the thread in front of you. When it’s close but not quite right, you nudge it: make it warmer, make it shorter, cut the last line, until it sounds like you. And when you want something more concrete than prose, ask for a command, a snippet of code, a config block, or a checklist and it hands back something you can actually use, not a wall of text you have to untangle.

Meeting Notes, without babysitting a recorder

Some of the day disappears into calls, and the useful parts always seem to slip away the moment they end.

When you arm it, Aura Desktop can listen to a meeting and turn it into a clean note afterward: a summary, the decisions that were made, the action items, and the open questions still hanging. It only runs when you choose to turn it on, and the raw audio is deleted as soon as the note is ready. You walk out of the call with the note already written instead of a recording you’ll never replay.

An assistant should remember the work, not just answer the question

A useful desktop assistant can’t treat every conversation like the first one.

Aura is built to remember what matters. When you tell Buddy to save something, it sticks around, and it’s there the next time you need it. Ask it to set a reminder or a follow-up out of something you’re reading, and it becomes a real thing you’ll be nudged about later, not a note you lose in another tab.

The goal isn’t just to generate a good reply in one moment. It’s to become more useful over time because it understands the things you’ve been working on. That’s the difference between a chatbot and an assistant you might actually keep around.

A chatbot waits in another tab until you need it.

Aura is meant to be closer to having a capable person beside you who knows what you’ve been dealing with, can help in the moment, and doesn’t make you start from zero every time.

Where this is going: the tools you already live in

Right now Buddy helps with what’s on your screen and what you tell it. The obvious next step is letting it reach into the tools your day already runs on, so you’re not the one moving things between them.

That’s the direction I’m building toward:

  • Slack and Discord, so you can catch up on a noisy channel, draft the reply, and send it without leaving your conversation with Buddy.
  • Notion, so a decision from a meeting or a thought you say out loud lands in the right doc instead of a note you never open again.
  • Gmail and your calendar, so “reply to this” and “put that on Thursday” actually happen instead of turning into three more tabs.
  • Linear, Jira, and GitHub, so a bug you’re staring at can become a ticket or an issue while you’re still looking at it.

The point isn’t to bolt on a hundred logos. It’s that the work you do all day lives in a handful of apps, and moving things between them by hand is exactly the kind of small, repeated friction Aura is supposed to take off your plate. These are rolling out over time. If there’s one you’d want first, tell me, that’s genuinely how I decide the order.

Everything in one place when you want to look back

Not all of it lives in the moment. Your past conversations, the drafts Buddy wrote, the things you saved, and your meeting notes are all there in a simple dashboard when you want to find something again. The in-the-moment help is the point, but nothing you asked for just evaporates.

What’s on your screen stays yours

This only works if you trust it, so here is exactly how it works. When Buddy looks at your screen, that frame is used in the moment to answer you and then it is gone. It is never saved to a cloud database to sit there, never written to our logs, and never fed into analytics. There is no library of your screens on a server somewhere, because we don’t keep them.

Anything that does need to live on your machine, like the buffer that protects a meeting recording if your wifi drops mid-call, is stored locally and encrypted on disk with strong, industry-standard cryptography. The point is simple: the stuff you’re personally working on isn’t sitting in the cloud for anyone to steal, because it never goes there to be stored in the first place.

You stay in control

Screen context is powerful, which is exactly why it has to be clear and permission-based.

Aura should help you work with what you choose to share, not quietly take over your computer. You decide when to open it, what to ask, and when screen context is useful. Capture is always something you turn on, never something running behind your back. The point is to remove friction, not remove your control.

What Aura Desktop is for

Aura Desktop is for the moments between the big tasks:

  • Understanding something already on screen
  • Getting a quick command, snippet, or checklist without switching apps
  • Turning a meeting into notes, decisions, and action items
  • Saving useful information before it disappears into another tab
  • Looking something up and gathering information while staying focused
  • Responding to an email or a DM without losing momentum
  • Creating reminders and follow-ups from a conversation
  • Talking through a task instead of typing another prompt

Those moments are small on their own. Across a day, they’re where a lot of time goes.

I’m building Aura because I think your computer should feel less like a place where you manage a hundred tools, and more like a place where you can simply ask for help.

Buddy is still in beta and free. But that’s the direction: an AI desktop companion that knows the context, talks naturally, and is ready when you are. You can grab the Windows build or read why I started Aura in the first place.

Building this in the open. Follow along on X: @auravoiceapp