Sorinai just got eyes

The Sorinai teamThe Sorinai team·6 August·3 min read

Until now, Sorinai could hear your meeting and nothing else.

That was fine for most of it. Conversation is where the meeting lives, and Sorinai was listening to all of it. But a lot of calls have a second half that never gets said out loud. Maybe it's the spreadsheet you're both looking at, the CV open in the other window, a presentation you're watching, or the pitch deck you're presenting.

Sorinai was blind to all of it. You could ask about it, but only by typing out a description first, and nobody types a description of a table while someone waits on the other end of the line.

So we gave Sorinai a pair of eyes (or rather, one eye)!

Ask about what you're looking at

While a call is running, Sorinai sits on the side of your screen. When you decide to ask it for help, there's now an eye beside the box you type into. When it's lit, it means Sorinai can actively see what you're looking at.

That's the whole feature. You stop describing things.

Point at a pricing table and ask which line they'll push back on. Have a CV open and ask what's missing from it. Get shown a dashboard for four seconds and ask what the number in the corner actually means. The answer comes back from what's on the screen, not from what you managed to summarise about it while someone was mid-sentence.

It can do more than answer, too: ask Sorinai to write what it saw straight into your notes, and the line lands while the slide is still up.

There's also a button — Quick Help — that answers without you typing anything at all. Press it and Sorinai works out where the conversation has got to, what's still hanging, and what you might say next. It now reads the screen alongside the room, so one press can solve the coding problem you were just handed, or explain the slide that went past too quickly, without a word from you.

It looks when you ask, not while you work

This is the part worth being precise about, because "it can see your screen" is a sentence that deserves some suspicion.

It takes one still picture, at the moment you press send. There's no video, no stream, and nothing running between your questions.

  • Only when the eye is lit. It starts on if you've given Sorinai permission to see your screen, and one click turns it off. Off stays off.
  • Only the screen you're on. The display your cursor is on — not your other monitors.
  • Not Sorinai's own window. It leaves itself out of the picture, so it never ends up looking at itself.
  • Not kept. The picture goes with that one question and is never saved. All that stays behind is a mark showing it could see when you asked.

It takes a snapshot when you ask it a question. It doesn't watch you work.

On a Mac, macOS will ask for permission to record your screen the first time. If you don't give it, the eye stays dark and everything else works as before.

Live now

The eye is there in your next call, once you're on the latest version.

The Sorinai team
Written by
The Sorinai team
Read next
Edit your notes by asking