In this video, I show you a cool way to use Siri AI in the new macOS 27 Golden Gate to create captions and keywords for use with Lightroom, Lightroom Classic or any photo editor really. The trick involves using Apple’s “Visual Intelligence” feature to let Siri see what image you’re looking at, and then it can generate captions from there. I also show you how to use the new “Describe a Shortcut” feature to create a shortcut to do this quickly in one step.
Basically, the idea is to use visual Intelligence to create captions for any image. Visual Intelligence uses the screenshot tool to select part of the screen, and then you just ask Siri about what you have selected. In this case, you can ask it to create captions for you.
To activate Visual Intelligence, you use the same command key for taking a screenshot selection, so it’s Command + Shift + 4 and then just press Command again to go into Visual Intelligence mode. You will notice that the cursor changes, and now the marquee has a glass look when you drag it. Drag it around the image on the screen, and then you just ask Siri to create a caption for you. You can also get it to generate keywords. Another thing I cover is how to be more specific, so if you know something about the location of the photo, include that in your prompt.
In the video, I also explain how to use Apple’s new “describe a shortcut” feature to automate this a bit. You can basically use the shortcuts app to create a shortcut that will do all of this in one step for you and copy the results to the clipboard. the prompt I used to create my shortcut is below:
Describe a Shortcut Prompt: “Take a screenshot and create a caption for the image in the screenshot, ignoring the user interface. Copy that caption to the clipboard. Wait five seconds, then create keywords for the same image, also ignoring the user interface. Then copy those to the clipboard”
Once you run this, it will create the caption, copy it to the clipboard, and wait 5 seconds before creating keywords and copying those to the clipboard. The wait is so you have time to paste the caption before the keywords are copied to the clipboard.