ChatGPT Work with Apps: Apply code changes in Cursor, VS Code, and access terminal output

ChatGPT Work with Apps: Apply code changes in Cursor, VS Code, and access terminal output

OpenAI has greatly enhanced the Work with Apps functionality in the ChatGPT app. Users can now incorporate the outputs from these apps as context for their prompts in ChatGPT and implement code changes in Cursor, VS Code, and various other IDEs. This feature positions the ChatGPT app as a competitor to Cursor and GitHub Copilot in VS Code. Furthermore, outputs from well-known terminal applications such as Warp and iTerm2 can be used as context within ChatGPT.

Contents

  1. Supported apps
  2. Using Work with Apps
  3. Work with Apps in a terminal
  4. Work with Apps in Cursor and VS Code
  5. Conclusion

Supported apps

The following apps are currently supported for Work with Apps:

  • Apple Notes
  • Notion
  • TextEdit
  • Quip
  • Xcode
  • VS Code (including Code, Code Insiders, VSCodium, Cursor, Windsurf)
  • JetBrains (including Android Studio, IntelliJ, PyCharm, WebStorm, PHPStorm, CLion, Rider, RubyMine, AppCode, GoLand, DataGrip)
  • TextEdit
  • Terminal
  • iTerm
  • Warp
  • Prompt

These applications are compatible with the macOS Accessibility API, a framework from Apple designed to help developers make their apps accessible for users with disabilities. This framework enables assistive technologies, like screen readers and alternative input devices, to communicate with and operate applications by supplying information about user interface components and enabling user interactions.

I believe that with such a prominent use case now, more software developers will soon support the Accessibility API.

Using Work with Apps

Work with Apps is currently available only for the macOS version of ChatGPT. Hopefully, the Windows version of ChatGPT will add the Work with Apps feature soon. Additionally, you’ll need a ChatGPT Plus subscription to use Work with Apps.

Ensure you have the latest version of the ChatGPT app for macOS installed, which, as of now, is 1.2025.057.

Check if Work with Apps is enabled in the ChatGPT settings.

Work with Apps settings in the ChatGPT app

If the feature is enabled, you should see the Work with Apps icon between the Deep Research and the model selector. Clicking this icon will display the supported apps that are currently open.

Works with Apps in ChatGPT

Work with Apps in a terminal

Some apps only permit you to add their current contents as context for ChatGPT. I tested Warp, iTerm2, and Terminal, and ChatGPT can only read the screen contents but cannot write.

When you highlight text in a terminal, ChatGPT prioritizes your selection while still considering the entire content as context.

Accessing content from the Warp terminal in ChatGPT

This effectively eliminates the need to copy and paste terminal content into ChatGPT. While this feature doesn’t compare to interacting with the AI agent in Warp, those who still use iTerm2 or the native Mac terminal will find this new functionality valuable.

Work with Apps in Cursor and VS Code

To utilize Work with Apps in Cursor or VS Code, you must install the latest ChatGPT extensions from OpenAI. This process isn’t as simple as it seems, so continue reading to avoid wasting time.

I installed the extension some time ago, but the old version no longer functions, and updating it isn’t possible either.

Start by uninstalling the previous version. Next, in Cursor, search for the ChatGPT extension in the VS Code Marketplace (Cmd+Shift+X) and proceed with the installation. Ensure that the extension is obtained from OpenAI.

Make sure to uninstall the old version of the ChatGPT extension

Interestingly, this approach failed in VS Code. After uninstalling the previous version, the extension vanished from the VS Code Marketplace. You can click this link to install the ChatGPT extension in VS Code. I sourced this link from the OpenAI help page in case it changes.

After installing the extension, open a file in Cursor or VS Code. Next, click the Work with Apps icon in ChatGPT, and then select Add next to the appropriate IDE.

You will notice the file name located above the chat input field. Switching to another file in the IDE will automatically update the file name in ChatGPT as well. While you cannot add multiple files from a single IDE, you can introduce context from various applications at the same time.

I introduced a syntax error into the code and asked ChatGPT to fix it. Initially, the latency was relatively low when I tested while the U.S. and Europe were asleep (as I am currently in Asia). However, upon retesting the feature later, I noticed the response time was significantly slower.

Next, a diff will appear in the ChatGPT window. By clicking on Review, you’ll access a side-by-side comparison along with a summary of edits.

Reviewing the code changes

If the Automatically Apply Suggested Edits option is activated in the ChatGPT settings, changes will be instantly applied in the IDE, and the file will be saved.

Click Apply in the ChatGPT app if this setting is not enabled to copy the changed code to your IDE.

Applying the code changes in the IDE

Conclusion

The new Work with Apps features are definitely helpful. When you frequently require context from one of the supported applications, it reduces the need for copying and pasting. The ability to implement code changes in IDEs is also a plus.

Nevertheless, this capability does not compare to the AI tools found in Cursor or VS Code when paired with GitHub Copilot, Roo Code, and Cline. For example, you can’t use multiple files or the entire codebase as context and apply code changes line by line, to name just two Cursor features that ChatGPT Work with Apps lacks.

However, if you’re a ChatGPT subscriber and prefer not to pay for another subscription, you may appreciate the new features, especially if you code infrequently.

Leave a Reply