Unlocking the Power of AI with ChatGPT Plugins:
ChatGPT Plugins: A Complete Guide
OpenAI is gradually rolling out plugins for ChatGPT to study their real-world use, impact, and safety and alignment challenges. As OpenAI continues to advance the capabilities of its powerful language model, GPT-4, it is now collaborating with various companies and developers to create an ecosystem of plugins that enhance the user experience and provide access to a myriad of new features. These plugins, currently being rolled out and tested, are designed to interact with external APIs and enable ChatGPT to perform tasks like booking flights, making restaurant reservations, and even offering personalized shopping experiences.
These Chat GPT add-ons are developed with an aim to redefine how we utilize AI, especially in the context of conversation. The applications of AI chatbot technologies like ChatGPT are ever-expanding with the introduction of these plugins.
How to Install ChatGPT Plugins
Step 1: Sign up for ChatGPT Plus Subscription Plan for $20/month.
Step 2: Go to “Settings” then “Beta Features” and select “Plugins”
Step 3: Select Version, then Plugin Store.
Step 4: Find the plugin that you want to install and click “Install”
There are four main types of ChatGPT Plugins:
Third Party Plugins
These plugins are developed by external developers, offering a plethora of unique features that cater to specific needs. Some 3rd party plugins are available for ChatGPT, such as Expedia, Fiscal Note, Instacart, KAYAK, Klarna, OpenTable, Wolfram, and Zapier. As we dive into the world of ChatGPT plugins, you’ll discover how these third-party applications are transforming the way we interact with AI models, providing a more seamless and intuitive experience for users across various domains.
Web Browsing Plugins
Empowering ChatGPT with internet access, these plugins utilize Bing AI to browse the web and retrieve relevant information on demand.
The ChatGPT Browsing Plugin is an experimental model that enables ChatGPT to access the internet and provide users with up-to-date information. This feature is inspired by past work such as WebGPT, GopherCite, BlenderBot2, and LaMDA2, and aims to enhance ChatGPT’s capabilities by expanding its knowledge base beyond its training corpus. The browsing plugin prioritizes safety and adherence to web norms, utilizing a text-based browser that only makes GET requests, which limits security risks. It retrieves content using the Bing search API, benefiting from Microsoft’s work on source reliability and safe-mode features.
To respect content creators and web norms, the plugin uses the ChatGPT-User user-agent token, honors robots.txt files, and has implemented rate-limiting measures. When a website blocks ChatGPT, the plugin will display a “click failed” message. The browsing plugin also shows visited websites and cites sources in ChatGPT’s responses to promote transparency, accuracy, and credit to content creators. See demo of ChatGPT Browsing Plugin in the video below:
Code Interpreter Plugins
The ChatGPT Code Interpreter Plugin is an experimental feature that integrates a Python interpreter within a secure and sandboxed environment. This enables ChatGPT to perform various tasks like solving mathematical problems, conducting data analysis, and converting files between formats. Users can upload files to the conversation workspace and download the results. The main aim is to provide a natural interface for fundamental computer capabilities and make programming more accessible to new audiences. To ensure safety, the execution environment is secured, has strict network controls to prevent external internet access, and imposes resource limits on each session. See demo of the ChatGPT Interpreter plugin in the video below:
The open-source retrieval plugin for ChatGPT enables users to access personal or organizational information sources, such as files, notes, emails, and public documentation, by asking questions or expressing needs in natural language. This self-hosted solution allows developers to deploy their own version of the plugin, register it with ChatGPT, and choose a vector database for indexing and searching documents. Information sources can be synchronized with the database using webhooks. These plugins ensure that ChatGPT generates accurate and up-to-date responses. View a demo of the ChatGPT Retrieval Plugin here.
The ChatGPT Retrieval Plugin allows you to effortlessly search and locate personal or professional documents by posing questions in everyday language. It can be accessed on GitHub.
Chat ChatGPT Generate Images?
At first glance, the answer to this question might seem like a no. You may be surprised to learn that there actually are some up-and-coming ChatGPT Plugins that can be used to generate images. StoryBird.AI is quickly becoming a popular ChatGPT Plugin. Using this plugin, you can quickly create illustrated books from simple prompts. It’s currently in beta so you need to enable beta features in your ChatGPT account.
Learn how to enable StoryBird.AI for free here.
Mixerbox ImageGen is another ChatGPT plugin that can generate images. They have several other ChatGPT plugins, including MixerBox ChatPDF, which will summarize and analyze PDF files, and MixerBox ChatMap, the 1st ChatMap powered by Google Maps API.
Argil is another up-and-coming ChatGPT plugin that allows you to train the AI on your image data and generate generic and custom images. You must sign up with Argil before installing the plugin in ChatGPT. Here’s an example of an image generated using ChatGPT with the Argil plugin:
Popular ChatGPT Plugins
From harnessing the power of perfect prompts to interacting with apps, exploring academic literature, or even learning a new language, the world of ChatGPT plugins offers a diverse array of capabilities designed to enhance user experiences. These plugins provide a suite of tools that cater to a wide range of user needs, from communication and learning, to planning, data visualization, and web search. Let’s delve into the functionalities of these popular plugins:
Type ‘perfect’, and this plugin helps you craft the perfect prompt every time, enhancing your interaction with the AI.
Your AI-powered language tutor. Learn to say anything in another language with the Speak plugin.
Show Me Diagrams
This plugin allows you to create and edit diagrams directly in chat, facilitating visual data representation.
Browse and QA webpages, PDFs, and data. Generate articles from one or more URLs for simplified information extraction.
Enables search of YouTube transcripts, financial data sources, Google Search results, and much more!
Dive deep into your documents with this plugin. Unlock the power of your PDFs, find answers, and bring information to your fingertips.
Explore data, visualize, and share notebooks in Python, SQL, and Markdown with everyone.
Interact with online video platforms like YouTube or Daily Motion, making video content more accessible and insightful.
Make your trip plans a reality. This plugin helps you get there, stay there, and find things to see and do.
Access computation, math, curated knowledge, and real-time data through Wolfram|Alpha and Wolfram Language.
Unleash the power of scientific research with this plugin. Search over 40M+ peer-reviewed papers, explore scientific PDFs, and save to reference managers.
Interact with over 5,000+ apps like Google Sheets, Gmail, HubSpot, Salesforce, and many more. Automate workflows and improve productivity.
Chat with everything from entire PDF books to Google Drive documents just by providing a link. Simplify your document interaction process.
Search flights, stays, and rental cars or get recommendations on where you can go within your budget.
Read any links, including webpages, YouTube, PDF, PPT, images, Word docs, etc. It also provides OCR for images and facilitates web search and browsing.
Search and browse the web using Google Search results with KeyMate.AI, your AI-powered web crawler.
List of Third-Party ChatGPT Plugins
Learn more about these incredible collaborations and the potential impact they will have on the future of AI-powered applications.
Expedia Group has collaborated with OpenAI to create a plugin for ChatGPT, which allows users to plan and book trips through a conversation with the model. The plugin connects users to Expedia Group’s library of travel data and sends them to Expedia to finalize the purchase. This plugin is the first of its kind in the travel industry, enabling ChatGPT to use external tools or “plugins” for various use cases, including booking flights and retrieving information from a proprietary database. The plugin’s goal is to simplify trip planning for ChatGPT users by providing up-to-date information on the availability and price of flights, hotels, vacation rentals, activities, and car rentals across the world.
FiscalNote, a provider of political, legal, and regulatory intelligence, is collaborating with OpenAI to leverage its protocol for trusted developers to expose certain data and information to OpenAI’s user base. The collaboration aims to gain insights into how users may use generative models to understand political and regulatory information in the future, and to create a flywheel to drive future product development for FiscalNote’s domain-specific models. This will enable FiscalNote to extend its leadership in the application of AI and large language models related to these specialized data sets.
Instacart has collaborated with OpenAI to introduce an Instacart plugin for ChatGPT that will help users shop for food and recipe-related conversations with ChatGPT and have the ingredients delivered to their doorstep. The plugin combines ChatGPT’s natural language processing capabilities with Instacart’s AI technology, enabling users to shop for ingredients by adding all necessary items to their Instacart cart in just a few clicks. With Instacart’s rich catalog of more than 1.5 million products from over 1,100 retail banners, users can rely on ChatGPT for meal planning inspiration, with Instacart turning it into a reality. The Instacart ChatGPT plugin will be rolled out gradually to ChatGPT users over the coming weeks.
On March 23, 2023, KAYAK announced its integration on ChatGPT. This integration allows ChatGPT to act as a virtual travel assistant, enabling more conversational interactions with KAYAK’s search engine. By typing in natural language queries, such as “Where can I fly to from Nashville for under $600 in March?” users will receive personalized recommendations based on their search criteria and KAYAK’s historical travel data. ChatGPT’s ability to understand and analyze natural language also helps KAYAK provide more personalized recommendations on its platform. This integration represents a step forward in the world of travel search, making it easier for travelers to plan their dream vacations.
Klarna introduced a plugin for ChatGPT that allows for a highly personalized and intuitive shopping experience. The plugin provides curated product recommendations to users who ask the platform for shopping advice and inspiration, along with links to shop for those products via Klarna’s search and compare tool. Klarna’s engineering teams have been working with OpenAI to integrate the plugin for ChatGPT, which will enable users to discover new products and solve problems for consumers at every stage of the shopping journey. The plugin will be gradually enabled for ChatGPT users, starting with ChatGPT Plus subscribers in the US and Canada. Over time, more users and regions will become available following a period of safety testing, development, and improvement.
OpenTable has become the first brand to bring restaurant recommendations to ChatGPT through its newly launched plugins, which come with a direct link to book on OpenTable. With this integration, users can ask for restaurant recommendations in a conversational way using natural language, and OpenTable’s recommendations will provide a link to make a reservation. The integration will roll out gradually, starting with ChatGPT Plus subscribers, with wider access after additional testing.
Wolfram is a company that develops computational technology and software for a wide range of applications, including data science, physics, engineering, finance, and more. It was founded by physicist and mathematician Stephen Wolfram in 1987. Its flagship product is the Wolfram Language, a high-level programming language with built-in support for symbolic and numerical computation.
The combination of ChatGPT and Wolfram|Alpha is considered the first large-scale statistical and symbolic AI system. Wolfram|Alpha was the first to offer natural language understanding, with “understanding” linked to computational representation and computation. Now, with ChatGPT, we can use the entire stack, from the neural net of ChatGPT to the computational language and knowledge of Wolfram Language. The result is a system that can generate “human-like” meaningful language and perform accurate computations.
With the Zapier ChatGPT plugin, users can automate tasks directly within ChatGPT’s interface, such as writing and sending chat messages, emails, and adding, updating or searching database items from 5,000+ apps like Google Sheets, Gmail, and Slack. The plugin is powered by Zapier’s new Natural Language Actions API, which enables AI models like ChatGPT to use simple natural language to complete actions in other apps.
Other Chat GPT plugins include Milo Family AI, Shop, and Speak. We’ll post more information on any new Chat GPT plugins as it becomes available.
ChatGPT Plugins are now available to all ChatGPT plus subscribers. You can sign up for ChatGPT Plus on the Open AI website.
ChatGPT Compatible Tools
Ghostwriter add-in for Microsoft Word
A new add-in for Microsoft Word, Ghostwriter, allows users to incorporate OpenAI’s ChatGPT directly into their Word documents. The add-in, created by entrepreneur Patrick Husting, integrates a Word sidebar with ChatGPT, enabling users to generate real-time AI-created content within their documents. Ghostwriter is available via the Office Add-in store with a Basic ($10 one-time fee) and Pro ($25 one-time fee) edition. The Basic version utilizes ChatGPT and has a two-paragraph response limit, while the Pro version includes all available OpenAI language models and an adjustable response length. Users are also required to have a free OpenAI account for an API key to connect to the OpenAI service.
Surfer AI combines the capabilities of GPT-4 with its own proprietary technology like SERP analysis and NLP for more specialized tasks such as keyword research and content optimization.
Embra recently introduced Embra Plugins, now in early access for developers, which allow the integration of apps and data with AI systems. These plugins are backward compatible with ChatGPT Plugins. Developers can submit plugin ideas for early access and build public or private plugins that work with internal tools and data. Users maintain control over their AI and data, while developers must implement OAuth for user identification and maintain transparency. The platform supports custom plugins, with more foundation models coming soon.
ChatGPT can be used for SEO, for tasks such as keyword research, SEO analysis, content creation, competitor analysis, strategic recommendations, and performance monitoring. It can generate keyword suggestions, analyze SEO performance of webpages, and create SEO-optimized content. Furthermore, it can provide insights into competitors’ SEO strategies and offer actionable recommendations for improvement. With the aid of SEO plugins, ChatGPT can provide more detailed analysis, including metrics like response code, load time, meta tags, and keyword occurrence. These plugins enhance the functionality of ChatGPT, making it an even more powerful tool for SEO professionals to optimize their websites, create engaging content, and monitor their SEO performance.
Web Pilot Plugin
The Web Pilot tool is an AI tool that allows you to interact with web content. It can visit a webpage, extract specific information, and perform various tasks with the content from the URL.
SEO Assistant Plugin
The SEO Assistant can generate search engine keyword information in order to aid the creation of content.
SEO Core AI Plugin
Use AI to analyze and improve the SEO of a website. Get advice on websites, keywords, and competitors.
FAQs about Chat GPT
How do I access ChatGPT Plugins?
You must have a ChatGPT Plus account. Inside your ChatGPT Plus account, go to “settings” >> “beta features” >> and select “plugins”. Then from the GPT version drop-down menu, visit the “Plugin store” and select the plugins you want to install.
How do I use ChatGPT Plugins after I install them?
Here’s a link to a screen recording that shows how to enable ChatGPT Plugins.
Can I use ChatGPT for free?
ChatGPT 3.5 is free to use, but you’ll need ChatGPT Plus to access the latest model, GPT-4. You can use ChatGPT for free or sign up for ChatGPT Plus at openai.com.
What is the website for ChatGPT?
The official website for ChatGPT is openai.com. This website provides information about the features and capabilities of ChatGPT, as well as news and updates related to its development.
What is a Chat GPT Plugin?
Chat GPT plugins are third-party applications that allow the GPT language model to interact with external APIs. Chat GPT plugins are like little tools that can be added to a computer program called GPT, which can understand and use human language. These plugins can help GPT do even more things than it could before, like finding out what’s happening in the world right now, answering questions from a specific database of information, or even booking a flight or ordering food for you. Developers create plugins by writing a special set of instructions that GPT can understand, and once the plugin is added to GPT, it can start using those instructions to do new things. These plugins are still being tested, but in the future, they could be used to make GPT even more useful to people in all sorts of ways.
GPT stands for Generative Pre-trained Transformer. It is a language model developed by OpenAI trained on large amounts of text data to understand human language and generate natural-sounding responses to given prompts. GPT models have been used in various applications, including chatbots, language translation, and content generation.
OpenAI is a research organization focused on advancing artificial intelligence (AI). It was founded in 2015 by several prominent figures in the technology industry, including Elon Musk, Sam Altman, Greg Brockman, Ilya Sutskever, and Wojciech Zaremba. OpenAI researches a wide range of AI-related topics, from natural language processing and computer vision to robotics and reinforcement learning.
API stands for Application Programming Interface. An API is a set of guidelines and standards for accessing a web-based software application or web tool. APIs enable different software applications to communicate and share data, allowing developers to create new applications or build on existing ones using the functionality of other applications. APIs typically define the methods of communication between two different systems and specify the data formats to be exchanged. Many companies and organizations offer APIs for their products and services, making it easier for developers to integrate those services into their own applications.
The development and integration of ChatGPT plugins showcase the incredible potential and versatility of AI-powered language models in various real-world applications. Collaborations between OpenAI and companies across different industries are transforming how we interact with technology, making it more efficient.
As the ChatGPT plugin ecosystem continues to expand, we can expect even more innovative applications and solutions that harness the power of AI to streamline tasks, provide valuable insights, and enhance our daily lives. The future of AI is exciting, and I look forward to witnessing the ongoing evolution of AI and AI website builders and their impact on the world of artificial intelligence.