TypeChat: Microsoft's New AI Tool Enables Building Applications Using Natural Language

2023-07-24

Microsoft is in its AI era. The company has been integrating OpenAI's models into Office, Bing, and even Windows. Now, the tech giant is open-sourcing a toolkit that allows developers to enjoy this level of AI integration. Microsoft recently released TypeChat, a software toolkit aimed at enhancing traditional UI with the power of AI. By leveraging the code generation capabilities of LLM, Microsoft researchers have created a system that helps AI algorithms communicate with applications. This allows users to interact with software using natural language input, in addition to existing UI elements. Importantly, this toolkit can be used with any LLM of developers' choice in a truly open-source manner, opening the door to AI-driven applications worldwide. Just as Microsoft is creating the future of computing by tightly integrating AI into applications used by millions of people every day, it is also driving a developer movement for greater AI integration in everyday applications. TypeChat Overview: One of the biggest challenges developers face when integrating LLM into software is that language models rarely provide machine-readable text. Even when prompted to provide structured data, LLM performs poorly. However, Microsoft's team found that these generative AI algorithms perform well in converting user queries into JSON (JavaScript Object Notation) format, which is highly useful for machines. In the examples provided by Microsoft in their blog, LLM accurately transcribes a customer's order into a JSON output with minimal errors. To ensure this happens consistently, they further refined the technique by adding a type requirement to the output. For example, when asked to respond with a predefined output type "Response," LLM creates a more precise and structured output for the query. This code can also be validated by the TypeScript compiler, which is the compiler used by the researchers. This paves the way for clean, structured, and machine-readable output in the workflow of applications. This approach, temporarily referred to as "response mode," can be used for various different applications by defining a specific pattern for each use case. Some showcased applications include sentiment analysis, creating applications using the "API mode," and "data mode" for structured output. As mentioned earlier, this project is not only open-source but also has pipelines to plug in different LLMs. While it is built on the OpenAI API and Azure OpenAI services, the researchers explicitly mention that it can be used with "any chat-style API." However, they also state that TypeChat is best suited for models trained on both prose and code. TypeChat is just one of the latest announcements in a highly innovative environment that enables developers to create future applications. Future AI Tools: TypeChat is just one of the latest achievements in LLM integration tools. It can be said that this field was sparked by the launch of LangChain, which has seen significant innovation in the past few months. Even AI agents, which once shone in products like AutoGPT and Baby AGI, can be classified as AI tools. Additionally, LLM has become more powerful in parsing large databases with the emergence of vector database systems like PineCone and Weavite. Any successful innovation in the software field is amplified by the movements in the developer ecosystem. The power of open-source development tools is evident, as seen in the explosive innovation surrounding Meta's LLaMA model. Even executives of tech giants acknowledge that top AI companies no longer have moats, and open-source will eventually prevail. According to a survey by Sequoia Capital, only 15% of respondents built custom language models from scratch or using open-source. However, 38% expressed interest in application development frameworks around LLM, and a staggering 94% used pre-trained models. Another interesting finding is that 88% of respondents stated that retrieval mechanisms like vector databases are a key part of their tech stack. This shows a strong demand in this field for more developer-oriented LLM tools. At the 2023 Microsoft Build conference, the company announced a series of development tools, ranging from adopting OpenAI's plugin standard to enhancing the WinML API. These tools also serve the same verticals as TypeChat, targeting developers who want to build AI applications. With the rise of this ecosystem, developers will soon have tools to create applications that integrate with AI through a simple text box and link multiple models together, creating an AI that can only be found in science fiction novels. Source: https://analyticsindiamag.com/microsoft-typechat-will-create-the-apps-of-the-future/

RECENT AI NEWS

RECENT AI TOOLS