Microsoft Build 2024: Expanding AI Tools for Developers

Introduction to Microsoft Build 2024

Microsoft Build, the company’s flagship event for developers, continues to push the boundaries of innovation in AI and technology.

This year’s event, attended by over 200,000 registered participants and 4,000 in-person attendees, highlighted the evolution and expansion of AI tools, including the introduction of Copilot+ PCs, new AI models, and strategic partnerships.

With over 300 sessions, demos, and labs, the event provided three days of technical learning and community connection.

Groundbreaking Advances in AI

Over the past year, Microsoft has made significant strides in AI development, enhancing efficiency, customer experiences, and achieving new breakthroughs.

Key among these advancements is Microsoft Copilot, which has received over 150 updates, and the Copilot stack, empowering developers to build their own copilots. GitHub Copilot, widely adopted with 1.8 million paid subscribers, continues to revolutionize AI in software development.

Just a day before the event, Microsoft introduced Copilot+ PCs, the fastest, most AI-ready PCs ever built.

→ Microsoft Co-Pilot

Everyday Companion Providing Knowledge and Expertise
Microsoft Co-Pilot has been designed as an everyday companion, offering invaluable knowledge and expertise across various applications. It’s more than just an AI assistant; it’s a powerful tool that enhances productivity and efficiency in daily tasks.

The Co-Pilot Stack
The Co-Pilot stack is a comprehensive framework that enables developers to build sophisticated AI applications, solutions, and experiences. This stack leverages Microsoft’s cutting-edge technology and infrastructure, providing a robust foundation for innovative AI development.

Copilot + PCs
Microsoft has introduced a new category of Windows PCs called Copilot+ PCs, which are designed with AI capabilities at their core.

These devices feature advanced hardware, including a new Neural Processing Unit (NPU), and are capable of performing over 40 trillion operations per second. Copilot+ PCs offer all-day battery life, advanced AI models, and unique features such as Recall for enhanced search and memory, Cocreator for real-time image creation, and Live Captions for translating audio from over 40 languages into English.

These PCs come from Microsoft Surface and partners like Acer, ASUS, Dell, HP, Lenovo, and Samsung, with prices starting at $999 and availability beginning on June 18. They are designed to deliver exceptional performance, efficiency, and security, integrating deeply with cloud AI services to provide powerful, on-device AI experiences. This launch marks a significant evolution in the Windows platform, with an emphasis on AI-driven innovation across hardware and software.

→ Deep Partnership with Nvidia

Hardware and System Software Innovation
Microsoft’s collaboration with Nvidia is focused on advancing hardware and system software innovation. This partnership enhances the capabilities of Azure, ensuring it remains at the forefront of AI and computing technology.

Azure Confidential Computing on GPUs
A significant milestone in this collaboration is the introduction of Azure confidential computing on GPUs, which ensures sensitive data is protected while leveraging powerful GPU performance for complex AI tasks.

Latest Nvidia GPUs in Azure
Microsoft has integrated Nvidia’s latest GPUs into Azure, providing developers with the best tools for high-performance computing and AI applications.

→ AMD Collaboration

VMs Based on AMD’s AI Accelerator
Microsoft is the first cloud provider to offer virtual machines (VMs) based on AMD’s AI accelerator.

This collaboration focuses on delivering superior price-performance benefits, particularly for GPT-4 inference tasks, making advanced AI more accessible and cost-effective for users.

→ Azure AI and OpenAI

Broad Selection of Frontier and Open-Source Models
Azure AI now offers a wide range of frontier and open-source models, including advanced large language models (LLMs). This broad selection ensures developers have access to the latest and most powerful AI tools.

Partnership with OpenAI
Through its partnership with OpenAI, Microsoft brings groundbreaking innovations like GPT-4 to Azure. This collaboration has resulted in significant advancements in AI capabilities, particularly in multimodal processing (text, audio, image, video).

Demonstrations of GPT-4’s Multimodal Capabilities
During the event, Microsoft demonstrated GPT-4’s ability to handle various types of data inputs, showcasing its versatility and power in real-world applications.

→ Demonstrations and Applications

Interactive Demo
One of the standout demos was the integration of Co-Pilot with Minecraft, assisting users in real-time. This interactive demonstration highlighted the practical applications of Co-Pilot in gaming and beyond.

Retail and Customer Assistance
In retail, an AI assistant helps with product recommendations and shopping decisions, enhancing the customer experience and driving sales through intelligent interactions.

Educational Partnerships
Microsoft announced a new partnership with Khan Academy, aimed at making math tutoring more accessible. As part of this initiative, the AI assistant K Amigo is being made free for all US teachers, empowering educators with powerful AI tools.

→ New Tools and Capabilities

Azure AI Studio
Azure AI Studio is now generally available as a comprehensive development environment for AI models. The platform emphasizes AI safety with features to detect hallucinations, monitor risks, and block prompt injection attacks. It also introduces custom categories for unique filters and rapid deployment options.

Co-Pilot Studio
Co-Pilot Studio allows businesses to customize Co-Pilot for specific processes and workflows. New connectors enable integration of data from various sources, including third-party applications like Adobe and ServiceNow, enhancing flexibility and functionality.

Team Co-Pilot
Team Co-Pilot extends the capabilities of Co-Pilot to team collaboration tools. It acts as a meeting facilitator, project manager, and more, with a preview available later this year. This feature aims to streamline teamwork and project management.

Agent Capabilities
Looking to the future, Microsoft plans to build Co-Pilots with agent capabilities, allowing them to work asynchronously on behalf of users. These agents will manage complex tasks, provide continuous support, and enhance productivity without constant user input.

Vision and Mission

Microsoft emphasizes its mission to empower every person and organization through these innovations.

The focus is on creating impactful and meaningful experiences with technology, rather than celebrating technology for its own sake.

This vision underscores Microsoft’s commitment to using AI and advanced computing to make a positive difference in the world.

→ Additional Highlights

Microsoft goes mini-multimodal
Phi-3-vision, a new version of the Phi-3 AI model, offers multimodal capabilities compact enough for mobile devices, enhancing image analysis and AI applications on smartphones.

Microsoft Edge real-time video translation
Edge browser will soon offer AI-powered real-time video translation, providing seamless dubbing for videos from sites like YouTube and LinkedIn in multiple languages.

Custom emoji for Microsoft Teams
Users can now add their own emojis in Microsoft Teams, enhancing communication and team collaboration.

Qualcomm’s Snapdragon Dev Kit
A new compact PC with Snapdragon X Elite chip, offering high performance and flexibility for developers.

File Explorer as a Git repository
Microsoft integrates Git into File Explorer, allowing developers to manage projects directly within the file system browser.

AI-powered clipboard features in PowerToys
The new Advanced Paste feature in PowerToys suite for Windows 11 offers dynamic clipboard content conversion, enhancing productivity for users.

Conclusion

Microsoft Build 2024 has showcased a range of innovative AI tools and partnerships aimed at empowering developers to create cutting-edge applications.

With new hardware, software, and collaborative efforts, Microsoft continues to lead the AI revolution, providing developers with the resources they need to innovate and excel.

The event has reinforced Microsoft’s commitment to advancing AI technology and supporting the developer community in their journey towards building the future of AI.

If you want more updates related to AI, subscribe to our Newsletter