We are excited to announce the integrations of pay-as-you-go inference APIs through Models-as-a-Service (MaaS) with ClearML, Arize AI, and Dataloop. These collaborations are designed to extend the reach and enhance the accessibility of our MaaS to diverse platforms, facilitating seamless integration and use by a broader audience of developers and businesses. With MaaS available on these GenAI development platforms, now developers can continue using their preferred tools to build GenAI apps while leveraging enterprise grade pay-as-you-go APIs. These APIs are subject to Azure's data, privacy, and security commitments, ensuring Microsoft does not share your data with third parties without your permission. Your data, including the data generated through your organization’s use of Models as a Service on Azure – such as prompts and responses – are kept private and are not disclosed to third parties.
Strategic Collaborations to Drive AI Innovation
The integration of Azure AI MaaS with ClearML, Arize AI, and Dataloop aims to empower users of these platforms with advanced AI capabilities directly within their preferred environments. This expansion not only simplifies the implementation process for users but also enhances the functional breadth of each partner platform.
Arize AI: Advancing Model Evaluation, Tracing and Observability
By offering access to Azure AI MaaS models like Llama 3, Mistral Large or Cohere Command R+, Azure is making it faster to build generative AI applications than ever. Through a seamless integration with Arize, AI engineers and developers can ensure enterprise grade deployments of sophisticated generative AI systems.
Arize is a market leading AI evaluation, tracing and observability platform that empowers teams to deliver AI into production with confidence. Arize offers AI observability for any LLM or ML-powered application built on top of Azure's stack. With native support for Azure AI Studio users, Arize enables complete visibility and debugging across every layer of an LLM-based software system: the application, the prompt and the response. Arize offers a free signup and its team also maintains Phoenix, a popular open source LLM evaluation and observability library.
Azure AI MaaS in the Arize platform
AI observability workflow in Arize AI
Dataloop: Accelerating Unstructured Data Pipelines
Dataloop is an enterprise-grade end to-end AI development platform for building and deploying powerful GenAI applications. It includes robust data management for visualizing and searching through troves of unstructured data, an orchestration layer for customizing production RLHF (Reinforcement Learning from Human Feedback), RAG (Retrieval Augmented Generation) and Gen AI data pipelines, MLOps (Machine Learning Operations) tooling, an AI cloud environment and a model marketplace for streamlining the data and AI building process. Integrating with Dataloop allows for better data management, annotation and model accuracy, facilitating more effective training and refinement of AI models.
“Developers building with Dataloop gain speed with scalable dataset curation, easy-to-use pipeline building, enhanced human annotation feedback tools for model accuracy, facilitating more effective training and refinement of AI models,” said Nir Buschi, Co-Founder & Chief Business Officer. “This partnership represents a significant milestone in our mission to democratize AI development. Integrating Azure AI MaaS provides our users with access to cutting-edge technologies, further enhancing our robust AI development ecosystem.”
Microsoft Marketplace Hub, including MaaS, in Dataloop platform
ClearML: Enhancing Automation and Scalability
Through our work with ClearML, users can now leverage Azure AI MaaS models within the ClearML environment to automate and optimize their AI workflows. This integration allows for greater scalability and efficiency, enabling developers to focus more on innovation and less on operational logistics.
ClearML's Low-code LLM Application Builder with Azure AI MaaS provides customers with a streamlined way to address GenAI use cases for their organizations with customized LLMs. RAG implementation, often a complex process, is simplified with integrated capabilities for fine-tuning embedding models and building vector databases, and the critical issue of keeping the human in the loop is solved through feedback capture prior to production and CI/CD (Continuous Integration and Continuous Delivery) model re-training. ClearML’s enterprise-grade security and granular policies prevent data leakage internally or externally with controlled access to training data, models, compute resources, API endpoints, vector databases, and other internal data sources referenced by your LLMs. Integrating Azure AI MaaS into the ClearML AI Platform accelerates time to value by seamlessly enabling model development, testing, and inference while preserving data privacy and security by keeping everything inside customers Azure account.
Unified Benefits: Accessibility, Efficiency, and Innovation
The core advantage of these integrations is the streamlined accessibility they provide—users on ClearML, Arize AI, and Dataloop can directly access and deploy MaaS models from Azure AI. This integration not only saves time and resources but also fosters a more innovative and efficient development environment.
"Integrating our Models as a Service with platforms like ClearML, Arize AI, and Dataloop is a pivotal step towards democratizing advanced AI technologies,” said Asha Sharma, Corporate Vice President, Product, Microsoft AI Platform. “By making these powerful tools more accessible, we are not only enhancing productivity and innovation but also enabling a broader spectrum of developers to build and deploy AI solutions at scale."
The collaboration with ClearML, Arize AI, and Dataloop represents an important achievement in our pledge to broaden the reach and practicality of Azure AI Models-as-a-Service. By integrating our sophisticated AI models into these platforms, we are augmenting their functionality while also providing developers and enterprises with essential resources to thrive in today's competitive tech environment.
Get Started
We invite developers and organizations to explore these new capabilities and integrate them into their projects. Visit Azure AI Studio and our partners’ platforms (ClearML, Arize AI, Dataloop) to discover how this expanded accessibility can benefit your AI initiatives.