Saltar al contenido principal
Al continuar, acepta nuestros Términos de uso, nuestra Política de privacidad y que sus datos se almacenan en los EE. UU.

Altavoces

Más información

¿Entrenar a 2 o más personas?

Obtenga acceso de su equipo a la biblioteca completa de DataCamp, con informes centralizados, tareas, proyectos y más
Pruebe DataCamp Para EmpresasPara obtener una solución a medida, reserve una demostración.

Buy or Train? Using Large Language Models in the Enterprise

July 2023
Compartir

Large Language Models (LLMs) like GPT, Bard and LLaMA have taken the world by storm. However, enterprise adoption presents a dilemma. Do you access a proprietary model through an API and try to deal with the data privacy risks? Do you use an off-the-shelf LLM and fine-tune it to meet your needs? Or do you start from scratch and train your own LLM?

In this (mostly) non-technical webinar, Hagay talks you through the pros and cons of each approach to help you make the right decisions for safely adopting large language models in your organization.

Key Takeaways:

  • Learn what choices you have for using large language models and other generative AI models in the enterprise.
  • Learn how to make the right decisions for safe adoption of AI in business.
  • Learn how MosaicML can help you manage AI at your organization.

Link to slides

Hagay's company, MosaicML

Hagay's company's GitHub repos

[SKILL TRACK] AI Essentials

Summary

In an age marked by rapid advancements in artificial intelligence, the use of large language models (LLMs) has become essential for organizations looking to utilize AI's full potential. The discussion sheds light on the process of choosing between purchasing or developing AI models for enterprise needs, providing insights into the challenges and benefits of each approach. Haggai Lopescu, from Mosaic ML, explores the history and evolution of NLP, revealing how AI technologies have shifted from symbolic to neural methods. The session discusses the expanding ecosystem of open-source models, like Meta's LLAMA2, and their competitiveness with closed-source models like OpenAI's ChatGPT. The complexities of using APIs, implementing open-source models, and developing proprietary models are examined to provide clarity on how organizations can optimally implement LLMs. Additionally, ethical considerations and the significance of data privacy in AI implementation are highlighted, underlining the need for trust and compliance. Ultimately, the session serves as a guide for enterprises to strategically adopt LLMs while addressing cost, customization, and ethical challenges.

Key Takeaways:

  • Understanding the advantages and limitations of purchasing versus developing large language models.
  • The significance of data privacy and ethical considerations in AI deployment.
  • The evolution of natural language processing from symbolic to neural networks.
  • Open-source models are becoming competitive with closed-source alternatives.
  • The role of infrastructure and expertise in successfully utilizing AI models.

Deep Dives

Using Large Language Models in Enterprises

...
Leer Mas

Enterprises today face a critical decision in AI implementation: whether to purchase or develop large language models (LLMs). The decision depends on factors such as cost, expertise, data privacy, and the specific needs of the organization. Purchasing LLMs through APIs offers a fast and cost-effective entry point, allowing businesses to use sophisticated models without extensive machine learning expertise. However, this approach limits customization and can become expensive at scale, especially when extensive API usage is required. Moreover, data privacy concerns arise as sensitive data is transmitted to external servers. On the other hand, developing proprietary models provides complete control over customization, data privacy, and cost efficiency at scale. Despite initial high costs and the need for machine learning expertise, developing in-house models enables companies to create a unique competitive edge. Haggai Lupescu emphasizes, "LLMs are within reach for most organizations; you just need to find the right path that works for your needs."

The Emergence of Open-Source Models

The session sheds light on the growing influence of open-source models, particularly Meta's LLAMA2, which showcases competitive performance against leading closed-source counterparts like ChatGPT. Open-source models offer a significant advantage by allowing organizations full control over data privacy and the ability to customize models for specific tasks. The field is rapidly evolving, with new models continually emerging, offering various sizes and capabilities. Despite their growing effectiveness, open-source models still face challenges, such as licensing concerns and the need for machine learning expertise to integrate and fine-tune models. “What’s exciting is that open-source models are closing the gap rapidly,” notes Haggai Lopescu, highlighting the potential for these models to become the top choices in the future.

Challenges and Opportunities in Ethical AI

As LLMs become more common, ethical considerations have emerged as a critical aspect of AI deployment. Bias in AI models is a significant concern, as these models are trained on real-world data that inherently contains biases. Addressing these biases is essential for ethical AI practice. Both AI developers and consumers must assess their models for prejudices and employ techniques to mitigate them. The discussion also covers data privacy and the evolving trust relationship between enterprises and AI providers. Haggai Lopescu highlights the importance of transparency and compliance in earning trust, particularly in sensitive sectors like finance and healthcare. As he rightly puts it, "Bias mitigation is something both providers and consumers of LLMs should think about."

Cost and Infrastructure Considerations

Implementing LLMs involves managing complex cost and infrastructure factors. While purchasing LLMs via APIs offers low initial costs, expenses can quickly escalate with increased usage. Conversely, developing models from scratch incurs significant upfront costs, yet offers long-term cost efficiency at scale. Infrastructure plays an important role in optimizing these costs, with cloud services providing the flexibility needed for training and inference. Haggai Lupescu advises implementing cloud platforms to save time and money, emphasizing the need for a fault-tolerant training stack to handle GPU failures. Additionally, the need for a skilled team is vital, as expertise in machine learning, neural networks, and data curation directly impacts the quality and effectiveness of the AI models.


Relacionado

webinar

Best Practices for Putting LLMs into Production

The webinar aims to provide a comprehensive overview of the challenges and best practices associated with deploying Large Language Models into production environments, with a particular focus on leveraging GPU resources efficiently.

webinar

Understanding LLM Inference: How AI Generates Words

In this session, you'll learn how large language models generate words. Our two experts from NVIDIA will present the core concepts of how LLMs work, then you'll see how large scale LLMs are developed.

webinar

Making Decisions with Data & AI

In this webinar, Dhiraj shares his advice both from building a multi-billion dollar data-driven company and from helping other companies tackle their data problems.

webinar

Best Practices for Developing Generative AI Products

In this webinar, you'll learn about the most important business use cases for AI assistants, how to adopt and manage AI assistants, and how to ensure data privacy and security while using AI assistants.

webinar

Scaling Enterprise Value with AI: How to Prioritize ChatGPT Use Cases

Learn to navigate privacy and security concerns, the ethical and compliance considerations, and the human factors to safely incorporate generative AI in your organization.

webinar

Getting ROI from AI

In this webinar, Cal shares lessons learned from real-world examples about how to safely implement AI in your organization.

Hands-on learning experience

Companies using DataCamp achieve course completion rates 6X higher than traditional online course providers

Learn More

Upskill your teams in data science and analytics

Learn More

Join 5,000+ companies and 80% of the Fortune 1000 who use DataCamp to upskill their teams.

Don’t just take our word for it.