Web Scraping Data for Generative AI - Learn how to feed your LLMs with web data

Опубликовано: 01 Январь 1970
на канале: Apify
18,792
214

In this video, we show you how to feed your large language models with web data using your favorite LLM integrations like 🦜🔗 LangChain, LlamaIndex 🦙 or Pinecone, and Apify Actors, like Website Content Crawler. Find out how to get data for generative AI.

💬 Join our AI and web scraping channel on Discord to continue the conversation:
  / discord  

🆓 Try Website Content Crawler to get data for your AI:
https://apify.com/apify/website-conte...

Extended GPT Scraper:
https://apify.com/drobnikj/extended-g...

Integrate 🦜🔗 LangChain with Apify Actors:
https://help.apify.com/en/articles/78...

👇 More resources on generative AI and LLMs:
https://blog.apify.com/tag/ai/

🛍️ AI-related Actors on Apify Store:
https://apify.com/store/categories/ai

Power up your AI game 🚀
Data is the fuel for AI, and the web is the largest source of data ever created. Today's most popular language models, like ChatGPT and LLaMA, were all trained on data scraped from the web. Apify gives you the tools to feed, fine-tune, or create your own AI models by bringing vast amounts of data from the web to your fingertips. Join our webinar to learn how to use these tools and ask questions from one of the lead developers of Website Content Crawler and our open-source web scraping library, Crawlee - Jindrich Bar.

In this video, you can find ⌛️
00:00 Introduction
00:40 How web scraping enabled the AI revolution
02:07 Website Content Crawler demo - why we created it, what it does, and how to ingest entire websites with it
28:28 Feeding large language models with data from the web via the 🦜🔗 LangChain integration
36:40 Enriching your LLMs using other Actors from Apify Store
43:11 Q&A
57:32 Conclusion

#generativeai #webscraping #llm #langchain #ai


На этой странице сайта вы можете посмотреть видео онлайн Web Scraping Data for Generative AI - Learn how to feed your LLMs with web data длительностью часов минут секунд в хорошем качестве, которое загрузил пользователь Apify 01 Январь 1970, поделитесь ссылкой с друзьями и знакомыми, на youtube это видео уже посмотрели 18,792 раз и оно понравилось 214 зрителям. Приятного просмотра!