NotionNext - null

☁️LangSmith平替Cloudflare发布 AI Gateway

type
status
date
slug
summary
tags
category
icon
password
😀
LangSmith 平替，几行代码搞定 AI Ops，赛博菩萨 Cloudflare 正式发布 AI Gateway！！
  1. 支持 AI 应用的性能，安全，可靠性和可观测性分析 👁️
  1. 支持多 LLM 负载均衡，支持 OpenAI，Amazon 等各种模型 :
    1. 未来支持构建数据集，微调模型
    1. 与 Workers AI 整合无缝体验
    🐏
    Workers AI 是 Cloudflare AI Platform 的一部分，主要为模型提供推理加速的 Infra Host 平台
    同时借助 Cloudflare 的平台和基础设施优势，可以支持更低的成本和更快的速度 Host Lora finetune 的 Huggingface 模型 比如 Llama2 降低 7 倍成本，Mistral 7B 降低 14 倍
    AI Gateway is generally available: a unified interface for managing and scaling your generative AI workloads
    AI Gateway is an AI ops platform that provides speed, reliability, and observability for your AI applications. With a single line of code, you can unlock powerful features including rate limiting, custom caching, real-time logs, and aggregated analytics across multiple providers
    AI Gateway is generally available: a unified interface for managing and scaling your generative AI workloads
    https://blog.cloudflare.com/ai-gateway-is-generally-available
    AI Gateway is generally available: a unified interface for managing and scaling your generative AI workloads
    notion image
    Cloudflare 同时提供 AI Playground 和 Dashboard 方便分析 AI 应用的消耗和成本控制
    notion image
    Cloudflare 支持与 Langchain 整合使用
    Using LangChainJS and Cloudflare Workers together
    We are incredibly stoked that our friends at LangChain have announced LangChainJS Support for Cloudflare Workers! In this post we'll show you how to build a sample application.
    Using LangChainJS and Cloudflare Workers together
    https://blog.cloudflare.com/langchain-and-cloudflare
    Using LangChainJS and Cloudflare Workers together
    AI Gateway 支持的模型涵盖主流的模型 Anthropic, Azure, AWS Bedrock, Google Vertex, and Perplexity
    Workers AI 还支持 Embedding Model
    notion image
    Models · Cloudflare Workers AI docs
    Browse our entire catalog of models.
    Models · Cloudflare Workers AI docs
    https://developers.cloudflare.com/workers-ai/models/#text-embeddings
    Models · Cloudflare Workers AI docs
    基于 Huggingface 的 TGI https://github.com/huggingface/text-generation-inference…，Cloudflare 支持 serverless GPU Host 14+ 模型，包括 Mistral 7B，Google Gemma 7B，DeepSeek
    GitHub - huggingface/text-generation-inference: Large Language Model Text Generation Inference
    Large Language Model Text Generation Inference. Contribute to huggingface/text-generation-inference development by creating an account on GitHub.
    GitHub - huggingface/text-generation-inference: Large Language Model Text Generation Inference
    https://github.com/huggingface/text-generation-inference
    GitHub - huggingface/text-generation-inference: Large Language Model Text Generation Inference
    Loading...

    No results found.