以编程方式使用文档

本页面介绍如何在 LangChain 中使用 Prediction Guard 生态系统。 它分为两部分:安装和设置,然后是特定 Prediction Guard 包装器的参考。

此集成在以下位置维护 langchain-predictionguard package.

安装和设置

  • - 安装 PredictionGuard LangChain 合作伙伴包:
pip install langchain-predictionguard
uv add langchain-predictionguard
  • - 获取 Prediction Guard API 密钥(如 Prediction Guard 文档中所述),并将其设置为环境变量(PREDICTIONGUARD_API_KEY)

## Prediction Guard LangChain 集成 |API|描述|端点文档|导入|示例用法| |---|---|---|---------------------------------------------------------|-------------------------------------------------------------------------------| |Chat|构建聊天机器人|Chat| from langchain_predictionguard import ChatPredictionGuard | ChatPredictionGuard.ipynb | |Completions|生成文本|Completions| from langchain_predictionguard import PredictionGuard | PredictionGuard.ipynb | |Text Embedding|将字符串嵌入向量|Embeddings| from langchain_predictionguard import PredictionGuardEmbeddings | PredictionGuardEmbeddings.ipynb |

开始使用

聊天模型

Prediction Guard 聊天

查看 使用示例

from langchain_predictionguard import ChatPredictionGuard

用法

# If predictionguard_api_key is not passed, default behavior is to use the `PREDICTIONGUARD_API_KEY` environment variable.
chat = ChatPredictionGuard(model="Hermes-3-Llama-3.1-8B")

chat.invoke("Tell me a joke")

嵌入模型

Prediction Guard 嵌入

查看 使用示例

from langchain_predictionguard import PredictionGuardEmbeddings

用法

# If predictionguard_api_key is not passed, default behavior is to use the `PREDICTIONGUARD_API_KEY` environment variable.
embeddings = PredictionGuardEmbeddings(model="bridgetower-large-itm-mlm-itc")

text = "This is an embedding example."
output = embeddings.embed_query(text)

LLMs

Prediction Guard LLM

查看 使用示例

from langchain_predictionguard import PredictionGuard

用法

# If predictionguard_api_key is not passed, default behavior is to use the `PREDICTIONGUARD_API_KEY` environment variable.
llm = PredictionGuard(model="Hermes-2-Pro-Llama-3-8B")

llm.invoke("Tell me a joke about bears")