> ## Documentation Index
> Fetch the complete documentation index at: https://portkey-docs-cookbook-aws-sts-session-tags.mintlify.site/llms.txt
> Use this file to discover all available pages before exploring further.

# Overview

> Portkey connects with all major LLM providers and orchestration frameworks.

## Supported AI Providers

<CardGroup cols={3}>
  <Card title="OpenAI" href="/integrations/llms/openai">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-cookbook-aws-sts-session-tags/JRVdH51rc7NXw8Io/images/supported-llm/open-ai.avif?fit=max&auto=format&n=JRVdH51rc7NXw8Io&q=85&s=8057b279739ec69b83aefc4334206fb9" alt="OpenAI" width="245" height="138" data-path="images/supported-llm/open-ai.avif" />
    </Frame>
  </Card>

  <Card title="Anthropic" href="/integrations/llms/anthropic">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-cookbook-aws-sts-session-tags/JRVdH51rc7NXw8Io/images/supported-llm/anthroic.avif?fit=max&auto=format&n=JRVdH51rc7NXw8Io&q=85&s=9be2477020c9e92f25656d94f858ce81" alt="Anthropic" width="245" height="138" data-path="images/supported-llm/anthroic.avif" />
    </Frame>
  </Card>

  <Card title="Azure OpenAI" href="/integrations/llms/azure-openai">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-cookbook-aws-sts-session-tags/JRVdH51rc7NXw8Io/images/supported-llm/microsoft-assure.avif?fit=max&auto=format&n=JRVdH51rc7NXw8Io&q=85&s=e4b29c2d582b408017c8191898b9df11" alt="Azure OpenAI" width="245" height="138" data-path="images/supported-llm/microsoft-assure.avif" />
    </Frame>
  </Card>

  <Card title="AWS Bedrock" href="/integrations/llms/aws-bedrock">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-cookbook-aws-sts-session-tags/JRVdH51rc7NXw8Io/images/supported-llm/amazon.avif?fit=max&auto=format&n=JRVdH51rc7NXw8Io&q=85&s=3fcd86524dee404fbe423618734f0403" alt="AWS Bedrock" width="245" height="138" data-path="images/supported-llm/amazon.avif" />
    </Frame>
  </Card>

  <Card title="Cerebras" href="/integrations/llms/cerebras">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-cookbook-aws-sts-session-tags/fIqFL8udBHWgGmq4/images/llms/cerebras.avif?fit=max&auto=format&n=fIqFL8udBHWgGmq4&q=85&s=968a0b1e878990e4860a6ba64017b0df" alt="Cerebras" width="770" height="480" data-path="images/llms/cerebras.avif" />
    </Frame>
  </Card>

  <Card title="Google Gemini" href="/integrations/llms/gemini">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-cookbook-aws-sts-session-tags/JRVdH51rc7NXw8Io/images/supported-llm/google-gemini.avif?fit=max&auto=format&n=JRVdH51rc7NXw8Io&q=85&s=fee6e5d0ee1885d4647fb4b7c234488a" alt="Google Gemini" width="245" height="138" data-path="images/supported-llm/google-gemini.avif" />
    </Frame>
  </Card>

  <Card title="Vertex AI" href="/integrations/llms/vertex-ai">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-cookbook-aws-sts-session-tags/JRVdH51rc7NXw8Io/images/supported-llm/vertex-ai.avif?fit=max&auto=format&n=JRVdH51rc7NXw8Io&q=85&s=548e939fdbefc725464e8ddb5a53aab9" alt="Vertex AI" width="245" height="138" data-path="images/supported-llm/vertex-ai.avif" />
    </Frame>
  </Card>

  <Card title="Cohere" href="/integrations/llms/cohere">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-cookbook-aws-sts-session-tags/JRVdH51rc7NXw8Io/images/supported-llm/cohere.avif?fit=max&auto=format&n=JRVdH51rc7NXw8Io&q=85&s=74e9bbadaf606be1d3a233018f72d5ef" alt="Cohere" width="245" height="138" data-path="images/supported-llm/cohere.avif" />
    </Frame>
  </Card>

  <Card title="Perplexity AI" href="/integrations/llms/perplexity-ai">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-cookbook-aws-sts-session-tags/JRVdH51rc7NXw8Io/images/supported-llm/perplexity-ai.avif?fit=max&auto=format&n=JRVdH51rc7NXw8Io&q=85&s=ea99cd9235f645388257bd9bb4217b71" alt="Perplexity AI" width="245" height="138" data-path="images/supported-llm/perplexity-ai.avif" />
    </Frame>
  </Card>

  <Card title="AI21" href="/integrations/llms/ai21">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-cookbook-aws-sts-session-tags/JRVdH51rc7NXw8Io/images/supported-llm/ai21.avif?fit=max&auto=format&n=JRVdH51rc7NXw8Io&q=85&s=b8dbb0f48bb61d076643c9a5df8769d6" alt="AI21" width="245" height="138" data-path="images/supported-llm/ai21.avif" />
    </Frame>
  </Card>

  <Card title="Anyscale" href="/integrations/llms/anyscale-llama2-mistral-zephyr">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-cookbook-aws-sts-session-tags/JRVdH51rc7NXw8Io/images/supported-llm/anyscale.avif?fit=max&auto=format&n=JRVdH51rc7NXw8Io&q=85&s=646a6754f7d723d80d2e640ef54e3667" alt="Anyscale" width="245" height="138" data-path="images/supported-llm/anyscale.avif" />
    </Frame>
  </Card>

  <Card title="Byollm" href="/integrations/llms/byollm" />

  <Card title="Dashscope" href="/integrations/llms/dashscope">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-cookbook-aws-sts-session-tags/JRVdH51rc7NXw8Io/images/supported-llm/dashscope.jpeg?fit=max&auto=format&n=JRVdH51rc7NXw8Io&q=85&s=f441557ee2ef4ae935af01d1cc72ea1b" alt="Dashscope" width="128" height="128" data-path="images/supported-llm/dashscope.jpeg" />
    </Frame>
  </Card>

  <Card title="Deepbricks" href="/integrations/llms/deepbricks">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-cookbook-aws-sts-session-tags/JRVdH51rc7NXw8Io/images/supported-llm/deepbricks.jpeg?fit=max&auto=format&n=JRVdH51rc7NXw8Io&q=85&s=06e0918480db71abe999cd6954173606" alt="Deepbricks" width="225" height="225" data-path="images/supported-llm/deepbricks.jpeg" />
    </Frame>
  </Card>

  <Card title="DeepInfra" href="/integrations/llms/deepinfra">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-cookbook-aws-sts-session-tags/JRVdH51rc7NXw8Io/images/supported-llm/deepinfa.avif?fit=max&auto=format&n=JRVdH51rc7NXw8Io&q=85&s=9efa22e7a7d12e663b2e8da2bd1178e3" alt="DeepInfra" width="245" height="138" data-path="images/supported-llm/deepinfa.avif" />
    </Frame>
  </Card>

  <Card title="DeepSeek" href="/integrations/llms/deepseek">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-cookbook-aws-sts-session-tags/JRVdH51rc7NXw8Io/images/supported-llm/deepseek.webp?fit=max&auto=format&n=JRVdH51rc7NXw8Io&q=85&s=afadea52fa4687b3339a416ad3fc6880" alt="DeepSeek" width="780" height="165" data-path="images/supported-llm/deepseek.webp" />
    </Frame>
  </Card>

  <Card title="Fireworks AI" href="/integrations/llms/fireworks">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-cookbook-aws-sts-session-tags/JRVdH51rc7NXw8Io/images/supported-llm/fireworks.png?fit=max&auto=format&n=JRVdH51rc7NXw8Io&q=85&s=2540e8136e2a118c8a96f0c479dfbad8" alt="Fireworks AI" width="240" height="136" data-path="images/supported-llm/fireworks.png" />
    </Frame>
  </Card>

  <Card title="Featherless AI" href="/integrations/llms/featherless">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-cookbook-aws-sts-session-tags/JRVdH51rc7NXw8Io/images/supported-llm/featherless.png?fit=max&auto=format&n=JRVdH51rc7NXw8Io&q=85&s=12d32d13275de5d280c7970c2e7e12c4" alt="featherless-AI" width="225" height="225" data-path="images/supported-llm/featherless.png" />
    </Frame>
  </Card>

  <Card title="Github Models" href="/integrations/llms/github">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-cookbook-aws-sts-session-tags/fIqFL8udBHWgGmq4/images/llms/github.png?fit=max&auto=format&n=fIqFL8udBHWgGmq4&q=85&s=34c52e8a53c624269a12d2292b49862f" alt="Github" width="954" height="482" data-path="images/llms/github.png" />
    </Frame>
  </Card>

  <Card title="Google Palm" href="/integrations/llms/google-palm">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-cookbook-aws-sts-session-tags/JRVdH51rc7NXw8Io/images/supported-llm/google-palm.avif?fit=max&auto=format&n=JRVdH51rc7NXw8Io&q=85&s=8328938ccf2a5efb896707670133cc8e" alt="Google Palm" width="245" height="138" data-path="images/supported-llm/google-palm.avif" />
    </Frame>
  </Card>

  <Card title="Groq" href="/integrations/llms/groq">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-cookbook-aws-sts-session-tags/JRVdH51rc7NXw8Io/images/supported-llm/groq.avif?fit=max&auto=format&n=JRVdH51rc7NXw8Io&q=85&s=a15f097bf4e92d74f5b41aef6cac8ffb" alt="Groq" width="245" height="138" data-path="images/supported-llm/groq.avif" />
    </Frame>
  </Card>

  <Card title="Jina AI" href="/integrations/llms/jina-ai">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-cookbook-aws-sts-session-tags/JRVdH51rc7NXw8Io/images/supported-llm/jina.png?fit=max&auto=format&n=JRVdH51rc7NXw8Io&q=85&s=2f1ab45237b67479eb1ca62e10966c47" alt="Jina AI" width="225" height="225" data-path="images/supported-llm/jina.png" />
    </Frame>
  </Card>

  <Card title="Lambda" href="/integrations/llms/lambda">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-cookbook-aws-sts-session-tags/JRVdH51rc7NXw8Io/images/supported-llm/lambda.png?fit=max&auto=format&n=JRVdH51rc7NXw8Io&q=85&s=ce506f5ab182c41e04554102ed4d8ca0" alt="Lambda" width="225" height="225" data-path="images/supported-llm/lambda.png" />
    </Frame>
  </Card>

  <Card title="Lemonfox AI" href="/integrations/llms/lemon-fox">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-cookbook-aws-sts-session-tags/JRVdH51rc7NXw8Io/images/supported-llm/lemonfox-ai.png?fit=max&auto=format&n=JRVdH51rc7NXw8Io&q=85&s=ed452fa811d3c6104dd06a2e860d4c26" alt="Lemonfox AI" width="225" height="225" data-path="images/supported-llm/lemonfox-ai.png" />
    </Frame>
  </Card>

  <Card title="Lepton AI" href="/integrations/llms/lepton">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-cookbook-aws-sts-session-tags/JRVdH51rc7NXw8Io/images/supported-llm/lepton.png?fit=max&auto=format&n=JRVdH51rc7NXw8Io&q=85&s=a8785c983bc75b4bf11fa84cbdd071fd" alt="Lepton AI" width="311" height="85" data-path="images/supported-llm/lepton.png" />
    </Frame>
  </Card>

  <Card title="Lingyi (01.ai)" href="/integrations/llms/lingyi-01.ai">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-cookbook-aws-sts-session-tags/JRVdH51rc7NXw8Io/images/supported-llm/lingyi.png?fit=max&auto=format&n=JRVdH51rc7NXw8Io&q=85&s=99bdf0419090480d004da66f180f6270" alt="Lingyi (01.ai)" width="200" height="200" data-path="images/supported-llm/lingyi.png" />
    </Frame>
  </Card>

  <Card title="LocalAI" href="/integrations/llms/local-ai">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-cookbook-aws-sts-session-tags/JRVdH51rc7NXw8Io/images/supported-llm/local.avif?fit=max&auto=format&n=JRVdH51rc7NXw8Io&q=85&s=d02065c390b4afb5c694fe5189bfa79f" alt="LocalAI" width="245" height="132" data-path="images/supported-llm/local.avif" />
    </Frame>
  </Card>

  <Card title="Mistral AI" href="/integrations/llms/mistral-ai">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-cookbook-aws-sts-session-tags/JRVdH51rc7NXw8Io/images/supported-llm/mistral.avif?fit=max&auto=format&n=JRVdH51rc7NXw8Io&q=85&s=7b7c2f0c6dbe5b02cc8f1694c3ef7bb2" alt="Mistral AI" width="245" height="138" data-path="images/supported-llm/mistral.avif" />
    </Frame>
  </Card>

  <Card title="MonsterAPI" href="/integrations/llms/monster-api">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-cookbook-aws-sts-session-tags/JRVdH51rc7NXw8Io/images/supported-llm/monster.avif?fit=max&auto=format&n=JRVdH51rc7NXw8Io&q=85&s=abb7be6f174b75829ec7d4f187b7e8bf" alt="MonsterAPI" width="245" height="138" data-path="images/supported-llm/monster.avif" />
    </Frame>
  </Card>

  <Card title="Moonshot" href="/integrations/llms/moonshot">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-cookbook-aws-sts-session-tags/JRVdH51rc7NXw8Io/images/supported-llm/moonshoot.jpg?fit=max&auto=format&n=JRVdH51rc7NXw8Io&q=85&s=2ab003becc678d5f7c4631202cbc2929" alt="Moonshot" width="224" height="224" data-path="images/supported-llm/moonshoot.jpg" />
    </Frame>
  </Card>

  <Card title="nCompass" href="/integrations/llms/ncompass">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-cookbook-aws-sts-session-tags/fIqFL8udBHWgGmq4/images/llms/ncompass.jpeg?fit=max&auto=format&n=fIqFL8udBHWgGmq4&q=85&s=c94d246b17967204e667f7232b776a23" alt="nCompass" width="200" height="200" data-path="images/llms/ncompass.jpeg" />
    </Frame>
  </Card>

  <Card title="Nebius" href="/integrations/llms/nebius">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-cookbook-aws-sts-session-tags/JRVdH51rc7NXw8Io/images/supported-llm/nebius.jpeg?fit=max&auto=format&n=JRVdH51rc7NXw8Io&q=85&s=0adca0bd6b03e4fb5e006599520dd76e" alt="Nebius" width="200" height="200" data-path="images/supported-llm/nebius.jpeg" />
    </Frame>
  </Card>

  <Card title="Nomic AI" href="/integrations/llms/nomic">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-cookbook-aws-sts-session-tags/JRVdH51rc7NXw8Io/images/supported-llm/nomic.avif?fit=max&auto=format&n=JRVdH51rc7NXw8Io&q=85&s=82dbf2f6b0671ec7c810c8c8fb991fc2" alt="Nomic AI" width="245" height="138" data-path="images/supported-llm/nomic.avif" />
    </Frame>
  </Card>

  <Card title="Nscale" href="/integrations/llms/nscale">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-cookbook-aws-sts-session-tags/JRVdH51rc7NXw8Io/images/supported-llm/nscale.jpeg?fit=max&auto=format&n=JRVdH51rc7NXw8Io&q=85&s=994d612cd6b809a647bd2d348dac48ea" alt="Nscale" width="259" height="194" data-path="images/supported-llm/nscale.jpeg" />
    </Frame>
  </Card>

  <Card title="Ollama" href="/integrations/llms/ollama">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-cookbook-aws-sts-session-tags/JRVdH51rc7NXw8Io/images/supported-llm/ollama.avif?fit=max&auto=format&n=JRVdH51rc7NXw8Io&q=85&s=a11b937f7018992ba8bf5cb0a4aec899" alt="Ollama" width="245" height="138" data-path="images/supported-llm/ollama.avif" />
    </Frame>
  </Card>

  <Card title="Openrouter" href="/integrations/llms/openrouter">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-cookbook-aws-sts-session-tags/JRVdH51rc7NXw8Io/images/supported-llm/openrouter.png?fit=max&auto=format&n=JRVdH51rc7NXw8Io&q=85&s=75e654450404d531d0734c9ebb8bb894" alt="Openrouter" width="224" height="224" data-path="images/supported-llm/openrouter.png" />
    </Frame>
  </Card>

  <Card title="Predibase" href="/integrations/llms/predibase">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-cookbook-aws-sts-session-tags/JRVdH51rc7NXw8Io/images/supported-llm/predise.avif?fit=max&auto=format&n=JRVdH51rc7NXw8Io&q=85&s=c318a21f1548fbfba26a8406f46ecaa7" alt="Predibase" width="245" height="132" data-path="images/supported-llm/predise.avif" />
    </Frame>
  </Card>

  <Card title="Recraft AI" href="/integrations/llms/recraft-ai">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-cookbook-aws-sts-session-tags/VSHGtFQigy70fGR_/images/llms/recraft.jpeg?fit=max&auto=format&n=VSHGtFQigy70fGR_&q=85&s=d85839f9d5b3b65b38f8d23c46361ecc" alt="Recraft" width="200" height="200" data-path="images/llms/recraft.jpeg" />
    </Frame>
  </Card>

  <Card title="Siliconflow" href="/integrations/llms/siliconflow">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-cookbook-aws-sts-session-tags/JRVdH51rc7NXw8Io/images/supported-llm/siliconflow.jpeg?fit=max&auto=format&n=JRVdH51rc7NXw8Io&q=85&s=a804ce1d260f0fa56bef19c702a00154" alt="Siliconflow" width="200" height="200" data-path="images/supported-llm/siliconflow.jpeg" />
    </Frame>
  </Card>

  <Card title="Snowflake Cortex" href="/integrations/llms/snowflake-cortex">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-cookbook-aws-sts-session-tags/fIqFL8udBHWgGmq4/images/llms/Snowflake%20Cortex%20Logo.png?fit=max&auto=format&n=fIqFL8udBHWgGmq4&q=85&s=5e9516f7dd621731c47ff8727a8ac1bb" alt="Snowflake" width="225" height="225" data-path="images/llms/Snowflake Cortex Logo.png" />
    </Frame>
  </Card>

  <Card title="Stability AI" href="/integrations/llms/stability-ai">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-cookbook-aws-sts-session-tags/JRVdH51rc7NXw8Io/images/supported-llm/stability.avif?fit=max&auto=format&n=JRVdH51rc7NXw8Io&q=85&s=53024c77926073631b08c88f14b40e8c" alt="Stability AI" width="245" height="138" data-path="images/supported-llm/stability.avif" />
    </Frame>
  </Card>

  <Card title="Together AI" href="/integrations/llms/together-ai">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-cookbook-aws-sts-session-tags/JRVdH51rc7NXw8Io/images/supported-llm/together-ai.avif?fit=max&auto=format&n=JRVdH51rc7NXw8Io&q=85&s=a6127bf39a07bece5261207e0255308f" alt="Together AI" width="245" height="138" data-path="images/supported-llm/together-ai.avif" />
    </Frame>
  </Card>

  <Card title="Triton" href="/integrations/llms/triton">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-cookbook-aws-sts-session-tags/JRVdH51rc7NXw8Io/images/supported-llm/triton.png?fit=max&auto=format&n=JRVdH51rc7NXw8Io&q=85&s=af5604787bc8d86cb84bfa5b787be483" alt="Triton" width="254" height="198" data-path="images/supported-llm/triton.png" />
    </Frame>
  </Card>

  <Card title="Upstage" href="/integrations/llms/upstage">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-cookbook-aws-sts-session-tags/JRVdH51rc7NXw8Io/images/supported-llm/upstage.jpeg?fit=max&auto=format&n=JRVdH51rc7NXw8Io&q=85&s=ae6ddb36ee4b7190d9ad919446268573" alt="Upstage" width="200" height="200" data-path="images/supported-llm/upstage.jpeg" />
    </Frame>
  </Card>

  <Card title="Voyage-AI" href="/integrations/llms/voyage-ai">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-cookbook-aws-sts-session-tags/JRVdH51rc7NXw8Io/images/supported-llm/voyage.png?fit=max&auto=format&n=JRVdH51rc7NXw8Io&q=85&s=37c3b1996f1fbb4a4cc26a058e462e78" alt="Voyage-AI" width="314" height="160" data-path="images/supported-llm/voyage.png" />
    </Frame>
  </Card>

  <Card title="Workers AI" href="/integrations/llms/workers-ai">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-cookbook-aws-sts-session-tags/JRVdH51rc7NXw8Io/images/supported-llm/worksai.jpg?fit=max&auto=format&n=JRVdH51rc7NXw8Io&q=85&s=eaa998cfbdba74a7a987e5eff1612a3c" alt="Workers AI" width="225" height="225" data-path="images/supported-llm/worksai.jpg" />
    </Frame>
  </Card>

  <Card title="ZhipuAI" href="/integrations/llms/zhipu">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-cookbook-aws-sts-session-tags/JRVdH51rc7NXw8Io/images/supported-llm/zhipu.avif?fit=max&auto=format&n=JRVdH51rc7NXw8Io&q=85&s=e67c3682538bc78834d108c1fab9b1e9" alt="ZhipuAI" width="245" height="132" data-path="images/supported-llm/zhipu.avif" />
    </Frame>
  </Card>

  <Card title="Z AI" href="/integrations/llms/z-ai">
    <Frame>
      <img src="https://mintcdn.com/portkey-docs-cookbook-aws-sts-session-tags/JRVdH51rc7NXw8Io/images/supported-llm/z-ai.png?fit=max&auto=format&n=JRVdH51rc7NXw8Io&q=85&s=d4cb4e403975837f8dc7c93a3b7b9aea" alt="Z-AI" width="250" height="250" data-path="images/supported-llm/z-ai.png" />
    </Frame>
  </Card>
</CardGroup>

## Endpoints Supported

For a detailed breakdown of supported endpoints and features per provider, refer to the table below:

<Card title="Supported Providers" href="/provider-endpoints/supported-providers" />

## Supported Frameworks

Portkey has native integrations with the following frameworks. Click to read their getting started guides.

<CardGroup cols={3}>
  <Card title="Langchain" href="/integrations/libraries/langchain-python">
    <img src="https://mintcdn.com/portkey-docs-cookbook-aws-sts-session-tags/JRVdH51rc7NXw8Io/images/supported-llm/langchain.avif?fit=max&auto=format&n=JRVdH51rc7NXw8Io&q=85&s=3e7f5c4a02a07c8c21f346b9a785f18f" alt="Langchain" width="245" height="138" data-path="images/supported-llm/langchain.avif" />
  </Card>

  <Card title="LlamaIndex" href="/integrations/libraries/llama-index-python">
    <img src="https://mintcdn.com/portkey-docs-cookbook-aws-sts-session-tags/JRVdH51rc7NXw8Io/images/supported-llm/llama.avif?fit=max&auto=format&n=JRVdH51rc7NXw8Io&q=85&s=895e793b3e2fe626971808dd182d0425" alt="LlamaIndex" width="245" height="138" data-path="images/supported-llm/llama.avif" />
  </Card>

  <Card title="Autogen" href="/integrations/libraries/autogen">
    <img src="https://mintcdn.com/portkey-docs-cookbook-aws-sts-session-tags/JRVdH51rc7NXw8Io/images/supported-llm/autogen.avif?fit=max&auto=format&n=JRVdH51rc7NXw8Io&q=85&s=9fbcdb976b0777e76fd6c21b6a1181a3" alt="Autogen" width="245" height="138" data-path="images/supported-llm/autogen.avif" />
  </Card>

  <Card title="Vercel" href="/integrations/libraries/vercel">
    <img src="https://mintcdn.com/portkey-docs-cookbook-aws-sts-session-tags/JRVdH51rc7NXw8Io/images/supported-llm/vercel.avif?fit=max&auto=format&n=JRVdH51rc7NXw8Io&q=85&s=5d6d47bec241d697341657577d89268c" alt="Vercel" width="245" height="132" data-path="images/supported-llm/vercel.avif" />
  </Card>

  <Card title="Instructor" href="/integrations/libraries/instructor">
    <img src="https://mintcdn.com/portkey-docs-cookbook-aws-sts-session-tags/JRVdH51rc7NXw8Io/images/supported-llm/instructor.avif?fit=max&auto=format&n=JRVdH51rc7NXw8Io&q=85&s=8593e78d07156f5334fb5216089577b1" alt="Instructor" width="245" height="132" data-path="images/supported-llm/instructor.avif" />
  </Card>

  <Card title="DSPy" href="/integrations/libraries/dspy">
    <img src="https://mintcdn.com/portkey-docs-cookbook-aws-sts-session-tags/JRVdH51rc7NXw8Io/images/supported-llm/dspy.png?fit=max&auto=format&n=JRVdH51rc7NXw8Io&q=85&s=2a8479d354cf86cf4c47ffc668f4f258" alt="DSPy" width="300" height="168" data-path="images/supported-llm/dspy.png" />
  </Card>

  <Card title="Promptfoo" href="/integrations/libraries/promptfoo">
    <img src="https://mintcdn.com/portkey-docs-cookbook-aws-sts-session-tags/JRVdH51rc7NXw8Io/images/supported-llm/prompftoo.avif?fit=max&auto=format&n=JRVdH51rc7NXw8Io&q=85&s=aa4f19ca4ec2fd06c0d9e5615fd84cb9" alt="Promptfoo" width="245" height="132" data-path="images/supported-llm/prompftoo.avif" />
  </Card>
</CardGroup>

Have a suggestion for an integration with Portkey? Tell us on [Discord](https://discord.gg/DD7vgKK299), or drop a message on [support@portkey.ai](mailto:support@portkey.ai).

While you're here, why not [give us a star](https://git.new/ai-gateway-docs)? It helps us a lot!

***

<Card title="Portkey is now PRISMA AIRS AI Gateway. See it in action." href="https://www.paloaltonetworks.in/ai-security/ai-gateway?utm_source=portkey&utm_medium=referral&utm_campaign=prisma_airs&utm_content=docs_nav#contact" icon="arrow-up-right-from-square">
  Contact Us
</Card>