diff options
| author | S. Solomon Darnell | 2025-03-28 21:52:21 -0500 |
|---|---|---|
| committer | S. Solomon Darnell | 2025-03-28 21:52:21 -0500 |
| commit | 4a52a71956a8d46fcb7294ac71734504bb09bcc2 (patch) | |
| tree | ee3dc5af3b6313e921cd920906356f5d4febc4ed /.venv/lib/python3.12/site-packages/litellm/batch_completion/Readme.md | |
| parent | cc961e04ba734dd72309fb548a2f97d67d578813 (diff) | |
| download | gn-ai-master.tar.gz | |
Diffstat (limited to '.venv/lib/python3.12/site-packages/litellm/batch_completion/Readme.md')
| -rw-r--r-- | .venv/lib/python3.12/site-packages/litellm/batch_completion/Readme.md | 11 |
1 files changed, 11 insertions, 0 deletions
diff --git a/.venv/lib/python3.12/site-packages/litellm/batch_completion/Readme.md b/.venv/lib/python3.12/site-packages/litellm/batch_completion/Readme.md new file mode 100644 index 00000000..23cc8712 --- /dev/null +++ b/.venv/lib/python3.12/site-packages/litellm/batch_completion/Readme.md @@ -0,0 +1,11 @@ +# Implementation of `litellm.batch_completion`, `litellm.batch_completion_models`, `litellm.batch_completion_models_all_responses` + +Doc: https://docs.litellm.ai/docs/completion/batching + + +LiteLLM Python SDK allows you to: +1. `litellm.batch_completion` Batch litellm.completion function for a given model. +2. `litellm.batch_completion_models` Send a request to multiple language models concurrently and return the response + as soon as one of the models responds. +3. `litellm.batch_completion_models_all_responses` Send a request to multiple language models concurrently and return a list of responses + from all models that respond.
\ No newline at end of file |