diff options
author | S. Solomon Darnell | 2025-03-28 21:52:21 -0500 |
---|---|---|
committer | S. Solomon Darnell | 2025-03-28 21:52:21 -0500 |
commit | 4a52a71956a8d46fcb7294ac71734504bb09bcc2 (patch) | |
tree | ee3dc5af3b6313e921cd920906356f5d4febc4ed /.venv/lib/python3.12/site-packages/litellm/caching/Readme.md | |
parent | cc961e04ba734dd72309fb548a2f97d67d578813 (diff) | |
download | gn-ai-master.tar.gz |
Diffstat (limited to '.venv/lib/python3.12/site-packages/litellm/caching/Readme.md')
-rw-r--r-- | .venv/lib/python3.12/site-packages/litellm/caching/Readme.md | 40 |
1 files changed, 40 insertions, 0 deletions
diff --git a/.venv/lib/python3.12/site-packages/litellm/caching/Readme.md b/.venv/lib/python3.12/site-packages/litellm/caching/Readme.md new file mode 100644 index 00000000..6b0210a6 --- /dev/null +++ b/.venv/lib/python3.12/site-packages/litellm/caching/Readme.md @@ -0,0 +1,40 @@ +# Caching on LiteLLM + +LiteLLM supports multiple caching mechanisms. This allows users to choose the most suitable caching solution for their use case. + +The following caching mechanisms are supported: + +1. **RedisCache** +2. **RedisSemanticCache** +3. **QdrantSemanticCache** +4. **InMemoryCache** +5. **DiskCache** +6. **S3Cache** +7. **DualCache** (updates both Redis and an in-memory cache simultaneously) + +## Folder Structure + +``` +litellm/caching/ +├── base_cache.py +├── caching.py +├── caching_handler.py +├── disk_cache.py +├── dual_cache.py +├── in_memory_cache.py +├── qdrant_semantic_cache.py +├── redis_cache.py +├── redis_semantic_cache.py +├── s3_cache.py +``` + +## Documentation +- [Caching on LiteLLM Gateway](https://docs.litellm.ai/docs/proxy/caching) +- [Caching on LiteLLM Python](https://docs.litellm.ai/docs/caching/all_caches) + + + + + + + |