From 4a52a71956a8d46fcb7294ac71734504bb09bcc2 Mon Sep 17 00:00:00 2001 From: S. Solomon Darnell Date: Fri, 28 Mar 2025 21:52:21 -0500 Subject: two version of R2R are here --- .../site-packages/litellm/caching/Readme.md | 40 ++++++++++++++++++++++ 1 file changed, 40 insertions(+) create mode 100644 .venv/lib/python3.12/site-packages/litellm/caching/Readme.md (limited to '.venv/lib/python3.12/site-packages/litellm/caching/Readme.md') diff --git a/.venv/lib/python3.12/site-packages/litellm/caching/Readme.md b/.venv/lib/python3.12/site-packages/litellm/caching/Readme.md new file mode 100644 index 00000000..6b0210a6 --- /dev/null +++ b/.venv/lib/python3.12/site-packages/litellm/caching/Readme.md @@ -0,0 +1,40 @@ +# Caching on LiteLLM + +LiteLLM supports multiple caching mechanisms. This allows users to choose the most suitable caching solution for their use case. + +The following caching mechanisms are supported: + +1. **RedisCache** +2. **RedisSemanticCache** +3. **QdrantSemanticCache** +4. **InMemoryCache** +5. **DiskCache** +6. **S3Cache** +7. **DualCache** (updates both Redis and an in-memory cache simultaneously) + +## Folder Structure + +``` +litellm/caching/ +├── base_cache.py +├── caching.py +├── caching_handler.py +├── disk_cache.py +├── dual_cache.py +├── in_memory_cache.py +├── qdrant_semantic_cache.py +├── redis_cache.py +├── redis_semantic_cache.py +├── s3_cache.py +``` + +## Documentation +- [Caching on LiteLLM Gateway](https://docs.litellm.ai/docs/proxy/caching) +- [Caching on LiteLLM Python](https://docs.litellm.ai/docs/caching/all_caches) + + + + + + + -- cgit v1.2.3