updates

docs/swarms/RAG/qdrant_rag.md

@@ -383,28 +383,45 @@ print(result)
 
 ## Best Practices
 
-| Category | Best Practice | Details |
+### Document Processing Strategy
-|----------|---------------|---------|
+
-| **Document Processing Strategy** | | |
+| Practice | Recommendation | Details |
-| | Chunking | Split large documents into 200-500 token chunks for optimal retrieval |
+|----------|----------------|---------|
-| | Overlap | Use 20-50 token overlap between chunks to maintain context |
+| **Chunking** | 200-500 tokens | Split large documents into optimal chunks for retrieval |
-| | Preprocessing | Clean and normalize text before indexing |
+| **Overlap** | 20-50 tokens | Maintain context between consecutive chunks |
-| **Collection Organization** | | |
+| **Preprocessing** | Clean & normalize | Remove noise and standardize text format |
-| | Separation | Use separate collections for different document types (technical docs, policies, etc.) |
+
-| | Naming | Implement consistent naming conventions for collections |
+### Collection Organization
-| | Lifecycle | Consider document lifecycle and update strategies |
+
-| **Embedding Model Selection** | | |
+| Practice | Recommendation | Details |
-| | Development | Use `all-MiniLM-L6-v2` for fast iteration |
+|----------|----------------|---------|
-| | Production | Use `text-embedding-3-small` or `text-embedding-3-large` for quality |
+| **Separation** | Type-based collections | Use separate collections for docs, policies, code, etc. |
-| | Specialized | Consider domain-specific embedding models for specialized domains |
+| **Naming** | Consistent conventions | Follow clear, descriptive naming patterns |
-| **Performance Optimization** | | |
+| **Lifecycle** | Update strategies | Plan for document versioning and updates |
-| | Retrieval Count | Start with 3-5 results, adjust based on performance testing |
+
-| | Batch Operations | Use `batch_add()` for efficient bulk document ingestion |
+### Embedding Model Selection
-| | Metadata Strategy | Store relevant metadata for enhanced filtering and context |
+
-| **Production Deployment** | | |
+| Environment | Recommended Model | Use Case |
-| | Storage | Use Qdrant Cloud or self-hosted server for persistent storage |
+|-------------|-------------------|----------|
-| | Error Handling | Implement proper error handling and retry mechanisms |
+| **Development** | `all-MiniLM-L6-v2` | Fast iteration and testing |
-| | Monitoring | Monitor performance metrics and embedding quality |
+| **Production** | `text-embedding-3-small/large` | High-quality production deployment |
+| **Specialized** | Domain-specific models | Industry or domain-focused applications |
+
+### Performance Optimization
+
+| Setting | Recommendation | Rationale |
+|---------|----------------|-----------|
+| **Retrieval Count** | Start with 3-5 results | Balance relevance with performance |
+| **Batch Operations** | Use `batch_add()` | Efficient bulk document processing |
+| **Metadata** | Strategic storage | Enable filtering and enhanced context |
+
+### Production Deployment
+
+| Component | Best Practice | Implementation |
+|-----------|---------------|----------------|
+| **Storage** | Persistent server | Use Qdrant Cloud or self-hosted server |
+| **Error Handling** | Robust mechanisms | Implement retry logic and graceful failures |
+| **Monitoring** | Performance tracking | Monitor metrics and embedding quality |
 
 ## Performance Tips