Inference

• FlagAutoModel
  • FlagAutoModel
  • Methods
    • FlagAutoModel.from_finetuned()
• FlagAutoReranker
  • FlagAutoReranker
  • Methods
    • FlagAutoReranker.from_finetuned()
• Embedder
  • BaseEmbedder
    • BaseEmbedder
      • BaseEmbedder.DEFAULT_POOLING_METHOD
    • Methods
      • BaseEmbedder.encode_corpus()
      • BaseEmbedder.encode()
      • BaseEmbedder.encode_single_device()
      • BaseEmbedder.pooling()
  • M3Embedder
    • M3Embedder
      • M3Embedder.DEFAULT_POOLING_METHOD
    • Methods
      • M3Embedder.encode_queries()
      • M3Embedder.encode_corpus()
      • M3Embedder.encode()
      • M3Embedder.convert_id_to_token()
      • M3Embedder.compute_lexical_matching_score()
      • M3Embedder.colbert_score()
      • M3Embedder.encode_single_device()
      • M3Embedder.compute_score()
      • M3Embedder.compute_score_multi_process()
      • M3Embedder.compute_score_single_device()
  • BaseEmbedder
    • BaseLLMEmbedder
      • BaseLLMEmbedder.DEFAULT_POOLING_METHOD
    • Methods
      • BaseLLMEmbedder.encode_queries()
      • BaseLLMEmbedder.encode_corpus()
      • BaseLLMEmbedder.encode()
      • BaseLLMEmbedder.encode_single_device()
  • ICLLLMEmbedder
    • ICLLLMEmbedder
      • ICLLLMEmbedder.DEFAULT_POOLING_METHOD
    • Methods
      • ICLLLMEmbedder.encode_queries()
      • ICLLLMEmbedder.encode_corpus()
      • ICLLLMEmbedder.encode()
      • ICLLLMEmbedder.set_examples()
      • ICLLLMEmbedder.get_detailed_example()
      • ICLLLMEmbedder.encode_queries_single_device()
      • ICLLLMEmbedder.encode_single_device()
• Reranker
  • BaseReranker
    • BaseReranker
    • Methods
      • compute_score_single_gpu
  • BaseLLMReranker
    • BaseLLMReranker
    • Methods
      • compute_score_single_gpu
  • LayerWiseLLMReranker
    • LayerWiseLLMReranker
    • Methods
      • compute_score_single_gpu
  • LightweightLLMReranker
    • LightweightLLMReranker
    • Methods
      • compute_score_single_gpu