Feature Extraction
Transformers
PyTorch
ONNX
Safetensors
sentence-transformers
Transformers.js
jina_clip
xlm-roberta
eva02
clip
sentence-similarity
retrieval
multimodal
multi-modal
crossmodal
cross-modal
mteb
clip-benchmark
vidore
custom_code
🇪🇺 Region: EU
Instructions to use jinaai/jina-clip-v2 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use jinaai/jina-clip-v2 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("feature-extraction", model="jinaai/jina-clip-v2", trust_remote_code=True)# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("jinaai/jina-clip-v2", trust_remote_code=True, dtype="auto") - sentence-transformers
How to use jinaai/jina-clip-v2 with sentence-transformers:
from sentence_transformers import SentenceTransformer model = SentenceTransformer("jinaai/jina-clip-v2", trust_remote_code=True) sentences = [ "The weather is lovely today.", "It's so sunny outside!", "He drove to the stadium." ] embeddings = model.encode(sentences) similarities = model.similarity(embeddings, embeddings) print(similarities.shape) # [3, 3] - Transformers.js
How to use jinaai/jina-clip-v2 with Transformers.js:
// npm i @huggingface/transformers import { pipeline } from '@huggingface/transformers'; // Allocate pipeline const pipe = await pipeline('feature-extraction', 'jinaai/jina-clip-v2'); - Notebooks
- Google Colab
- Kaggle
encode_image returns embeddings with NaN values in Transformers 5
#61 opened about 2 months ago
by
yelboudouri
Dependencies while exporting into ONNX format.
#59 opened 4 months ago
by
jayn2u
Using task (LoRA) with ONNX model?
#58 opened 7 months ago
by
satorean
Use text and image encoder separately with onnxruntime
6
#57 opened 10 months ago
by
Frayin
Pointer argument (at 0) cannot be accessed from Triton (cpu tensor?)
#56 opened 12 months ago
by
vivian345
Blocking access to onnx backend?
#55 opened 12 months ago
by
rcaulk
'JinaCLIPConfig' object has no attribute 'num_attention_heads'
1
#54 opened 12 months ago
by
SupercarryNg
Inconsistent image processing times
4
#53 opened 12 months ago
by
Peniak
When running the sample locally, an error was reported:AttributeError: 'EVAVisionTransformer' object has no attribute '_initialize_weights'
5
#52 opened 12 months ago
by
yslovesby
how to load the jina-clip-v2 model offline? help me plz!!
2
#51 opened about 1 year ago
by
HT-NEKO
Failed to load the downloaded model locally
6
#50 opened about 1 year ago
by
HT-NEKO
Encountering issues while deploying Jina-CLIP v2 on AWS using jina-sagemaker.
4
#49 opened about 1 year ago
by
YanaKnudsen
Will you release the fine-tuning code as open source?
1
#48 opened about 1 year ago
by
classdemo
gguf format please?
👍 1
1
#46 opened about 1 year ago
by
kalle07
Using a slow image processor as `use_fast` is unset - Transformers issue
🚀❤️ 3
#45 opened about 1 year ago
by
do-me
ValueError: Invalid image type. Expected either PIL.Image.Image, numpy.ndarray, torch.Tensor, tf.Tensor or jax.ndarray, but got <class 'list'>.
#44 opened about 1 year ago
by
do-me
Running on Apple Silicon with GPU
1
#43 opened about 1 year ago
by
do-me
do you have 224x224 or 386x386 pretrained clip model?
2
#42 opened about 1 year ago
by
bojohn
Ollama use?
1
#41 opened about 1 year ago
by
YarvixPA
Does “multilingual MSCOCO” refer to “XTD”?
1
#38 opened over 1 year ago
by
Chao985
Onnx clip-v2 inferrence q4,uint8 speed slower than fp16
#37 opened over 1 year ago
by
eminarcissus
Loading jina-clip-v2 extremely slow
1
#36 opened over 1 year ago
by
kenshinn
The issue of VRAM usage in image extraction
1
#35 opened over 1 year ago
by
jimmyseven
Jina Clip V2 Encode_image latency is proportional to batch size
3
#33 opened over 1 year ago
by
lssatvik
Jina Clip V2: Inconsistent Embeddings
14
#32 opened over 1 year ago
by
lssatvik
Dose this model support mixed-modality input?
1
#29 opened over 1 year ago
by
Haon-Chen
ValueError: JinaCLIPModel does not support Flash Attention 2.0 yet
1
#27 opened over 1 year ago
by
kelvennn
Exception: data did not match any variant of untagged enum PyPreTokenizerTypeWrapper at line 83 column 3
1
#25 opened over 1 year ago
by
h3clikejava
Transformers.js error: can't find model.onnx_data file
4
#22 opened over 1 year ago
by
recallapp
ValueError: class 'jina_clip_v2.configuration_clip.JinaCLIPConfig'>
1
#21 opened over 1 year ago
by
zhoudl5
onnx use pixel_values = np.random.rand(0, 3, 512, 512).astype(np.float32) will cause onnx warning
3
#15 opened over 1 year ago
by
xxai-art