Questions tagged [openai-clip]
4 questions
1
vote
1 answer
Open Ai's CLIP and image databases
Using Open Ai's CLIP with BigGAN, VQGAN etc. are there image databases other than:
ImageNet 1024, ImageNet 16384, COCO,S-FLCKR, WikiArt, FacesHQ
that can be used? If so what others?
garrettlynchirl
- 790
- 8
- 23
0
votes
0 answers
Yolo and Clip to find top 3 similar images
import os
import clip
import numpy as np
from PIL import Image
from tqdm import tqdm
from typing import List, Dict
import concurrent.futures
import pickle
import time
def tokenize_text(text: List[str], tokenizer):
"""
Tokenize the input…
aryan vir
- 11
- 3
0
votes
1 answer
Semantic video search
I am attempting to extend OpenAI's CLIP functionality to semantic video search. Essentially, my objective is to input a text query and get relevant video segments/clips that match the semantic content of the text query. Here's what I've thought so…
danywigglebutt
- 238
- 1
- 17
0
votes
2 answers
use openAI CLIP with torch tensor or numpy array as input
How to use a pytorch tensor or an openCV iamge correctly as input for for OpenAi CLIP?
I tried the following but this didn't work so far :
device = "cuda" if torch.cuda.is_available() else "cpu"
clip_model, clip_preprocess = clip.load("ViT-B/32",…
werber bang
- 173
- 3
- 11