Add bioimage search utils and example notebook #553
Conversation
There was a problem hiding this comment.
Really great. One question how can we validate the similarity? In this type of images is not profound. In a test notebook I tried while ago the related_images included as a top result the query image too. Validating that the query image is similar with the top 1 related image.
In the example Notebook, I currently skip the top result as it should always be the query image selected. However, in actual use cases, the query image would be an image that is not in the dataset so this shouldn't be problem. About result validation, do you have anything else in mind? The result similarity is mostly based on the embedding selected. Maybe you can find a finetuned embedding model for biomedical images that could give better results. |
Cool nope I don't have sth in mind for now but it is definitely doable I just wanted to make sure that the top result is the query image this is a nice validation indicator for now. |
apis/python/src/tiledb/vector_search/embeddings/huggingface_auto_image_embedding.py
Show resolved
Hide resolved
Add bioimage search utils and example notebook