Visual Document Retrieval
PEFT
Safetensors
ColPali
vidore
multimodal_embedding
multilingual_embedding
Text-to-Visual Document (T→VD) retrieval
Instructions to use nomic-ai/nomic-embed-multimodal-3b with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use nomic-ai/nomic-embed-multimodal-3b with PEFT:
Task type is invalid.
- ColPali
How to use nomic-ai/nomic-embed-multimodal-3b with ColPali:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
- Notebooks
- Google Colab
- Kaggle
How does this perform on classification/clustering task & do you consider submission on MMEB ?
#1
by ququwowo - opened
Hi Team - thanks for the work & model.
Since this is not a col-family model, could this be used for (document/page/raster) classification/clustering task? Have you done any benchmarking? Would you consider a submission on MMEB? https://huggingface.co/spaces/TIGER-Lab/MMEB
Thanks.
I haven't had a chance yet to run it on there but I'll take a look soon! it's mostly trained on retrieval/QA tasks so I'm not sure how it'll do
zpn changed discussion status to closed