Instructions to use microsoft/OmniParser-v2.0 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use microsoft/OmniParser-v2.0 with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("microsoft/OmniParser-v2.0", trust_remote_code=True, dtype="auto") - Notebooks
- Google Colab
- Kaggle
updated config.json lacks 'model_type'
Calling the model with updated config.json returns value error
ValueError: Unrecognized model in microsoft/OmniParser-v2.0. Should have a model_type key in its config.json
After adding "model_type": "blip-2" (based on the config.json in OmniParser v1), return OSEerror
OSError: microsoft/OmniParser-v2.0 does not appear to have a file named pytorch_model.bin, model.safetensors, tf_model.h5, model.ckpt or flax_model.msgpack.
I would appreciate it if someone could point out where I went wrong.
Calling the model with updated config.json returns value error
ValueError: Unrecognized model in microsoft/OmniParser-v2.0. Should have amodel_typekey in its config.jsonAfter adding "model_type": "blip-2" (based on the config.json in OmniParser v1), return OSEerror
OSError: microsoft/OmniParser-v2.0 does not appear to have a file named pytorch_model.bin, model.safetensors, tf_model.h5, model.ckpt or flax_model.msgpack.I would appreciate it if someone could point out where I went wrong.
Did you solve this problem?