LAVIS在Mac,M1PRO芯片下的安装实战

type
Post
status
Published
date
Aug 6, 2024
slug
240806-lavis
summary
本地想装个图片理解的大模型，看了下blip2感觉比较合适，macos安装的时候有点坑需要注意下，但是最终也无法使用mps加速，比较蛋疼。这里记录下安装步骤。
tags
推荐
折腾
category
技术分享
icon
password
 
契机安装测试代码总结写到最后

契机

⚙
本地想装个图片理解的大模型，看了下blip2感觉比较合适，macos安装的时候有点坑需要注意下，但是最终也无法使用mps加速，比较蛋疼。这里记录下安装步骤。

安装

LAVIS/projects/blip2 at main · salesforce/LAVIS
LAVIS - A One-stop Library for Language-Vision Intelligence - salesforce/LAVIS
LAVIS/projects/blip2 at main · salesforce/LAVIS
https://github.com/salesforce/LAVIS/tree/main/projects/blip2
LAVIS/projects/blip2 at main · salesforce/LAVIS
Build issues with decord for Mac with Python 3.9+ · Issue #15 · salesforce/LAVIS
Decord is listed as a dependency but there is no prebuilt binaries for Mac above Python 3.8 (see issues here). This means Mac users of LAVIS effectively have to stay below 3.8. Can we get rid of De...
Build issues with decord for Mac with Python 3.9+ · Issue #15 · salesforce/LAVIS
https://github.com/salesforce/LAVIS/issues/15#issuecomment-1896661800
Build issues with decord for Mac with Python 3.9+ · Issue #15 · salesforce/LAVIS
 

测试代码

notion image

总结

  • 其实效果一般，可能我用的float16
  • 最主要就是安装decode
  • decode的cmake有点麻烦
  • 最后执行的时候，下载模型要卡很久，这里看网速就知道其实正在下载

写到最后

notion image
是在往前走就好 bothsavage.github.io
 
notion image
 
Prev
Mac平台M1PRO芯片MiniCPM-V-2.6网页部署跑通
Next
Iphone Mirroring圆了我AI打DNF手游的梦
Loading...