HPC 配置TensorFlow和Pytorch
最近HPC配置环境。
#显示channel
conda config --set show_channel_urls yes
#配置anaconda源
vim ~/.condarc
#修改如下
channels:
- defaults
show_channel_urls: true
default_channels:
- https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
- https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/r
- https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/msys2
custom_channels:
conda-forge: https://mirrors.tuna.tsinghua.edu.cn/anaconda/cloud
msys2: https://mirrors.tuna.tsinghua.edu.cn/anaconda/cloud
bioconda: https://mirrors.tuna.tsinghua.edu.cn/anaconda/cloud
menpo: https://mirrors.tuna.tsinghua.edu.cn/anaconda/cloud
pytorch: https://mirrors.tuna.tsinghua.edu.cn/anaconda/cloud
pytorch-lts: https://mirrors.tuna.tsinghua.edu.cn/anaconda/cloud
simpleitk: https://mirrors.tuna.tsinghua.edu.cn/anaconda/cloud
#刷新镜像缓存
conda clean -i
#显示当前镜像内容
conda config --show channels
#安装pytorch
conda install pytorch torchvision torchaudio cudatoolkit=11.3 -c pytorch
#安装TensorFlow-gpu，指定安装源
pip install tensorflow-gpu==2.6.0 -i https://pypi.tuna.tsinghua.edu.cn/simple
#安装cudnn，否则TensorFlow无法调用GPU，cuda cudnn TensorFlow python 版本需要匹配
conda install cudnn==8.2.1 -c conda-forge安装TensorFlow的时候，需要注意版本匹配，注意cuda和python版本，可取TensorFlow官网查看，见参考链接。
否则报错Cannot dlopen some GPU libraries. Cannot dlopen some TensorRT libraries. 等等。
参考链接：
https://www.jianshu.com/p/9911dee2f00b
https://zhuanlan.zhihu.com/p/115837429
https://blog.csdn.net/weixin_48344945/article/details/110479978
https://www.tensorflow.org/install/source#gpu
https://mirrors.tuna.tsinghua.edu.cn/help/anaconda/
https://tensorflow.org/install/source#gpu
https://www.jianshu.com/p/3d8a444ff440
https://www.jianshu.com/p/4344821abb05
https://stackoverflow.com/questions/55256671/how-to-install-latest-cudnn-to-conda
https://blog.csdn.net/vivigreeeen/article/details/119972147