点【开始】-所有程序列表 找到 Anaconda3 ，打开Anaconda Powershell Prompt（%windir%\System32\WindowsPowerShell\v1.0\powershell.exe -ExecutionPolicy ByPass -NoExit -Command "& 'C:\ProgramData\anaconda3\shell\condabin\conda-hook.ps1' ; conda activate 'C:\ProgramData\anaconda3' "）或者Anaconda Prompt（%windir%\System32\cmd.exe "/K" C:\ProgramData\anaconda3\Scripts\activate.bat C:\ProgramData\anaconda3）
打开命令行窗口
(base) PS C:\Users\Administrator> conda activate streaming
(streaming) PS C:\Users\Administrator> pip install transformers==4.33.0 accelerate datasets evaluate wandb scikit-learn scipy sentencepiece
Collecting transformers==4.33.0
Using cached transformers-4.33.0-py3-none-any.whl.metadata (119 kB)
Collecting accelerate
Using cached accelerate-0.26.1-py3-none-any.whl.metadata (18 kB)
Collecting datasets
Using cached datasets-2.16.1-py3-none-any.whl.metadata (20 kB)
Collecting evaluate
Using cached evaluate-0.4.1-py3-none-any.whl.metadata (9.4 kB)
Collecting wandb
Using cached wandb-0.16.2-py3-none-any.whl.metadata (9.8 kB)
Collecting scikit-learn
Using cached scikit_learn-1.3.2-cp38-cp38-win_amd64.whl.metadata (11 kB)
Collecting scipy
Downloading scipy-1.10.1-cp38-cp38-win_amd64.whl (42.2 MB)
---------------------------------------- 42.2/42.2 MB 40.4 kB/s eta 0:00:00
Collecting sentencepiece
Downloading sentencepiece-0.1.99-cp38-cp38-win_amd64.whl (977 kB)
---------------------------------------- 977.6/977.6 kB 35.9 kB/s eta 0:00:00
Requirement already satisfied: filelock in c:\users\administrator\.conda\envs\streaming\lib\site-packages (from transformers==4.33.0) (3.13.1)
Collecting huggingface-hub<1.0,>=0.15.1 (from transformers==4.33.0)
Downloading huggingface_hub-0.20.2-py3-none-any.whl.metadata (12 kB)
Requirement already satisfied: numpy>=1.17 in c:\users\administrator\.conda\envs\streaming\lib\site-packages (from transformers==4.33.0) (1.24.4)
Collecting packaging>=20.0 (from transformers==4.33.0)
Downloading packaging-23.2-py3-none-any.whl.metadata (3.2 kB)
Collecting pyyaml>=5.1 (from transformers==4.33.0)
Downloading PyYAML-6.0.1-cp38-cp38-win_amd64.whl.metadata (2.1 kB)
Collecting regex!=2019.12.17 (from transformers==4.33.0)
Downloading regex-2023.12.25-cp38-cp38-win_amd64.whl.metadata (41 kB)
---------------------------------------- 42.0/42.0 kB 46.2 kB/s eta 0:00:00
Requirement already satisfied: requests in c:\users\administrator\.conda\envs\streaming\lib\site-packages (from transformers==4.33.0) (2.31.0)
Collecting tokenizers!=0.11.3,<0.14,>=0.11.1 (from transformers==4.33.0)
Downloading tokenizers-0.13.3-cp38-cp38-win_amd64.whl (3.5 MB)
---------------------------------------- 3.5/3.5 MB 45.5 kB/s eta 0:00:00
Collecting safetensors>=0.3.1 (from transformers==4.33.0)
Downloading safetensors-0.4.1-cp38-none-win_amd64.whl.metadata (3.8 kB)
Collecting tqdm>=4.27 (from transformers==4.33.0)
Downloading tqdm-4.66.1-py3-none-any.whl.metadata (57 kB)
---------------------------------------- 57.6/57.6 kB 38.4 kB/s eta 0:00:00
Collecting psutil (from accelerate)
Downloading psutil-5.9.7-cp37-abi3-win_amd64.whl.metadata (22 kB)
Requirement already satisfied: torch>=1.10.0 in c:\users\administrator\.conda\envs\streaming\lib\site-packages (from accelerate) (2.1.2)
Collecting pyarrow>=8.0.0 (from datasets)
Downloading pyarrow-14.0.2-cp38-cp38-win_amd64.whl.metadata (3.1 kB)
Collecting pyarrow-hotfix (from datasets)
Downloading pyarrow_hotfix-0.6-py3-none-any.whl.metadata (3.6 kB)
Collecting dill<0.3.8,>=0.3.0 (from datasets)
Downloading dill-0.3.7-py3-none-any.whl.metadata (9.9 kB)
Collecting pandas (from datasets)
Downloading pandas-2.0.3-cp38-cp38-win_amd64.whl.metadata (18 kB)
Collecting xxhash (from datasets)
Downloading xxhash-3.4.1-cp38-cp38-win_amd64.whl.metadata (12 kB)
Collecting multiprocess (from datasets)
Downloading multiprocess-0.70.15-py38-none-any.whl.metadata (7.1 kB)
Collecting fsspec<=2023.10.0,>=2023.1.0 (from fsspec[http]<=2023.10.0,>=2023.1.0->datasets)
Downloading fsspec-2023.10.0-py3-none-any.whl.metadata (6.8 kB)
Collecting aiohttp (from datasets)
Downloading aiohttp-3.9.1-cp38-cp38-win_amd64.whl.metadata (7.6 kB)
Collecting responses<0.19 (from evaluate)
Downloading responses-0.18.0-py3-none-any.whl (38 kB)
Collecting Click!=8.0.0,>=7.1 (from wandb)
Downloading click-8.1.7-py3-none-any.whl.metadata (3.0 kB)
Collecting GitPython!=3.1.29,>=1.0.0 (from wandb)
Downloading GitPython-3.1.41-py3-none-any.whl.metadata (14 kB)
Collecting sentry-sdk>=1.0.0 (from wandb)
Downloading sentry_sdk-1.39.2-py2.py3-none-any.whl.metadata (9.7 kB)
Collecting docker-pycreds>=0.4.0 (from wandb)
Downloading docker_pycreds-0.4.0-py2.py3-none-any.whl (9.0 kB)
Collecting setproctitle (from wandb)
Downloading setproctitle-1.3.3-cp38-cp38-win_amd64.whl.metadata (10 kB)
Requirement already satisfied: setuptools in c:\users\administrator\.conda\envs\streaming\lib\site-packages (from wandb) (68.2.2)
Collecting appdirs>=1.4.3 (from wandb)
Downloading appdirs-1.4.4-py2.py3-none-any.whl (9.6 kB)
Requirement already satisfied: typing-extensions in c:\users\administrator\.conda\envs\streaming\lib\site-packages (from wandb) (4.9.0)
Collecting protobuf!=4.21.0,<5,>=3.19.0 (from wandb)
Downloading protobuf-4.25.2-cp38-cp38-win_amd64.whl.metadata (541 bytes)
Collecting joblib>=1.1.1 (from scikit-learn)
Downloading joblib-1.3.2-py3-none-any.whl.metadata (5.4 kB)
Collecting threadpoolctl>=2.0.0 (from scikit-learn)
Downloading threadpoolctl-3.2.0-py3-none-any.whl.metadata (10.0 kB)
Collecting colorama (from Click!=8.0.0,>=7.1->wandb)
Downloading colorama-0.4.6-py2.py3-none-any.whl (25 kB)
Collecting six>=1.4.0 (from docker-pycreds>=0.4.0->wandb)
Downloading six-1.16.0-py2.py3-none-any.whl (11 kB)
Collecting attrs>=17.3.0 (from aiohttp->datasets)
Downloading attrs-23.2.0-py3-none-any.whl.metadata (9.5 kB)
Collecting multidict<7.0,>=4.5 (from aiohttp->datasets)
Downloading multidict-6.0.4-cp38-cp38-win_amd64.whl (28 kB)
Collecting yarl<2.0,>=1.0 (from aiohttp->datasets)
Downloading yarl-1.9.4-cp38-cp38-win_amd64.whl.metadata (32 kB)
Collecting frozenlist>=1.1.1 (from aiohttp->datasets)
Downloading frozenlist-1.4.1-cp38-cp38-win_amd64.whl.metadata (12 kB)
Collecting aiosignal>=1.1.2 (from aiohttp->datasets)
Downloading aiosignal-1.3.1-py3-none-any.whl (7.6 kB)
Collecting async-timeout<5.0,>=4.0 (from aiohttp->datasets)
Downloading async_timeout-4.0.3-py3-none-any.whl.metadata (4.2 kB)
Collecting gitdb<5,>=4.0.1 (from GitPython!=3.1.29,>=1.0.0->wandb)
Downloading gitdb-4.0.11-py3-none-any.whl.metadata (1.2 kB)
Requirement already satisfied: charset-normalizer<4,>=2 in c:\users\administrator\.conda\envs\streaming\lib\site-packages (from requests->transformers==4.33.0) (3.3.2)
Requirement already satisfied: idna<4,>=2.5 in c:\users\administrator\.conda\envs\streaming\lib\site-packages (from requests->transformers==4.33.0) (3.6)
Requirement already satisfied: urllib3<3,>=1.21.1 in c:\users\administrator\.conda\envs\streaming\lib\site-packages (from requests->transformers==4.33.0) (2.1.0)
Requirement already satisfied: certifi>=2017.4.17 in c:\users\administrator\.conda\envs\streaming\lib\site-packages (from requests->transformers==4.33.0) (2023.11.17)
Requirement already satisfied: sympy in c:\users\administrator\.conda\envs\streaming\lib\site-packages (from torch>=1.10.0->accelerate) (1.12)
Requirement already satisfied: networkx in c:\users\administrator\.conda\envs\streaming\lib\site-packages (from torch>=1.10.0->accelerate) (3.1)
Requirement already satisfied: jinja2 in c:\users\administrator\.conda\envs\streaming\lib\site-packages (from torch>=1.10.0->accelerate) (3.1.3)
Collecting python-dateutil>=2.8.2 (from pandas->datasets)
Downloading python_dateutil-2.8.2-py2.py3-none-any.whl (247 kB)
---------------------------------------- 247.7/247.7 kB 33.7 kB/s eta 0:00:00
Collecting pytz>=2020.1 (from pandas->datasets)
Downloading pytz-2023.3.post1-py2.py3-none-any.whl.metadata (22 kB)
Collecting tzdata>=2022.1 (from pandas->datasets)
Downloading tzdata-2023.4-py2.py3-none-any.whl.metadata (1.4 kB)
Collecting smmap<6,>=3.0.1 (from gitdb<5,>=4.0.1->GitPython!=3.1.29,>=1.0.0->wandb)
Downloading smmap-5.0.1-py3-none-any.whl.metadata (4.3 kB)
Requirement already satisfied: MarkupSafe>=2.0 in c:\users\administrator\.conda\envs\streaming\lib\site-packages (from jinja2->torch>=1.10.0->accelerate) (2.1.3)
Requirement already satisfied: mpmath>=0.19 in c:\users\administrator\.conda\envs\streaming\lib\site-packages (from sympy->torch>=1.10.0->accelerate) (1.3.0)
Downloading transformers-4.33.0-py3-none-any.whl (7.6 MB)
---------------------------------------- 7.6/7.6 MB 38.6 kB/s eta 0:00:00
Downloading accelerate-0.26.1-py3-none-any.whl (270 kB)
---------------------------------------- 270.9/270.9 kB 40.6 kB/s eta 0:00:00
Downloading datasets-2.16.1-py3-none-any.whl (507 kB)
---------------------------------------- 507.1/507.1 kB 36.2 kB/s eta 0:00:00
Downloading evaluate-0.4.1-py3-none-any.whl (84 kB)
---------------------------------------- 84.1/84.1 kB 31.7 kB/s eta 0:00:00
Downloading wandb-0.16.2-py3-none-any.whl (2.2 MB)
---------------------------------------- 2.2/2.2 MB 36.2 kB/s eta 0:00:00
Downloading scikit_learn-1.3.2-cp38-cp38-win_amd64.whl (9.3 MB)
---------------------------------------- 9.3/9.3 MB 44.6 kB/s eta 0:00:00
Downloading click-8.1.7-py3-none-any.whl (97 kB)
---------------------------------------- 97.9/97.9 kB 46.8 kB/s eta 0:00:00
Downloading dill-0.3.7-py3-none-any.whl (115 kB)
---------------------------------------- 115.3/115.3 kB 33.6 kB/s eta 0:00:00
Downloading fsspec-2023.10.0-py3-none-any.whl (166 kB)
---------------------------------------- 166.4/166.4 kB 62.1 kB/s eta 0:00:00
Downloading aiohttp-3.9.1-cp38-cp38-win_amd64.whl (367 kB)
---------------------------------------- 367.1/367.1 kB 36.1 kB/s eta 0:00:00
Downloading GitPython-3.1.41-py3-none-any.whl (196 kB)
---------------------------------------- 196.4/196.4 kB 40.4 kB/s eta 0:00:00
Downloading huggingface_hub-0.20.2-py3-none-any.whl (330 kB)
---------------------------------------- 330.3/330.3 kB 32.7 kB/s eta 0:00:00
Downloading joblib-1.3.2-py3-none-any.whl (302 kB)
---------------------------------------- 302.2/302.2 kB 43.5 kB/s eta 0:00:00
Downloading packaging-23.2-py3-none-any.whl (53 kB)
---------------------------------------- 53.0/53.0 kB 74.0 kB/s eta 0:00:00
Downloading protobuf-4.25.2-cp38-cp38-win_amd64.whl (413 kB)
---------------------------------------- 413.4/413.4 kB 33.9 kB/s eta 0:00:00
Downloading psutil-5.9.7-cp37-abi3-win_amd64.whl (252 kB)
---------------------------------------- 252.2/252.2 kB 39.5 kB/s eta 0:00:00
Downloading pyarrow-14.0.2-cp38-cp38-win_amd64.whl (24.6 MB)
---------------------------------------- 24.6/24.6 MB 36.8 kB/s eta 0:00:00
Downloading PyYAML-6.0.1-cp38-cp38-win_amd64.whl (157 kB)
---------------------------------------- 157.3/157.3 kB 23.7 kB/s eta 0:00:00
Downloading regex-2023.12.25-cp38-cp38-win_amd64.whl (269 kB)
---------------------------------------- 269.5/269.5 kB 39.8 kB/s eta 0:00:00
Downloading safetensors-0.4.1-cp38-none-win_amd64.whl (277 kB)
---------------------------------------- 277.7/277.7 kB 44.3 kB/s eta 0:00:00
Downloading sentry_sdk-1.39.2-py2.py3-none-any.whl (254 kB)
---------------------------------------- 254.1/254.1 kB 36.0 kB/s eta 0:00:00
Downloading threadpoolctl-3.2.0-py3-none-any.whl (15 kB)
Downloading tqdm-4.66.1-py3-none-any.whl (78 kB)
---------------------------------------- 78.3/78.3 kB 27.4 kB/s eta 0:00:00
Downloading multiprocess-0.70.15-py38-none-any.whl (132 kB)
---------------------------------------- 132.6/132.6 kB 30.4 kB/s eta 0:00:00
Downloading pandas-2.0.3-cp38-cp38-win_amd64.whl (10.8 MB)
---------------------------------------- 10.8/10.8 MB 31.0 kB/s eta 0:00:00
Downloading pyarrow_hotfix-0.6-py3-none-any.whl (7.9 kB)
Downloading setproctitle-1.3.3-cp38-cp38-win_amd64.whl (11 kB)
Downloading xxhash-3.4.1-cp38-cp38-win_amd64.whl (29 kB)
Downloading async_timeout-4.0.3-py3-none-any.whl (5.7 kB)
Downloading attrs-23.2.0-py3-none-any.whl (60 kB)
---------------------------------------- 60.8/60.8 kB 37.6 kB/s eta 0:00:00
Downloading frozenlist-1.4.1-cp38-cp38-win_amd64.whl (50 kB)
---------------------------------------- 50.8/50.8 kB 74.2 kB/s eta 0:00:00
Downloading gitdb-4.0.11-py3-none-any.whl (62 kB)
---------------------------------------- 62.7/62.7 kB 55.1 kB/s eta 0:00:00
Downloading pytz-2023.3.post1-py2.py3-none-any.whl (502 kB)
---------------------------------------- 502.5/502.5 kB 58.3 kB/s eta 0:00:00
Downloading tzdata-2023.4-py2.py3-none-any.whl (346 kB)
---------------------------------------- 346.6/346.6 kB 32.7 kB/s eta 0:00:00
Downloading yarl-1.9.4-cp38-cp38-win_amd64.whl (77 kB)
---------------------------------------- 77.1/77.1 kB 38.9 kB/s eta 0:00:00
Downloading smmap-5.0.1-py3-none-any.whl (24 kB)
Installing collected packages: tokenizers, sentencepiece, pytz, appdirs, xxhash, tzdata, threadpoolctl, smmap, six, setproctitle, sentry-sdk, scipy, safetensors, regex, pyyaml, pyarrow-hotfix, pyarrow, psutil, protobuf, packaging, multidict, joblib, fsspec, frozenlist, dill, colorama, attrs, async-timeout, yarl, tqdm, scikit-learn, responses, python-dateutil, multiprocess, gitdb, docker-pycreds, Click, aiosignal, pandas, huggingface-hub, GitPython, aiohttp, wandb, transformers, accelerate, datasets, evaluate
Attempting uninstall: fsspec
Found existing installation: fsspec 2023.12.2
Uninstalling fsspec-2023.12.2:
Successfully uninstalled fsspec-2023.12.2
Successfully installed Click-8.1.7 GitPython-3.1.41 accelerate-0.26.1 aiohttp-3.9.1 aiosignal-1.3.1 appdirs-1.4.4 async-timeout-4.0.3 attrs-23.2.0 colorama-0.4.6 datasets-2.16.1 dill-0.3.7 docker-pycreds-0.4.0 evaluate-0.4.1 frozenlist-1.4.1 fsspec-2023.10.0 gitdb-4.0.11 huggingface-hub-0.20.2 joblib-1.3.2 multidict-6.0.4 multiprocess-0.70.15 packaging-23.2 pandas-2.0.3 protobuf-4.25.2 psutil-5.9.7 pyarrow-14.0.2 pyarrow-hotfix-0.6 python-dateutil-2.8.2 pytz-2023.3.post1 pyyaml-6.0.1 regex-2023.12.25 responses-0.18.0 safetensors-0.4.1 scikit-learn-1.3.2 scipy-1.10.1 sentencepiece-0.1.99 sentry-sdk-1.39.2 setproctitle-1.3.3 six-1.16.0 smmap-5.0.1 threadpoolctl-3.2.0 tokenizers-0.13.3 tqdm-4.66.1 transformers-4.33.0 tzdata-2023.4 wandb-0.16.2 xxhash-3.4.1 yarl-1.9.4
(streaming) PS C:\Users\Administrator>
(streaming) PS C:\Users\Administrator> d:
(streaming) PS D:\> cd .\python_project\streaming-llm\
(streaming) PS D:\python_project\streaming-llm> python setup.py develop
running develop
C:\Users\Administrator\.conda\envs\streaming\lib\site-packages\setuptools\command\develop.py:40: EasyInstallDeprecationWarning: easy_install command is deprecated.
!!
********************************************************************************
Please avoid running ``setup.py`` and ``easy_install``.
Instead, use pypa/build, pypa/installer or other
standards-based tools.
See https://github.com/pypa/setuptools/issues/917 for details.
********************************************************************************
!!
easy_install.initialize_options(self)
C:\Users\Administrator\.conda\envs\streaming\lib\site-packages\setuptools\_distutils\cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated.
!!
********************************************************************************
Please avoid running ``setup.py`` directly.
Instead, use pypa/build, pypa/installer or other
standards-based tools.
See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details.
********************************************************************************
!!
self.initialize_options()
running egg_info
creating streaming_llm.egg-info
writing streaming_llm.egg-info\PKG-INFO
writing dependency_links to streaming_llm.egg-info\dependency_links.txt
writing top-level names to streaming_llm.egg-info\top_level.txt
writing manifest file 'streaming_llm.egg-info\SOURCES.txt'
reading manifest file 'streaming_llm.egg-info\SOURCES.txt'
adding license file 'LICENSE'
writing manifest file 'streaming_llm.egg-info\SOURCES.txt'
running build_ext
Creating c:\users\administrator\.conda\envs\streaming\lib\site-packages\streaming-llm.egg-link (link to .)
Adding streaming-llm 0.0.1 to easy-install.pth file
Installed d:\python_project\streaming-llm
Processing dependencies for streaming-llm==0.0.1
Finished processing dependencies for streaming-llm==0.0.1
(streaming) PS D:\python_project\streaming-llm>