conda create -yn streaming python=3.8 conda activate streaming pip install torch torchvision torchaudio pip install transformers==4.33.0 accelerate datasets evaluate wandb scikit-learn scipy sentencepiece python setup.py develop
CUDA_VISIBLE_DEVICES=0 python examples/run_streaming_llama.py --enable_streaming
To view this video please enable JavaScript,and consider upgrading to a web browser that supports HTML5 video
This is a modal window.
Beginning of dialog window.Escape will cancel and close the window.
End of dialog window.