Run 70Bn Llama 3 Inference on a Single 4GB GPU
Code : https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/layered_inference_with_airllm_70B_LLM_Inference_on_a_Single_4GB_GPU.ipynb
π¦ TWITTER: https://twitter.com/rohanpaul_ai
Airllm Github - https://github.com/lyogavin/Anima/tree/main/air_llm
Checkout the MASSIVELY UPGRADED 2nd Edition of my Book (with 1300+ pages of Dense Python Knowledge) ππ₯
Covering 350+ Python π Core concepts ( 1300+ pages ) π
π Book Link - https://rohanpaul.gumroad.com/l/python-core-with-under-the-hood-explanations
-----------------
Hi, I am a Machine Learning Engineer | Kaggle Master. Connect with me on π¦ TWITTER: https://twitter.com/rohanpaul_ai - for daily in-depth coverage of Large Language Model bits
----------------
You can find me here:
**********************************************
π¦ TWITTER: https://twitter.com/rohanpaul_ai
π¨π»βπΌ LINKEDIN: https://www.linkedin.com/in/rohan-paul-ai/
π¨βπ§ Kaggle: https://www.kaggle.com/paulrohan2020
π¨βπ» GITHUB: https://github.com/rohan-paul
π§βπ¦° Facebook : https://www.facebook.com/rohan.paul.562/
πΈ Instagram: https://www.instagram.com/rohan_paul_2020/
**********************************************
Other Playlist you might like π
π MachineLearning & DeepLearning Concepts & interview Question Playlist - https://bit.ly/380eYDj
π ComputerVision / DeepLearning Algorithms Implementation Playlist - https://bit.ly/36jEvpI
π DataScience | MachineLearning Projects Implementation Playlist - https://bit.ly/39MEigt
π Natural Language Processing Playlist : https://bit.ly/3P6r2CL
----------------------
#LLM #Largelanguagemodels #Llama2 #LLMfinetuning #opensource #NLP #ArtificialIntelligence #datascience #textprocessing #deeplearning #deeplearningai #100daysofmlcode #neuralnetworks #datascience #generativeai #generativemodels #OpenAI #GPT #GPT3 #GPT4 #chatgpt #genai
Posted May 7
click to rate
Share this page with your family and friends.