Videos » Run 70Bn Llama 3 Inference on a Single 4GB GPU

Run 70Bn Llama 3 Inference on a Single 4GB GPU

Posted by admin
Code : https://github.com/rohan-paul/LLM-FineTuning-Large-Language-Models/blob/main/layered_inference_with_airllm_70B_LLM_Inference_on_a_Single_4GB_GPU.ipynb 🐦 TWITTER: https://twitter.com/rohanpaul_ai Airllm Github - https://github.com/lyogavin/Anima/tree/main/air_llm Checkout the MASSIVELY UPGRADED 2nd Edition of my Book (with 1300+ pages of Dense Python Knowledge) 🐍πŸ”₯ Covering 350+ Python 🐍 Core concepts ( 1300+ pages ) πŸš€ 🟠 Book Link - https://rohanpaul.gumroad.com/l/python-core-with-under-the-hood-explanations ----------------- Hi, I am a Machine Learning Engineer | Kaggle Master. Connect with me on 🐦 TWITTER: https://twitter.com/rohanpaul_ai - for daily in-depth coverage of Large Language Model bits ---------------- You can find me here: ********************************************** 🐦 TWITTER: https://twitter.com/rohanpaul_ai πŸ‘¨πŸ»β€πŸ’Ό LINKEDIN: https://www.linkedin.com/in/rohan-paul-ai/ πŸ‘¨β€πŸ”§ Kaggle: https://www.kaggle.com/paulrohan2020 πŸ‘¨β€πŸ’» GITHUB: https://github.com/rohan-paul πŸ§‘β€πŸ¦° Facebook : https://www.facebook.com/rohan.paul.562/ πŸ“Έ Instagram: https://www.instagram.com/rohan_paul_2020/ ********************************************** Other Playlist you might like πŸ‘‡ 🟠 MachineLearning & DeepLearning Concepts & interview Question Playlist - https://bit.ly/380eYDj 🟠 ComputerVision / DeepLearning Algorithms Implementation Playlist - https://bit.ly/36jEvpI 🟠 DataScience | MachineLearning Projects Implementation Playlist - https://bit.ly/39MEigt 🟠 Natural Language Processing Playlist : https://bit.ly/3P6r2CL ---------------------- #LLM #Largelanguagemodels #Llama2 #LLMfinetuning #opensource #NLP #ArtificialIntelligence #datascience #textprocessing #deeplearning #deeplearningai #100daysofmlcode #neuralnetworks #datascience #generativeai #generativemodels #OpenAI #GPT #GPT3 #GPT4 #chatgpt #genai
Posted May 7
click to rate

Embed  |  101 views