Posted by admin

What is the one task that is left before we get AGI? This video will delve into PaLM-E, multi-modality, long-term memory, compute accelerationism, safety and so much more. I will cover Anthropic's update this week on the state of the art of language models and go in depth into their eye-opening thoughts on AGI timelines. I cover Sam Altman's statements on a 'compute truce' and analyse what remaining weaknesses PaLM (and likely GPT 4) have. I show what people thought would be road blocks and how they turned out not to be, with specific examples from Bing Chat and ChatGPT. I also delve into Meta's Llama model, showing that not everything is exponential. Topics also covered into Claude, Big Bench tests, SIQA, mechanistic interpretability, Universal Turing Machines, Midjourney version 5 (v5) and more! https://palm-e.github.io/#demo https://www.anthropic.com/index/core-views-on-ai-safety https://palm-e.github.io/assets/palm-e.pdf https://twitter.com/NandoDF/status/1525397036325019649 https://en.wikipedia.org/wiki/Artificial_general_intelligence https://www.wired.com/story/adaptation-if-computers-are-so-smart-how-come-they-cant-read/ https://www.searchenginejournal.com/gpt-4-is-multimodal/481993/#close https://arxiv.org/pdf/2204.02311.pdf https://github.com/google/BIG-bench/tree/main/bigbench/benchmark_tasks/mnist_ascii https://github.com/google/BIG-bench/tree/main/bigbench/benchmark_tasks/temporal_sequences https://github.com/google/BIG-bench/tree/main/bigbench/benchmark_tasks/simple_text_editing https://github.com/google/BIG-bench/tree/main/bigbench/benchmark_tasks/hyperbaton https://github.com/google/BIG-bench/tree/main/bigbench/benchmark_tasks/hhh_alignment https://arxiv.org/pdf/2301.04589.pdf https://poe.com/claude https://arxiv.org/pdf/2302.13971.pdf https://storage.googleapis.com/pub-tools-public-publication-data/pdf/b8c26e4347adc3453c15d96a09e6f7f102293f71.pdf https://openai.com/blog/planning-for-agi-and-beyond https://www.lesswrong.com/posts/PE22QJSww8mpwh7bt/agi-in-sight-our-look-at-the-game-board https://www.lesswrong.com/posts/HguqQSY8mR7NxGopc/2022-was-the-year-agi-arrived-just-don-t-call-it-that https://arxiv.org/pdf/2210.00881.pdf https://github.com/google/BIG-bench/tree/main/bigbench/benchmark_tasks/gre_reading_comprehension https://ai.googleblog.com/2023/03/palm-e-embodied-multimodal-language.html