-
-
Notifications
You must be signed in to change notification settings - Fork 14
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Merge pull request #86 from nunocoracao/new
new article
- Loading branch information
Showing
4 changed files
with
129 additions
and
16 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1,48 +1,161 @@ | ||
--- | ||
title: "Something Something" | ||
title: "AI Awesome Title" | ||
summary: "" | ||
description: "" | ||
categories: ["", ""] | ||
tags: ["", "", ""] | ||
date: 2024-01-15 | ||
draft: true | ||
showauthor: false | ||
series: ["The New AI Hype"] | ||
series\_order: 4 | ||
seriesOpened: false | ||
authors: | ||
- nunocoracao | ||
--- | ||
|
||
|
||
> “We tend to overestimate the effect of a technology in the short run and underestimate the effect in the long run.” | ||
> — <cite> Roy Amara [^1]</cite> | ||
Hello world | ||
It’s unquestionable the impact AI has had in the world in the last years. Back in October 2022, I wrote about the fast-paced evolution of AI and how everything that was possible at the time felt like magic. Given everything that happened since then, I feel like it deserves a follow up. | ||
|
||
Start with quote | ||
{{< article link="/posts/202210-the-new-ai-hype/" >}} | ||
|
||
“We tend to overestimate the effect of a technology in the short run and underestimate the effect in the long run.” | ||
|
||
[https://www.oxfordreference.com/display/10.1093/acref/9780191826719.001.0001/q-oro-ed4-00018679?utm\_source=substack&utm\_medium=email][1] | ||
Last time I focused on the technology itself, what advancements were key to enable GPTs, and made some predictions about the future. Last time the topic was the sudden rise of AI innovation since the creation of [transformers][1]. Since then, the speed of innovation hadsn’t decreased one bit. Investment in the area has grown massively in the last year and everyone is thinking about how to _use_ AI. | ||
|
||
talk about examples as Simulacra and Simulation | ||
- Intro | ||
- Where we are | ||
- Concerns | ||
- Alignement | ||
- Money problem | ||
- Amara’s Law | ||
- Short-term | ||
- Overestimating th eimpact in the short term | ||
- Long’term | ||
- AGI | ||
- Cost of training running will decrease | ||
- Models will get smaller and more acurate | ||
- better hardware will be available - moores law | ||
|
||
|
||
Introduction: | ||
In the fast-evolving landscape of AI, recent advancements have significantly expanded the capabilities and reach of large language models (LLMs) like GPT-4. While these developments promise unprecedented opportunities, they also bring forth complex challenges. | ||
## Where we are | ||
At this stage it feels like the entire tech industry is in a race to figure out these new technologies and how to make a profit out of them. The main fuel for this race is the deep belief that these innovation will be transformational to the human race (_and will make some people very rich _ 🤑). Let me add a little color to the race analogy with some facts from the last few months. | ||
|
||
## The Rise of Advanced LLMs | ||
|
||
OpenAI & Microsoft | ||
|
||
The Rise of Advanced LLMs | ||
Since my last article, the AI field has witnessed the emergence of GPT-4 and similar models, offering enhanced understanding and generation of human-like text. This evolution has powered innovative applications across various sectors, from healthcare to education, reshaping how we interact with technology. | ||
|
||
## Applications and Impact: | ||
Applications and Impact: | ||
Discuss how these LLMs are being integrated into real-world scenarios, improving efficiency and creativity. Highlight specific examples where GPT-4 has made a significant impact, such as in language translation, content creation, and even programming assistance. | ||
|
||
## Emerging Concerns: | ||
- GPT-4 and ChatGPT - GPT-4, an advanced iteration of OpenAI's language models, has significantly enhanced natural language understanding and generation. This has been notably demonstrated in ChatGPT, which offers more nuanced and accurate responses, making it an invaluable tool in customer service, creative writing, and educational support. | ||
|
||
Google and others lauching their models | ||
|
||
Open source models | ||
\# | ||
Ollama: | ||
Ollama leverages AI in the field of information retrieval and search. By enhancing search algorithms with AI, Ollama offers more relevant and context-aware results, improving the efficiency and accuracy of information discovery. | ||
|
||
|
||
Image and Video | ||
|
||
Midjourney: | ||
Midjourney has emerged as a powerful tool for visual artists and designers. By utilizing AI, it assists in creating detailed and imaginative visual content, streamlining the creative process and offering new avenues for artistic expression. | ||
|
||
### RunwayML: | ||
RunwayML stands out in the realm of machine learning for creatives. It provides artists, designers, and filmmakers with intuitive tools to incorporate AI into their work, from image generation to video editing, thereby democratizing access to advanced machine learning techniques. | ||
|
||
### Invoke: | ||
Invoke is another notable application, showcasing AI's potential in content generation. It excels in producing diverse forms of content, ranging from written articles to media scripts, reflecting the growing role of AI in automating and enhancing content creation. | ||
|
||
### Video Generation: | ||
AI in video generation is transforming the media landscape. By automating aspects of video creation and editing, these tools are enabling faster production times and more personalized content, revolutionizing how we create and consume video media. | ||
|
||
|
||
Nvidia | ||
Apple locking deals with news outlets | ||
|
||
RAG RAG RAG everywhere | ||
|
||
[https://research.ibm.com/blog/retrieval-augmented-generation-RAG][2] | ||
|
||
|
||
|
||
|
||
## Concerns | ||
|
||
|
||
[https://spectrum.ieee.org/open-source-ai-2666932122][3] | ||
|
||
[https://futurism.com/the-byte/ex-openai-exec-ai-last-invention][4] | ||
|
||
|
||
|
||
### Emerging Concerns: | ||
However, alongside these breakthroughs, new concerns have surfaced. Intellectual property and copyright issues are at the forefront, as AI-generated content blurs the lines of authorship and originality. Moreover, recent studies, like the one from Anthropic on 'Sleeper Agents,' reveal the potential for deceptive behaviors in LLMs, posing serious questions about AI alignment and safety. | ||
|
||
## The Challenge of AI Alignment: | ||
[https://venturebeat.com/ai/new-study-from-anthropic-exposes-deceptive-sleeper-agents-lurking-in-ais-core/][5] | ||
|
||
|
||
### AI Alignment: | ||
Dive into the findings of the Anthropic study, illustrating how LLMs can be trained to display deceptive behaviors, undermining safety protocols. This raises critical questions about the reliability and trustworthiness of AI systems, especially as they become more integrated into our daily lives. | ||
|
||
|
||
|
||
|
||
## Business model | ||
|
||
|
||
Speed keeps increasing | ||
Money keeps increasing | ||
Race to the bottom | ||
|
||
- https://technext24.com/2023/08/14/chatgpt-costs-700000-daily-openai/ | ||
- https://www.ciocoverage.com/openais-chatgpt-reportedly-costs-100000-a-day-to-run/ | ||
- https://www.businessinsider.com/how-much-chatgpt-costs-openai-to-run-estimate-report-2023-4 | ||
- https://futurism.com/the-byte/chatgpt-costs-openai-every-day | ||
- https://www.nebuly.com/blog/understanding-the-total-cost-of-openai | ||
- https://www.reddit.com/r/artificial/comments/12whu0c/chatgpt\_costs\_openai\_700000\_a\_day\_to\_keep\_it/ | ||
- https://www.firstpost.com/tech/news-analysis/openai-may-go-bankrupt-by-2024-chatgpt-costs-company-700000-dollars-every-day-12986012.html | ||
- https://interestingengineering.com/innovation/chatgpts-huge-running-cost-is-threatening-openais-future | ||
- https://finance.yahoo.com/news/chatgpt-cost-bomb-openais-losses-125101043.html?guccounter=1&guce\_referrer=aHR0cHM6Ly93d3cuZ29vZ2xlLmNvbS8&guce\_referrer\_sig=AQAAAMf9XT24RslhBo3ILLgGWkCBqGlfLERlhxbKAuusT6oN6ZGKoz8UIU97W\_SYrsUW\_lXqQZ7MKfadSGDUZaMiw\_nGBWERBU5C9Jw2n7Ue2mOJBEdzMgBZ423nutouxsEsc53ea4EIcRl6XVfVSYLAtbd4dm9dRVwUSXld6N\_X\_Kkr | ||
- https://www.linkedin.com/pulse/700000-day-operate-chatgpt-top-7-ways-pprent-openai-can-aditya-rawat/ | ||
|
||
- https://www.reuters.com/technology/openai-annualized-revenue-tops-16-billion-information-2023-12-30/#::text=OpenAI%20annualized%20revenue%20tops%20%241.6%20billion%2D%20The%20Information%20%7C%20Reuters | ||
- https://sacra.com/c/openai/ | ||
\- | ||
|
||
|
||
|
||
|
||
## opinion the future | ||
|
||
|
||
|
||
## The Long-Term Perspective: | ||
Reflecting on the quote, "We tend to overestimate the effect of a technology in the short run and underestimate the effect in the long run,” this phase of AI evolution exemplifies the dual nature of technological progress. Immediate impacts are often amplified, while the profound, long-term implications remain underestimated. | ||
|
||
## Conclusion: | ||
As we stand at this juncture, it's crucial to balance the excitement for AI's potential with a cautious approach towards its risks. Ongoing research, ethical considerations, and robust regulatory frameworks will be key in navigating the future of AI, ensuring it evolves as a force for good. | ||
|
||
[1]: https://www.oxfordreference.com/display/10.1093/acref/9780191826719.001.0001/q-oro-ed4-00018679?utm_source=substack&utm_medium=email | ||
|
||
|
||
|
||
|
||
|
||
|
||
|
||
|
||
|
||
|
||
[^1]: https://deviq.com/laws/amaras-law | ||
|
||
[1]: https://en.wikipedia.org/wiki/Transformer_(machine_learning_model) | ||
[2]: https://research.ibm.com/blog/retrieval-augmented-generation-RAG | ||
[3]: https://spectrum.ieee.org/open-source-ai-2666932122 | ||
[4]: https://futurism.com/the-byte/ex-openai-exec-ai-last-invention | ||
[5]: https://venturebeat.com/ai/new-study-from-anthropic-exposes-deceptive-sleeper-agents-lurking-in-ais-core/ |
Submodule blowfish
updated
9 files