Half-baked ramblings after a day of binge-scrolling Twitter below:
I feel quite overwhelmed by the recent progress in AI and LLMs with GPT-4.
I say this not only about the general breakthrough in science, as the technology is incredibly impressive, but the downstream impacts of what this means for humanity as a whole. All weekend my Twitter feed has been flooded with content on the topic, and the only other time I’ve recognized “the collective” speak to something at this scale was the brief period between the first few cases of COVID and the first week in March when things began to shut down. (Caveat: I might also be a product of my information bubble, and not realize how deep I truly am)
I’m really not sure what this will lead to, and I hope I’m not being dramatic, but I think we’ve just accelerated a fundamental shift in society to the scale of what we’ve seen with electricity, the internet, and mobile phones.
Or maybe it’s all just hype 🙂
I’ve also noticed quite a few tweets discussing how this moment relates to ideas of consciousness, spirituality, and religion, all topics quite relevant to my thesis. Through reviewing my proposal feedback, more reading, and personal research, I think I want to experiment with GPT-3/4 LLMs and Voice Processing+Generation to explore the gray area between intelligent machines and anthropomorphizing of non-human entities, while speculating what this may look like in the future.
What this may look like (crude 11pm sketch below):
- Use a physical landline phone as an interface between human and “machine”
- Use GPT-3+TTS APIs to simulate a conversation
- Fine-tune/steer these conversations to have distinct personalities
- ????
- Have a successful Thesis presentation
Step 4 is looking to be the most difficult rn. Will sit with the concept a bit more and run it by Sarah and residents for further thoughts.
This concept was also inspired by a Tweet I saw earlier today. Someone managed to run a model similar to GPT-3 locally on device without a need for a network connection, meaning the technology in the movie “Her” just got a whole lot closer. This is a fascinating breakthrough and I want to experiment with it.
Some earnest and satirical thoughts/links/ideas/garbage for reference:
And a few more links to keep here for my own reference:
- https://en.wikipedia.org/wiki/Anthropomorphism
- https://danielmiessler.com/blog/ai-is-eating-the-software-world/
- https://github.com/ggerganov/llama.cpp
- https://github.com/ggerganov/whisper.cpp/blob/c353100bad5b8420332d2d451323214c84c66950/examples/talk.llama/talk-llama.cpp#L177