Not Quite a Game.. In the process of making Tethered Dreams.
Tethered Dreams is a project I have been working on and off for the past year, using the realtime interactive medium and scenes built out of 3D Scans to explore liminality, fragmented identity, decay & renewal.
It initially started with me 3D scanning everything I could get my phone's camera onto, and as I kept scanning, patterns began to appear. I clearly gravitated towards the natural & the decayed; my 3D scan library filled with old trees and mossy growth as much as it did with decrepit alleyways and abandoned spaces. I think what I found interesting in these is the material record of history apparent in their complex textures, leaving traces of histories both past and present–unfolding through erosion, decay, wear, and growth all at the same time.
Below are some selected screenshots of these 3D scans.
Composing Scenes & Building Interaction
The next thing I did was to assemble scenes with these scans using Blender and later Unreal Engine 5. I quickly became interested with the kinds of stories that unfolded as I made these scenes, creating spaces of mental associations that literally traversed across space and time. Working on these mainly felt reflexive, looking back at my own history of transition & migration and seeing it collapse in these patchwork scenes.
At this time I also became interested in creating an atmosphere that would both feel serene and oppressive, which for me is exactly the felt contradiction that comes from my identity being formed across places and cultures: serenity in not being tied to a single place (the freedom of choice in who to become), and the oppression from lack of identification (without a stable origin, who am I to be?)
As I composed these spaces, I imagined all sorts of ways to construct an interactive narrative around the threads that surfaced. How could I use interaction to immerse the audience into that felt contradiction? I am specifically drawn to realtime interaction and take notes from game design because this kind of medium not only presents a space, it has you inhabit it. And when the message I am exploring is about becoming, the interactive medium precisely lets the audience become something / someone anew.
"A film can show us a room and a realtime environment can let us enter one, approach a doorway, hesitate before crossing it, look behind us, walk along a wall, become lost, return later and discover that our understanding of the place has changed, since space acquires meaning through occupation."
From Realtime is a Poetic Technology by Damjan Jovanovic
This referenced essay closely captures my own thinking about games and interactive art, and I find a lot of inspiration in Damjan's work https://www.sciarc.edu/people/faculty/damjan-jovanovic
As for the interaction design itself, I drew from many many inspirations, but the main one for this project was MYST, the seminal first-person adventure puzzle game that originally came out on CD-ROM back in 1993. In Myst, you explore an abandoned island to uncover its mysteries, and it serves as mechanical inspiration for two main reasons.
First, its point-and-click interaction allows the game designers to have an incredibly high level of authorship in how you frame a scene and introduce clues and information about the world. I also want to retain this level of authorship in framing a scene, and it serves the practical purpose that many of my 3D Scans don't look great from all angles. Second, the exploration in Myst is done completely through in world cues, meaning there are no external UI markers or HUD elements that live outside of the constructed world. This is called Diegetic exploration, and it means that moving through a story-world is done using only tools, information, and navigation cues that actually exist inside that fictional universe. Diegetic exploration is crucial for the kind of experience I am trying to build, and this concept deserves its own post to expand on it.
But, as you may have noticed already if you know of or have played Myst before, it is not a real-time game. Due to hardware limitations of the time, the entire game is played by clicking through pre-rendered images. So one of my goals with this project is to retain the point-and-click interaction but modernize it into a realtime 3D virtual space, expanding the possibilities for interaction within the virtual world while retaining the handcrafted authored control that Myst's designers had. Using Unreal Engine 5, I built a node based navigation system where I could manually place position nodes on the virtual world, and clicking to them would have the camera glide from its current node to the clicked node along a generated path. I also built it so that this click could also trigger events in the virtual world, such as animations, environmental changes, character interactions, etc.
I'll make a dedicated post about this system as it has a lot of things that I can go over.
Back to the post title.. not quite a game?
Now, though I have many of the concepts and systems in place to continue building on the project, I've put it on hold for a little bit because two things still aren't clicking. One is that I'm not trying to gamify the ideas and feelings that inspire this project. Instead, I'm trying to convey them and complicate them. How and which game design concepts can I leverage to shape this experience without overly gamifying the experience?
And I'm also not sure that I want to create a "single-player" experience.. as I think so much of the feelings behind this project are processed in dialogue and in relation to others. How can diegetic, point-and-click exploration be expanded upon in a semi-multiplayer setting? How can users connect or support each other's experiences in this virtual world? Should this happen in a shared physical space (say, 2 players in a gallery room), asynchronously online (users leaving notes and traces of each other in the world), or something else entirely?
The previously referenced article, Realtime is a Poetic Technology by Damjan Jovanovic, is rich in history and thought, tracing conceptual lines from Wagner, to Tale of Tales, to Fumito Ueda and many more. I highly recommend giving it a read.
It concludes with:
"Realtime technology gave artists something extraordinary, which is the ability to construct a world and allow another person to enter it. The artistic response to that capacity is neither technological worship nor conceptual distance. It is responsibility for the quality of the encounter. Someone enters the world, something happens there, and for a moment the world becomes real enough to matter. That is the art."
Comments