IMA Documentation

Inspiraton

In the game, the player has the ability to travel back to the start of the game when it dies, while the previous “itself” still remains in the game. When the player dies and restart the level, a tim shadow of the player will be generated. The shadow will move on its own according to the previous movement of the player, the player need to cooperate with “itself” that exist before the world restart to solve puzzles and defeat enemies.

Suggestion of the Professor

Professor recommanded a package to realize the idea, he alsp suggested that instead of let the “time shadow” to behave completely the same to the player’s past (including transform, shooting and other interactions with the environment), we could only save the transform in order to reduce some technology difficulties.

Professor also suggests to make the difficulty a bit easier, and make more levels using this mechanism in the future.

Tech

I use object recorder to record the operation of the user and put it on the time shadow. It causes the main problem now:

as the function is from UnityEditor but now UnityEngine, the game could only be played in unity edity, but not be able to build.

so I attached videos of the game, if you want to play it, you can have the src files from me and run it on unity editor

Link

The first video is too large to be uploaded here

https://drive.google.com/file/d/1nEj7I9eIpqtaY-xFfEbfMsiHwPrESlti/view?usp=sharing

the one below is a complementary video, plz watch the first one before this 🙂

Variables:

1.

very simple, just create variable and Debug.Log them out:

2.

The tricky part is to insert the variables as string in the story text elegantly, without using too much + operator:

therefore I use the operator in the code:

IF statement:

I combined the 3 car speed control tasks together in one program

when pressing w the car accelarates, when pressing s it decelarates

when the speed is positive the state is moving

when the speed is negative the state is reverse

when the -0.001 < speed < 0.001 speed will become 0 and state = stop

speed limited to -100 ~ 100, reaching the boundary will cause the state to become overspeed

To enable keyboard input, I used the special function in unity GetAxis()

To have a reasonable update rate of data, I used Time.deltatime

Switch

1. color

Very simple, not much to say.

2.  change weapon

I feel like it is easier to implemnt it usinf IF, because I googled that it is not quite easy to detect arbitary keyboard input and tell what is the key in unity.

Array

1. change color

2. change color by tag

For loop

1.

I feel the most difficlut part is to put the camera at the right position so that it can see all the cubes

2.

function

I put the three tasks together：

press w to move

press space tgo change color

press s to measure distance

In the last two weeks, I have developed my red panda model further, adding some color/texture and smoothed out the behaviors in each scene in RC. I applied the code I received from Nien to make the app one continuous experience, rather than each individual scene. I ran into some problems with the RC file size, as each scene is rather large and takes a while to build. I had to reduce the scenes to 5 instead of 7. I will need to fix up the 5 physical scenes (on paper). 

Here is the link!

Next steps:

• smooth out previous scene transition by applying notification trigger in RC behaviors
• sometimes tapping functionality is off – figure out what is going on with that (for ex: sometimes when I tap the globe, it doesn’t spin)
• potentially add a voice over trigger for page readings
• add RC function so that pandas follow user camera
• would like to wire up a button on the last page (adopt) on the UI interface so that each time the user presses it, a panda will pop up 

This week we were given the task to create a functional prototype of our final project. My final project idea revolves around the idea of creating an interactive AR storytelling experience of the endangered red panda. 

This week, I focused on putting all my assets into RC and creating a very basic prototype of what I imagine my final project to be. I mapped out the storyboard and the ideal interactions I hope to carry out. I initially had trouble referencing multiple scenes (aka. different pages) from RC into Xcode and that caused a lot of problems. I also focused a lot of 3-D modeling through Blender and texturing them through Substance Painter. Since I spent more time on building and importing other assets, I didn’t get a chance to fix up my panda to the ideal image yet. 

For the screen design, I wasn’t exactly sure how to go about the design because as of now RC detects the image on each page and triggers actions, rather than through an interface on the screen. I will need to think more about how to vamp up the interactivity. For future work, I was thinking I could add more interactivity on the screen by including buttons/labels/etc that trigger some sort of popup notification that allows the user to learn more about something or go to a link? It would also be cool to have the assets “pop out” of the book! Not sure yet.

My end-to-end user journey is still in the process of being finished, but you can kind of see the idea of what the story journey is like. For future work, I would like to figure out how to create a start and end page so that the user journey is more clear. I am just not sure how the code for that would be because we’ve mostly been working on creating in the moment AR experiences. As of now, I’ve been working on separate scenes rather than one coherent one. So, when the image anchor is detected, it triggers an interaction for that anchor, causing overlap from the previous page. I’m not sure how to make the previous pages assets go away or make certain assets (like the pandas) stay. 

Here’s a link to this problem.

Here is a link to the pages I have put into RC so far.

I have 3 more pages that I would like to add, but I wanted to see how to make the story/experience coherent before I put those into RC. I’m just not sure how I would begin to go about the code for that. 

Moving forward, here are some tasks I still need to work on/need help with:

• Creating a final physical storybook
• Editing and texturing my assets, mainly the red panda
• Creating + designing a start and end page
• Figuring out how to make the story one whole journey (as of now it’s just scene by scene)
• Integrating user interactions through UI?