Author: Binyan Xu

w4-handpose music-Allie and Michelle

Allie and I wanted to try ml5 to control music and we decided to use handpose.

She made the input and I made the output.And we tested it together.

 

Our interactive part:

1.fist_size can control the music play/stop, and also can control the volume of music.(this works)

2.the x of index_finger can control the rate of music.(this works)

I tried two songs, the “rythm” one is more obvious on rate change.

3.the x of index_finger can also control the drum.(I’m not sure whether it works.I tried many times ,but I cannot hear it.)

Our question:

the song hears noisy in p5, is that because I changed the rate of it?

We are trying to pause the song and hope it can continue next time.But we only can stop it and play from the beginning next time.

I put a test video here, in case p5 runs too slow in class. 

W10-pcomp Motor Motor

Motor drives me crazy this week！！！/(ㄒoㄒ)/~~

They just didn’t work！

stepper motor：I change my pin to2，4，5，6

DC motor：I don’t have the switch and I decided to DIY the switch. I changed the jump wire  connection manually.

 

Do I have different type components? Why they didn’t work?!!!!/(ㄒoㄒ)/

I will try again tomorrow.

I also borrowed a motor control shield from nyush，and I will try it tomorrow.

 

W3-AE-scene

my scene part：

Imagine，there is a squirrel running inside

Day: I try to adjust the color of the sun, but I cannot do it well. I want to have a burning sun.

Night：I make the nearby scenes move faster than the distant ones.I think it’s like this when I run in real life.

W10-VPD Collaboration/Brainstorm

1.Try to work in collaborative project.

 

2.Develop our story and go shopping for reference material, asset packs and tutorials.

Our story is,

Our story reminds me of Pygmalion who fell in love with sculpture.

I developed this story a little.

A genius puppy dog who hates lovers escaped to Mars. She is obsessed with creating art with video recorders. After a long and lonely time on Mars, she fell in love with the 3D boy she created in the virtual world. But the virtual boy’s desire to control gradually increased. Our doggy girl is trying to get rid of the control desire of the virtual boy, while fighting against the curse of hating lovers in her heart

 

I collected some sci-fi assets in my library and I found that some of them are suitable.

1.This one seems like a place to live on Mars.

2.I wanted to use this  one as environment on Mars, because it has better quality.

3.This looks like the virtual world where my virtual cyber boys live.

4.I love this scene ,but I haven’t have it.It’s a space hotel.It makes me think that there will be a story like Kubrick’s “The Shining” happening in the space.

 

For my midterm project，I felt that sometimes to tell the story I really want to tell,I have to choose the assets with not so good quality，because I cannot make them by myself.

In the second half  semester, my basic goal is to make my shots more realistic in UE4（the best possible quality，especially for my character）.

There are few things I want to learn and I tried to find their tutorials.

1.I want to know how to shoot real people in the virtual scene built by UE4.

I followed him on Youtube and he also has a tutorial about how to build a virtual production work station at home.It looks so attractive and I really want to have a work station like that.

All the equipment he have seem unaffordable for me now, and youtube recommended me another video.I haven’t watched it but it seems cheaper and more affordable.

And… a pretty cool video

2.3D scanning：Sometimes I felt that the assets in the Quixel Bridge are limited.They are enough for building American scenes, sometimes I want some Chinese style scenes，but I can only use Japanese style materials instead.I want to learn some basic knowledge about 3D scanning.

There are lots of 3D scanning products and services provided online.I knew some basic thing from this video，

 

And a free app for phones introduction.

3.

1）How to make my character more like a real person？I mean, I hope my character can better convey emotion when shooting at close range.（Except for MakeHuman, I know nothing about making characters，and I want to dive deeper.

I go back to our Week3 and learn more about those software.

A series of tutorial about that.

I have watched one on Unreal official channel，but I cannot find it this time.

 

2）How to better control/adjust my role to make him more suitable for my needs？(If I download a character)

Same as above I think.

 

4.I hope to be more familiar with the usage of blueprints.Although they are simple programming, I still don’t know them very well.

5.How does my character interact with objects in the virtual scene？Like how they drive cars?

6.Explosion effect

W3-sound

Actually,inspired by Chrome sound lab,I want to make more complex

pattern with algorithm. But I fail to make them work.

So I decided to back the basic thing. I started from changing shape of the wave and tried to make them look fancy.

 

I am trying to make a flaming red lips talking to you。

https://editor.p5js.org/MagicMonkeyWow/sketches/8U-fIUCsd

Animation:Response to Understanding Comics: The Invisible Art

The two strongest feelings：
1.I seldom read comics and I have always had misunderstandings about comics as the author mentioned.
But after reading this book, I really want to try to read comics.

2.As a filmmaker before,I always think about what kind of movies can attract the audience and interactive with their emotions.
I think I found a lot of answers in this book.Most of the author's views are based on art history, and the filmmaking is also based on art history.
 This is why I think the same principle can be applied to filmmaking.And I think I found the reason why Marvel movies are so popular in this book.
I would like to talk more about this point.

1).Simplifying or cartoonizing characters as much as possible is an effective way to make it easier for the audience to enter your story.
This is why some ordinary-looking girls can become popular movie stars（at least in China).Because the audience can see themselves from her.
And once who "I" is becomes less important, what "I" says becomes more important.
 
 

However, based on my previous experience of reading comics, I always feel that they are too unlike me and feel sleepy.
why？

2）Closure(知觉封闭性）and its technology.

This is a viewpoint that I didn’t realize before, I want to read more about McLuhan’s related works

a.The most interesting thing I think, is  the author conducted a quantitative study between each frame of the comic.I think it can also be used for transitions between scenes in a movie.

b.The balance between SUBTRACTIVE and ADDITIVE.

c.Method of controlling time with panel（p101）.

This reminds me of ” bullet time”(子弹时间） in The Matrix.It turns out that in movies we have so many (or even more) media methods to change the audience’s perception of time.Every innovation is a huge advancement that will be remembered in the history of film.

What’s more interesting is that we can find references from comics！

Duchamp’s “Motion Line” reminds me of “Bullet Time” in The Matrix.

3）Is emotion visible？

Comics have their own unique media methods. I feel shocked that such simple media can express emotions so vividly.And with more and more complex media means, we should be able to express emotions better.
Comics can be the basic reference.

As a basic and long-standing art form, comics inspired me a lot in filmmaking.I also have a more vivid understanding of art history from the author's interesting cases.

If the purpose of this book is to arouse the interest of someone who has no interest in comics at all, I have to say he is completely successful.I am eager to read the comics in different styles mentioned in the book!

Pcomp Project 2 Violent aesthetics

My silly tiktok video, but I love it.😆

 

Final version:

Flower Version:

Direct Boxing Version:

Next step to improve:

1.Sound visualization（p5） of dirty words from different countries（different language）.

2.

My project can be more targeted to specific groups.
One thing I want to do:

I asked my female friends from social media for words that made them feel hurt.Put these voice into p5 for visualization and use interaction with boxing ball to eliminate these hurtful language.

This can be used in any specific group to solve psychological dilemmas or stress.

Next next step（inspired by ICM class，but I don’t know how to achieve it）:

Machine learning can make those hurtful words more personal, and it may be a good way to treat psychological problems.

I think about this because when I asked my female friends about harmful words, many of them told me the most harmful words were from ex-boyfriend.

I was thinking this might be a good way to treat broken love

 

One interesting thing:

At first ,I bought a 12 meters USB connection cable and I thought it’s long enough and I can hide it along my boxing ball.

But it’s too slow to transfer data.Finally, I only can use a 2-meter one.

That’s why you can always see it hanging beside my boxing ball.

 

———————————————————————————————————————————————————————

This project made by Michelle and Dolby.

Final version code:https:

//editor.p5js.org/MagicMonkeyWow/sketches/EwHXkNzh1

Flower version code:

https://editor.p5js.org/MagicMonkeyWow/sketches/-xolecKo2

Reference：

1.Lab: Serial IMU Output to p5.js：https://itp.nyu.edu/physcomp/labs/lab-serial-imu-output-to-p5-js/

2.https://zhuanlan.zhihu.com/p/48926579 (Chinese one).

 

 

 

ICM-MEDIA W2 COLOR

I am exploring color interaction with my Arduino this week.

I tried several things,

1.Lisa’s Gradient clover with mousepressed.  And I can change the “mouseclick” function into a digital input from Arduino.

https://editor.p5js.org/MagicMonkeyWow/sketches/pWMnugcYM

 

2.Lisa’s Gradient clover with a analog input.

I use “mouseX” as a variable here and I can change “mouseX” into my accelerometer value(analog input).

https://editor.p5js.org/MagicMonkeyWow/sketches/y46OBjtop  

 

3.I want to try some painting splash effect and the splash-ink effect of Chinese painting.It seems difficult and I am still working on these refenrence.

blot-painting: https://mostlymaths.net/2020/05/blot-painting-p5js-sketch.html/ 

the splash-ink effect of Chinese painting(in Chinese):

https://zhuanlan.zhihu.com/p/53695818