This digital notebook contains the handwritten notes by Akshansh Chaudhary.
The notes are a part of the course MFA Design + Technology.
MFADT was taught at Parsons School of Design, New York.
For more content and study material, visit https://www.akshansh.net/.
3. 31Aug2018
Primaryfocusoftheclass Wv virtualReality
o
NYC is focusing on it
Joboffortunitiesforinternationalstudents VISA etc
F several
fagots in around NYC
selfAssignment Startlearningunity 3D
Theclass
may
not coverhereto use
Unity
UpcomingEvent in NYC Cin Sept2ndweek
BrooklynArmyTerminallooth Anniversary
Showcase
yourVNproject getfunding
o
History ofVR
Startedin early199Os a boxin which
you
stand operate
Nextin 2005 headsets thatcame with computers
120 X350 Px resolution
Oculus
Riftlaunched in 2012 DK
Madedizzy
n
hIw sho didn't catch
upwithmovement
SoOculussoldthemselves to FB
Idea createcontent
fora platformso thattheycan stick
around
fora
longtime
Akshansh Chaudhary 1 MFADT | Parsons School of Design
4. We haveMOTION CAPTURESTUDIO in school
4check it out
Checkphojects by NYCMEDIA LAB
Verizon othercompanieseduNYC
workingon Sa transformativetechnology as comparedto4G
what are its applications
VB will havetremendous scope ofstreamingspeeds
Check HTC vine we have it in school
Currentlimitations of VI
Difficulttohold
connectivityissues
inrealtime
codeinseveral
platformseverycompany
Thas
a difftcontentsstate
Ukheadsetsdon't
haveafocalpts
Soeyes
don'tknow
wheretolook
qwww.wdwb
emtuYfhollFmare
not
Interestingproject create a Ukinteractionsuchthatthelearning
curve is small
Akshansh Chaudhary 2 MFADT | Parsons School of Design
5. Coming up with new Uk contentis criticalforit tolast
long
Current topics in discussion
Use Al as personalassistants companionship
4 a movie HER
Nickfotuno oneofthebestGamedesigners
Usedtoteach atParsons 42
yrs
0 Frederic E Church 9painterswin1800s
cotopaxi sublimepaintings
History SocietyforNewYork place
forSublime
paintings
Harry
Potter exhibition
coming
in Octsois
Theidea ofthe cause is to
go
backtobasics
understandnature exploretheworld
4Create Va experiences ninththatunderstanding
Check out MicrosoftHololens otherV12devices
4Some ofthem are available at TNS
0 CheckGoogleCardboard
Akshansh Chaudhary 3 MFADT | Parsons School of Design
6. Understanding physical
spaceCdepthinformation
Sowhen
thingsareputin
space they can beputbehindother
things
BACCAM primary Vh headsetwhichwouldbeusedin class
as
tracksirisCnotheard
Otherheadsets MeiageSolo
Bridge Fone goodforeyetracking
Magicleap
oygffgnksfsanfqggfi.ge
adusGo Ithebest
HodgeHacking
StructureSensor 8Dscanning can bedone
using iOSdevices
Graphics wise BEST HTC Vine
Disadvantage lotofcables
o
Microsofthascreated a standard
forVRdevelopment
4companies likeDellHeer HP etc are
using
it
Isit is a separateplatform buttechnology wise it is still
developing
Akshansh Chaudhary 4 MFADT | Parsons School of Design
7. Magicleap 9 moregestures
bettercustemignthan MS Hoblens
Leapmotion Availableopensource
fordownloadingdesignfiles
Youwouldprimarily usethisforyourtargets
o Holokit 9 NYUdevelopedheadset
only
does
HR fan tah
youneedtocode
yourself
For VR development Windowsdevices arebetterthanthose
of
Apple
Take a PhysicalComputingclass nextsemester integrates
PERIPHERALS
very well
Motiondetection
glove withthis
th
yo
Gesturecontrol sensor
course
Hokey Makey A kittoquickly
makebuttons
Dexmo f2 Giveforcefeedback t givea
feelingoftouch
virtually
Woofer
Oo
Soundfeedbackband
Olorama Scent fragrance
PerceptionNeuron 9Motiontrackingsetup entirebody
Perception won
Tip Ifyou
need
anything talk to
Sven
Akshansh Chaudhary 5 MFADT | Parsons School of Design
8. Homeworkforthisweek
lookforAR VR experiencesaround NYC online
Documentthe entirething in a
blog
7Sept2018
JesperJuul
PHDin Games
Analysis on communitybuilding
forgames
wrotepapers
Feistpersonshooter
Ninogamesasdgnanimsystemsts
rules
goals game
mechanics
game
space
game
components
players what
you
are
doing in a
game
your
interactions
Game DinaDash Thought idea
ByTNSfaculty
clickingthe
game
as
pertimer
Akshansh Chaudhary 6 MFADT | Parsons School of Design
10. New
wayoflooking atgames
MDAGameDesign
4 ta Mechanics
D Dynamics
Is A Aesthetics
iaE mYmzYt paneusing l
JobSimulator Game
simulatingjobexperience
BoughtbyGoogle
Marinate
Game Experience 8
example JuicyBheakout
TE ON MDAexampleof MDA little Big YIyforres.eu
yPlanet Donmatheatgaffytuity
81 Depthkit Companies
working on VolumetricScanning
Realisticvideocaptureofpeople Holopastation
Present in NY
Kinectalsodoes it But Depthkit isbetter
Akshansh Chaudhary 8 MFADT | Parsons School of Design
11. Dotutorials on dirty
learn use it
Build SphereContraptionon
Unity
Indy
Rigidbody component addPhysicsto
your
object
Addmaterialtotheobjectforadding
behavior
Assetsection create Physicmaterial
Akshansh Chaudhary 9 MFADT | Parsons School of Design
12. 14Sept2018
Cool VRproject
Viewingsoundin Vh
ExperimentswithGoogle
Thy VR experience
forBladeRunner
Is
Google
CardboardgDaydream
whencreatingobjects in 3Dspace don'tkeep it still It
shouldhave some sortofmotion todepictlife
I changethenoteofmotion
ofunity Iplay
Edit Pagettsettings Time
fixedTimestamp TimeScale I
speed
Requires
goodrenderingpower
A fooling Unity
Variable TimedetaTime
proportionalmovement wot time automaticallydone
t.EE
Akshansh Chaudhary 10 MFADT | Parsons School of Design
13. variable Tinie time
eg
use
sniefMusingthis Mr
9141
Backlforth motionachieved
Matching herding standards
Phocessing Arduino Unity
voidsetupCK void setup void Start 3
voiddraw1393 void loop 3 void Updated I
Akshansh Chaudhary 11 MFADT | Parsons School of Design
15. 28Sept2018
whendoing VR development don'tmakethe
scene
looking fromjustone side
People shouldbeable to
navigatefrom allangles
In VR mostly we see content from 1stperson view
So think aboutcloseup scenes Take close up pictures
Analysing a spacefrombirds
eye
view is not the
best
thing
Flatfigures are
boring
Details auras brings exciting
needTerrain is
very
resource intensive in
Unity
So build models in
Maya animated import it in
Unity
Idea8Even if it is a rule build it somewhereelse
InUnity Terrain I unit I meter
I Unity int I meter reallife
For mobile platform use 2ooowints x sooo units
2km x 2km This is the mare
you
would use
Akshansh Chaudhary 13 MFADT | Parsons School of Design
16. Infirstperson control see theheightoftheperson
4Default height I 8winds
6ft
Directional
light straight light Sunlight
File Buildsettings exportoptions
Default Pc Mac
player setting
Othersetting
aone THE Gamma valueadjusts lightness
darkness
Everything linear 3 Higherendgraphics
looks
HM 4 useforhighqualityobjects
O
O
Akshansh Chaudhary 14 MFADT | Parsons School of Design
17. MainCamera
4 MsAA AntiAliasing Method
Redraws the corners
ofthepixelforsmoothness
z
smoothing
HDR 9Alsodoes anti aliasing
Don't use both MsAA HDR So turnoff
MsAA checkbox
O
O
lighting very
complicated object Takes a lotofbakingtime
Indeceit
lightbounce
Direct withoutbaking weonlysee direct
light lightwith baking8 Direct indirectvisible
Akshansh Chaudhary 15 MFADT | Parsons School of Design
18. Goofoffend.see
UncheckAutoGenerate
Ifyou
don't want the
bakingto run automatically
Edit ProjectSettings Quality
change thequalityofsender HighwayHigh
Anti Aliasing Deepdown Disabled
Using PostProcessing StackAsset
Adjustallprocessing at once
first PersonCam AddComponent 7 Post Processing
Not
Behavior
Maincamera Asset 7Create 7 PostProcessing Profile
XMLfile
Drag and dropthisprofileon the
addedcomponentofMainCamera
Akshansh Chaudhary 16 MFADT | Parsons School of Design
21. setup
your
computer
for UR equipment
IsAndroidSDK Java JDK
Edit 7 Preference 7External Tools
getall SDKs
Followinstallation
guide
forGoogle
Cardboard
Daydream
f
Download these I link
theSDK SDK
Update tesian share
screenshots
Additionallighting assets on
UnityAssetstore
4Legacy ImageEffects
legacy Cinematic ImageEffects
Akshansh Chaudhary 19 MFADT | Parsons School of Design
22. 05Oct 2018
Workin
outfighting
TURN off ALL LIGHTS
Starting fromscratch toseeeffectoflighting
Changeskybox A solidcolor
Change colorto black
Inlighting turn all intensitymultiplierstozero
Directional
light turnoff checkbox
setintensity
zero
O
d Turn intensity
multiplierto
zero
Giving a torcheffect fiftefittmentatha
blown
EID
spotlight
Akshansh Chaudhary 20 MFADT | Parsons School of Design
23. lighting mode
Realtime usedfordynamicobjects
third
Baked
foran objectwhichdoesn't move
eg
terrain trees
bake a richlightoncesothat
it can bereused
global
Illumination
In newer versions
ofUnity 2018
Abaked
light
basicallypaintsthe
light on the scene
to savespace in
realtime
Akshansh Chaudhary 21 MFADT | Parsons School of Design
25. Amin of Baking light on staticobjects
lighty
Afterclicking
Generate
g
lighting
Keeparatio of
1 10 2 40 is
IT good
g
Compress
lighting
Tickle NOT
render
fullused
Akshansh Chaudhary 23 MFADT | Parsons School of Design
26. Using lightPaoleeGrouprunifeemlyadd multiple
light
Putit wherethelightis changing
g
toteach
dotstoresthe
lightinfo on build
So we can usethis
infoon objects
Select a dot
press ctrlt D.li
duplicatethedot
0 makeaddnddots
0 2
Adjustthe
positionofthe
0 lightprobe
wherever
you
place
0 theprobe it will
take in information
0 lightprobe Data logger
So ifyou
want a particularcolorto behighlighted
add more
lightprobepoints fromthatsource
Akshansh Chaudhary 24 MFADT | Parsons School of Design
27. lightning setimportance
Selectthe light Inspector Rendermode
MAult Important NotImportant
I
died
lighting vertex
lighting
Moredetail d
Don'thome Uses
very
less
more than computingresources
4 imp lofts Ctakes
onlyvertex
in 1 scene
infoforlighting
Mid Team Builda worldusing
whatever
you
havelearned Oct 26
focus on aesthetics
Interactions aftermid term
It should work in VR
Once
leaking completes
youcan move theobject see which
probepoints are affectingthe
objectonthatposition
This scene is mostlygreen So
add more points on redregions
bakeagain
Akshansh Chaudhary 25 MFADT | Parsons School of Design
28. 12 Oct 2018
Workspaces to checktrends
forinspiration
Artstation
Pinterest Behave
creative
environments
Deviant Ast
Akshansh Chaudhary 26 MFADT | Parsons School of Design
30. Howtocreate assets Techniques
Photorealistic
takingpictures building a 3Denvironment
4 through it
Photogeometry
Structuresensors doscanning through
iPhone
Companies
working in Phatgeometry in NYC
8 I studio NYC Depthkit Nyc
NYC MediaLab is building a VR ARLab
Brooklyn Navy yard Building 22
Akshansh Chaudhary 28 MFADT | Parsons School of Design
31. AssetTools
Tilt Brush
works withOculus Rift
Shader Ascript in Unity you
can controlhow
many
details
you
want
2 brush 3Dmodel
pyneledit 2Dbased
magica
rood quickcharbuilding
3D coat realistictextures
Cinema 4D create own shapes
Medium 3D model in OculusRift
Blender
Milkshape takemodels
fromgames putin
other
games fileformatconversion
thetas
egoia goodfor lowpolygon
Retopology process to reducethefaces polygonsfrom
10 Hefaces to 10 K c
say
Akshansh Chaudhary 29 MFADT | Parsons School of Design
32. Miku MikuDance MMD
Make characters animate dance tomusic
Japanese
design
community
Create 2 sD models LIVE 2D
Putcharacters in a
format exportto create
fake 2 5D
Akshansh Chaudhary 30 MFADT | Parsons School of Design
33. Unity Chan
Download
fromAssetStore
to
Get a 3D model
with all expressions
3D kitbashing thredulararrangement
Building PARTSofa 3D model
getthem to
create a finalpiece
Usingscrap
tocreatesth
meaningful
Adobe Minamo Fuse
Akshansh Chaudhary 31 MFADT | Parsons School of Design
34. Autodesk characterGenerator
AdobeFuse
better8online
clipstudio Japanese version ofUnity
BowlRoll MMD CommunityBlog forinspiration
Open Hogwarts
a project
whichis an
open
communityfor creating Hogwarts
setup theplatform on OculusGo with the
prototypeof Mid Termproject
Akshansh Chaudhary 32 MFADT | Parsons School of Design
35. I9Oct 2018
Maeragingresources formobileplatform
Assetstore Resourcechecker
importinproject
Itshows alltheassets
beingused intheproject
checktheirsizes
goto Photoshop trim it
import thereduced file1512KD in Unity
Sometimes texturesizes are
of32 bit Ifthey
I
don'thave an alpha channel reduce it to 16bit
Window Rendering
Occlusion
culling
selectall Bake
Idea Bakes
onlythescenethatis visible notthe
entire scene
j
Akshansh Chaudhary 33 MFADT | Parsons School of Design
36. Toreduce thesizefather
go
to therespective object
click on static in Inspector Afterdoingthatto
allstatic objects use Occlusion
Culling The compression
would be better
stateI
Bakeas
manylightsas
you
can don'tbunthem in
realtime
Inthe
game
view
gotostats I seethevertices
fanmobile
ME3galiaatigan.ae
hfngf.fm
vertices
L l th vertices
ForOculusGo
F specialsettings on theirwebsite tofurtheroptimize
thescene
Akshansh Chaudhary 34 MFADT | Parsons School of Design
37. whendoing
gamedesign don'tshowtheentire screen
at once this willreducewhatneedstoberendered
less no ofvertices
Addturns tothe
viewso thatthe
X X X entireviewis
1 x x f notviable
x
ja Iv
a
Make a 2 3 sentencepitch
Handover
your
world toanyonebysayingthispitch
Akshansh Chaudhary 35 MFADT | Parsons School of Design
38. 26Oct 2018
Thinking languagesetse
As
yougetin
your
2nd
year
focus on one skill buildon it
Also learnthetoolswhichare used in theindustry
open
Frameworks notused in an industry
Cinder alternative openframeworks used
bythe industry
Processing
veryhinting notusedin an
industry
It is
very
slow to work on heavytasks
Layers Processing
Jana
c mmmm
inT.no
fs
JavaScript
very
usefulas it isusedin the
industry However Is is nota
visuallanguage It's greatfor
connecting things together
Akshansh Chaudhary 36 MFADT | Parsons School of Design
39. CommentsonElevatitch
when
you
create an Elevatorpitch thinkaboutwhat
you
want
otherstofeelafterseeing
theproject
02Nov2018
ZachGage
IndieGame Developer
Fishinggames
Playcrafting
A communityteaching
game design mobile dupt
Awardevent at TNS in Dec2018
0News
Nintendois working with a local NYC company toimplement
their controllers in theschoolausiculum
Akshansh Chaudhary 37 MFADT | Parsons School of Design
40. AssignmentfortheweekafterThanksgiving
Research on theassignedtopic leg shades
Understandits usefor2 weeks Nov 3rd 4thwk
Give a 30 minphesenthexplainingthetopic its
use totheclass
1 explore
Designingyour
own controller
HumanInterfaceDeviceCHID
Idea create a device which the computer understands
addmaldriveris not required
You can alsouse sound
trigger controls on thecontroller
eg
AdGems
PhonePhreaking
usesound totriggercalling
UsedintheSos
Akshansh Chaudhary 38 MFADT | Parsons School of Design
41. o Makey Markey
Deviceswhichcan detectv low levels
ofresistance on
thebody use that tocreateactions
Using Adafruitcomponentstocreate an HD controller
Arduino PaoMicro can be used as an HHScontroller
Needs an additionalbluetoothmodule
Nintendo Labo
keyboard greatpComp device
youtube Firstlookat
NintendoLabo
Usingthecameratotriggeractions
Japan's culture newspapers
includecarboardbasedprojects
which inspires kidsto makestuff So they are familiar
withmaking stuffwithcardboard
Non HlD
o LeapMotion Peroducts used
forhandtacking
Kinect
They haveprogramlogicsystembuiltforUnity
µConnect with PCthrough USB
Good
company to workfor friendly interested inproduct
improvement
Akshansh Chaudhary 39 MFADT | Parsons School of Design
42. Manus VRo
b 900
Myo GestureControlArmband
Tracksthe arm
muscles when
we
grabsomething
Dexmo f2 thimic touching in VN
SmartGloves by Dani Hu
TNS Alumni
Woojer a belt to
givemusic flb
Now making a
fullsuit
Japan an algorithm thatgeneratescharacters when
youinputdifftbarcodes blasted inJapan
Akshansh Chaudhary 40 MFADT | Parsons School of Design
43. Apple'sfocus creating a
living room technology
Microsoft FDA approved
Akinsurgery projectonthe backofa
person's back doctors can analyze do
surgery
NAV MESH CNPc QR Samples
Defining the area ofthe mapin Unityto bethe
most expensiveto go
ega.gepatrolling theobjectshould move in thekey
Alfollows a path
Michaelworked on it in 5 in s
VerbalCommand
Tv
robustpipeline
Google IBM Watson
Createinteractionwith voice
limitation 8 connectionspeeddependency
sG will solve it latency willhave a
guaranteedvalue it
would be toox faster
eye train Watson todetect
HarryPotterspells
done
byKyle
Akshansh Chaudhary 41 MFADT | Parsons School of Design
44. m Create a conversation
through TextASpeech
leg whathappens in
a voicecall
Watsoncloud expensiveservice
l yrfreefor
developers
FeistGoo interactions
free
o Watch Watson
Unity SDK series on YouTube
a
A TRICK Useyour TNS alias to createmultipleaccounts
extendsoftwarelicenses
get 2licenses
o
o Gamers liketo sit play think about thatwhen
creatinggames1interactions
forthataudience
Akshansh Chaudhary 42 MFADT | Parsons School of Design
45. 09Nov2018
INTERACTIONS BASED ON GAZE
o Newrendererfeaturehomecome on OculusGo
Add a
fewlines in thecodeto
give
a better
rendering
Using Gayeinning
cRAYCASTING SONAR EVENT
Setup a listenerto
listentheaggressiveness
aidknowthe
4yourplayerAbject
intersection with an
Setup Event
object triggerevent f
CDelegates
Achain
de
listener
Polling writing everything in the update1323 fn
Akshansh Chaudhary 43 MFADT | Parsons School of Design
46. 0
Doing Raycasting on
Unity
Check Assetshire Unity Projects 7VR Samples
Ithasmostofthesettings
alreadydone
Automatically focuses on thetarget
Titans
jhaicalviewofthe menu
Scriptspresent
in Unity
StatAssets
OnUp KeyPressed
OnDoron
Key
Released
UsetheStd packageshared
byKyle
Usetheprefabs customize it as needed
Sphere ChangeColors
bwe can addsound on theobject
o
it doesn't
destroyitself
ScriptAR colorchange OnEnable OnDisable
i b using
events listeners
Akshansh Chaudhary 44 MFADT | Parsons School of Design
47. Sphere fire
It hasparticlesysteminsideit So the object
needs to be linked withtheparticles
Ihfentimiffitote
system
add action
remove action
void onEnable void onDisable are built in
functions
using UnityEngine
Addingthis tothescript willmake
Unity
understand Particle
Systems
Shortcut to commentfuncomment on E E
Comment Al t k t o
Uncomment Ctrl t k t u
In a
game
F severalparticle systems So itgetsconfusing
to don't use sound
sys
on a particle
Treat an emptygameObject use it as a soundsource
RR Explosion
4 var Michael
Bay explosionparticleeffects
Akshansh Chaudhary 45 MFADT | Parsons School of Design
48. If sthis private you
want to see it in theinspectorwindow
add Serializefield3 before it
few multipleexplosion playwithdifftvolumelevels
for
bettereffects
With using Events listeners
if elsestatements are not
needed
anymore
Akshansh Chaudhary 46 MFADT | Parsons School of Design
49. 30Nov2018
DIFFERENT PROJECT PRESENTATIONS
KeDing Nick's team
DMthe DistanceIndependentMillimeters
Creating a v1 that'sreadable
Character in Unity Defaultfreight
1.6
Ul canvas set thescaleG o oo l
when we import an
inrage inside unity changeits
propertyfrom Default to sprite
Then in the UI element
drag dropthis
ring
in the source Image section
Dot MatrixSystem
IsCreate a reference
Sipin Unity
Akshansh Chaudhary 47 MFADT | Parsons School of Design
50. Using Mixamo
Rigging Uploadingto Mixamo
FBX Doesn't work well in
thioamo
Expertcharacteras 0 BT to be
usedin Miami
Downloadingfrom thinearms
Always FBX forUnity
FBX storesmaterials
OBI Doesn'tstore
Import
FB in cab
materials
you
can treat it there
export it
again
as FBX
Then inpostet in
Unity usinganimationwinded
making transition
Using 2 brush a sculpting tool
Good 3D softwareto use Element
Akshansh Chaudhary 48 MFADT | Parsons School of Design
51. Echo Ashita David SpacialSound
GoodsoftwareforSpacialSound
Audio Handled throughaudiosource audiolistener
Ago Yashwanth others Blind Flying Game
Using Osesimpt
x
Akshansh Chaudhary 49 MFADT | Parsons School of Design
52. I4 Dec 2018
FINALS
p
Sam
Commentsonmyfinialproject
SATO
Document theprocesswell That willhelpexplainthe
concept
Greatexplanation
ofthephysicalprototype
Testthe HUD byplacing it in differentlocations wrt
the medicine
1 21
Akshansh Chaudhary 50 MFADT | Parsons School of Design
53. Theinterface the HUD hags with headmovement
Improvethat
Kyle
Add an animation nextto the ring enzymesuch
that whenthemedicinepassesthrough the animation
blocks the enzyme That willcreate a better
feedback to theplayer
Theinterface starts
veryquickly in the beginning
butthe pacenormalizesafterwards
Akshansh Chaudhary 51 MFADT | Parsons School of Design