Camerca FX + Mic FX = AR

Natural Augment?

This picture was taken in NYC. When I seen the picture it made me think, who has a bleeding sword through their heart designed and posted up for display in a window somewhere but then after I developed the picture I seen that I had caught the reflection and in fact it looks as though I am the one with a broken heart, maybe that is why I took the picture. This made me look at augmented reality different as instead of a heart it could be a computer generated game / display.

Camera & Mic FX

INPUT = CAMERA


EFFECTS
e.g.
swirl
curve
round
emboss
sketch

INPUT = MICROPHONE


EFFECTS
e.g.
1/2 speed
x2 speed
echo
high pitch

Comp Ascii FX

 Computer language is represented as text, whether its binary or ascii it is still written in a text format for the computer to decode, so to be inside a computer would mean that we would have to be represented in text for the computer to understand. This is like being a part of the matrix however the matrix has its own format of 0's and 1's (binary) in a green colour so I thought this representation was better as its all letters and shown in a black on white imagery. (without sound)

Matrix FX

 To be inside the matrix means that you are in the world of the matrix and whether you are bound by the rules or not you will be viewed by people outside of the matrix via this feed. This is the view that is seen at the end of the movie when Neo the main character in the films comes back to life and can view the matrix with his naked eyes, however we can't so therefore I like this augmented reality and think it would be good with sound but there is no 'matrix' sound except the voices of the characters portrayed in the film by the actors.

Max5 - Handling Sound

As previously explained you can have inputs to Max5 using the following objects:

 

But as well as these there are many more things you can do to manipulate the inputs using other objects and messages as follows:

The previous is another way of toggling between on and off but this time using messages such as 1's and 0's to give it a state.

The following is a form using the Max5 keyboard in the patcher so that whenever you click a note on the keyboard the appropriate sound will be outputted to the speakers or headphones:

 

As you can see this uses the notein and noteout objects.

You can also add more interaction and better handling by using other objects. The following is a input from a mic to a output such as a speaker. 

adc~    =   analogue to digital converter

dac~    =   digital to analogue converter

These can also be used by using the speaker and microphone symbols,  I have used both in the following:

As you can see with the following you can also have sliders as volume controls or to control the synthesis of a sound, the bars labeled input and output show the volume at each interval. There is also a number box to show the volume.

But what about opening from files? You can not only open files but you can play, stop and pause where appropriate:

 

 All of the actions made on the sound are message boxes as this is the best way of a human controling the sound as if it were all code it would get very confusing.

Here is a more complicated way of manipulating sound in max5 I will try and explain what I can:

 

The previous example is a loop with a stop and start button along with the toggle button which sort of does the same thing, the 0.5 is half way to 1 so this makes the sound play half speed. The groove is connected to a buffer, if both of them have the same name then they automically relate to each other, if you do this wrong you will have a error outputted but once they have been connected and related to each other the error message will dissapear. The 1 or 2 represents the sound output, mono for one speaker or stereo for two speakers. I have used the speaker symbol here instead of the dac~ to give you a better understanding of its use. The min and max points in the number boxes do exactly as it says. The buffer looks like this:

Simple read message sent to the buffer which has been related to its groove~ object, the length of what we want and 1 or 2 for the sound outputs.

Max5 Inputs

ANY INPUT

Max 5 has many inputs available for the software to take in, this is done by using different objects to get the data in, one of these objects is the ctlin which is a midi controller. The following allowed us to find a key's number and a reference number to that key, using keyboards this time, don't worry this will be covered later:

KEYBOARD

The keyboard can also be tracked determining which key you press, the object for this is key and it tells you the ascii number of the key pressed NOT the letter. Here is a complex version of a keyboard tracker:

In the above code when the key 115 is pressed (I think it was P) it activates the toggle button which then turns on or off depending on it's previous state, if on the delay will start repeating at a high rate generating a random number up to 110 by the random object and displayed in the number box, if the button 112 is pressed (can't remember what button that was) the middle circle will light up and if any other key is pressed the right circle will light up.

MOUSE

 Last but not least is the mouse which has 5 parameters:

When the toggle box is active the mousestate objects checks what the mouse is doing, if clicked the toggle box will turn on and off and generate a 1 or a 2 to show if its on or off, the next 2 fields are the X and Y position of the cursor and the last 2 fields are the movement in the X and Y direction, if the user moves the mouse rapidly the numbers will be high compared to slowly where the numbers will be low.

Max5 Basics

Max5 is a piece of software that can implement any information through the system using different objects and tools to withdraw the information that is to be changed and also processing it in different ways.

When the program has loaded the first thing to do is open a new patcher, this is the workspace that all the stuff goes onto and where we implement our design. It has two modes; locked means that you cannot add or interefere with the design but you can test it and see how it runs. Unlocked mode is the editing mode where you implement the design and add new objects.

Basic objects and tools are the object box, this is used for objects that perform a action or do something to the data. These are one of the mostly used boxes in Max 5 because you can do so much with them. Along with that there are toggle boxes and option boxes that give control of the data. There are also boxes for integers and strings.

Here is a patcher that generates a random number every time the circle is clicked, the number will be between 1 and 100:

 

When the circle is cliked it will appear yellow and the number in the number box will change to a random number generated by the random object box which has the variable 100 to tell it what the maximum number outputted desired.

The following is another basic way of controlling data, in this case a toggle object is used, unlike the bottom above a toggle object stays permanently on or off depending on its state. This time a metro is used which is a type of delay and will turn the circle on and off in the delay that we set it. There is also a number box that you can scroll up and down to change the metro's delay time higher or lower/faster or slower.

 

 Along with controlling data and doing different things to it there are many mathematical techniques that can be implemented into the design to make it better. The following is a example of this:

 

This design previous adds the two numbers together when they are both clicked, the answer outcome is obviously 10. We can change the connections to make it multiplication, divide or subtract where necessary.

If you know what objects you need you can put them together to make a bigger chain of objects:

 

The previous picture is a bit more complicated example but its using the same objects in a longer process, they all behave the same though, the toggle object at the top will set the delay for the circle with the number box there to change the interval, the random number object is throwing another random number between 1 and 100 or whatever the maximum number is on the number box, this then has a 1 added to it to make it inclusive of that number and is represented before and after this affect. Not too complicated.

There are many other objects and techniques that allow you to create even more sophisticated and controlling patchers:

Dodge Game

This game is an adaptation of a japanese game show, similiar to takeshi's castle, in which players have to position themselves into a gap of an oncoming wall. If they succeeed they will remain on the platform but if the wall hits them they fall back into a pool of water, of course, there won't be any water in the augmented reality version.

The user will have a camera and will have to position themselves to fit onto the screen of whatever they are using to play the game. A wall panel will be seen in the distance with various shapes in it which the person then has to fit through, however easy it may seem at first, the later games hold more challenging shapes. Here are some of those shapes:

The wall will begin to 'launch' towards to player from the background and depending on the players positioning the player will either pass through the wall and prepare for the next one or the screen will flash red to say that the player has failed. The game can also be played by two players:

Instead of having a platform, the player will use the floor and instead of being in a game show, the player can play the game anywhere they want to, within reason.

Interactive TV Guide

My idea is to invent a tvguide that instead of reading, you view the best parts of the programme and can decide if you want to watch it. To view these video's you must need a camera with the software available in it, this is so that when the camera hovers over a specific part of the tvguide the user can see the appropriate advert.

The pointers used to mark this are used in the espire page above and among many other things, they are pictures of black and white shapes that the software interprets and shows the relative video, however, I have not encountered them before neither know what they are called but I would be very interested to work with this technology in this way.

---

AUGMENTED

New for 2010!       50p

---

Automatic Translator

My idea is to have a device that takes the sound input and converts it into another language, by recognising speech patterns and words using translation technology the device will turn all language differences into a thing of the past and will allow everybody to communicate via one language as individuals.

In order to do this we need a microphone to input the users voice, some speakers or headphones to output the neccesary language and a piece of software that recognises the speech pattern and changes it to suit a different language, preferrably, I'd like to be able to keep the persons voice so that the output would sound exactly as they would, not a robot made sound, although this would hide a lot of the augment.

This is what I believe it would look like when in action:

Play/Movie Theatre

This idea is for a theatre type place that holds a lot of people, these people will pay to come into the theatre and wear the goggles/glasses pictured above which would display the input from a camera at the front, this would mean that the user can see everything around them as they normally would, to find a seat and sit down with their popcorn and beverage. When the lights turn down instead of a projector projecting the video onto a screen, instead the characters will appear in front of the users eyes and appear to be walking in front of them, but they aren't really.

This will allow cartoon characters to star in their own performances, the aim for the watcher to have more of a emotional connection with the character from the whole experience of being able to watch them in a real like reality, also the special effects could be cool.

Augmented Taxi

This idea is a follow up to the pool robot which would intake things from the real world and determind its own actions depending on the state of the real world. I liked how instead of watching a our own reality in a augmented reality there could be a augmented thing in our reality. The customers could text a number saying "taxi" and using GPS the navigation would know where they are and there could be a text message relay to say when the taxi arrives. When the client gets into the taxi they will notice the artificial driver. Two inputs from the client is the destination and the money for the fare.

The customer puts there postcode / destination into the computer which is similar to a satnav because it uses the same technology. Using route finder software the computer can produce a route on road for the taxi to take including other information such as distance, traffic and speed area's.

Either up front or as the taxi reaches the destination the computer will give the customer feedback on the price of the fare then customer puts their money into the slot. The change will be given to the customer after.

As for the driver they will be a holographic display of the companies employee and could have speech or communication technologies built in. The driver must also know how to avoid collisions and other things that may appear on the road, to do this the computer will interpret the hazards in the real world and determine the best possible action, as shown in the second video. The first video shows the project of a holographic driving assistant:

Augmented Hand Painting

"half the mess, half the stress"

This idea could be a side project of the 'Wall Widget' idea discussed earlier, the user would take a special kind of glove that would allow their hand movements to be tracked and would be able to write on the walls with their hands or fingers and create their own art.

It could also be used to create lifelike objects in the digital reality which would make it appear as if the objet is alive and is on front of the user when really it's not. Interaction with the art would be minimal because it is not a part of the real world however, the user will be able to add, delete and edit as appropriate.

The following is a example of this effect created with motion technology:

This technology allows the artist to be in the same reality as its artwork and therefore it is a representation of itself in its own way, also the use of a glove not a stick could make for better artwork.

Augmented Pool

The Gadget Show / The Gadget Show: Season 13 - Episode 8

Season13 Episode8

22 Mar 2010

Compass technology

Seen on the apple iPhone.

A built-in digital compass that works just like a magnetic needle compass can let you know which way you’re facing, digital compass rotates maps to always match the direction you’re facing. You can also use the compass on its own.

A magnetometer that works as a digital compass will enable the iPhone to determine which direction it is being held in. This will allow useful things like turn-by-turn navigation (time to ditch that satnav?) and ‘augmented reality’ apps that superimpose info about a location onto a camera view or Google Street View image.

Wall Widgets

My idea is to have a bare room with nothing in it, or at least until you activate the augment. The augment can be any type of digital information basically as if the wall is a screen. The client would predefine the living environments to suit theirself, think about it, you could have any view on your wall or any image anywhere with no effort.

How the room would normally look:

Augmented:

Similar idea to the screen used in Minority Report where Tom Cruise uses gloves:

Use

This technology can be used to create a mixture of reality and virual reality allowing the user to be in a reality unknown to their own.

This also allows the user to have more information than usual.

Newest iPhone App

Newest iPhone app is a camera installment that lets you move the camera around via cumpus technology and shows londons underground to the user depending where the camera is pointed. This means the user can see more than the naked eye and can position themselves to be where they need to be more easily.

YouTube:
http://www.youtube.com/watch?v=5fZk0HaIs4s

Augmented Reality

What is it?

Augmented reality is a concept that combines reality with a virtual reality superimposed on top of it to become one augmented reality. The first time I ever saw augmented technology, although not a live production but still the idea, was in a Star Wars film where C3PO and Chewbacca are playing a projected game on a table and Chewy is a sore loser so the robot says the extract underneath. Two realities becoming one has been seen in many films however the interaction, technology and user participation has been minimal up until lately.

"Let the Wookie win."