Dear viewer, these subtitles were generated by a machine via the service Trint and therefore are (very) buggy. If you are capable, please help us to create good quality subtitles: https://c3subtitles.de/talk/1116 Thanks!
We.
We're going to
look at how to bridge the gap
between the physical and the digital
world.
So we go into immersive
things.
And my guest here, our
guest here is Patrick,
and he goes as well with the nickname
Cripe.
He's currently doing a Ph.D.
on human computer relations
interaction, actual interaction.
It's important to
say he
OK,
I'm not going to discuss this since I'm
as well a little bit on this field.
We made an agreement like that,
but he's focusing on augmented reality
today.
He's doing this study and the reason
I understood.
He has a general interest, of course,
in things to do with 3-D
that goes along with these kind of
things.
Yeah. And his talk provides
us an overview on
air in general
and explain its possible uses
for goods and for
the bats.
OK.
Ladies and gentlemen, here's Patrick.
Please give him a warm welcome.
Thank you.
Light the Fuze and put it in place,
Patrick.
Thanks.
Yeah, thanks.
Hi, everyone. So this is a foundation
talk. So it's mostly aimed at people
who know nothing of very little about
augmented reality.
So hopefully after the talk, you will
know a little bit more.
However, if you have some experience,
I hope maybe you will get some
new impulses, I don't know.
And furthermore, the talk is also focused
more about how augmented reality can be
used for everyday life
and not so much on the scientific
community.
So and it's roughly like 30 minutes
or something like that. So I made it a
little shorter so that we have to have
some questions on the end.
So if you have something that's of
particular interest, just
ask afterwards.
So but first, let's talk a little bit
about virtual reality because like
I think most people maybe are more
familiar with the term, that's been
a lot of talk about virtual reality,
like changing, revolutionizing the
way we use computers.
There are many commercial virtual reality
headsets of as ever before
and also quite a lot of applications.
But somehow, VR doesn't
really influence our everyday lives
that much, and I think there's two
reasons for that.
The first one is that that
virtual reality applications
are mostly centered on entertainment
right now.
And the second is that it disconnects
or some pretty much from the real world.
So while it might have the ability to
to actually
transfer us into another world which
more or less looks like this,
at the same time, we are caught up from
reality. And in contrast, augmented
reality expands the real world and
in the mind of most people right now,
this looks something like that.
But the important thing is that we can
still perceive our surroundings and
we can also experience the virtual
content as well.
And this particular difference makes
air a lot more useful for
everyday use than virtual reality.
So let's go to to a little definition of
what augmented reality
actually means.
So the important thing is that we combine
real and virtual content blowing
the borders between both sort.
So as you can see, here's a virtual globe
on a real table,
and the application also
interacts in real time.
So if I move or if I
have some input, the application
reacts on the spot. There's no delay.
And the objects are situated
not relative to the user, but
in space. So if I move around, the globe
stays on the table.
So this is basically
what what I mean when I'm talking about
augmented reality, what I mean?
But what it's also important
to note that air is only part of the
so-called mixed reality continuum,
which ranges from reality
without any augmentations.
So to normal reality, we experience
every day to a completely virtual
environment.
And those four categories are basically
the the classic mixed reality continuum.
There's also some extensions
to that which you can
see here. I don't want
to go into any detail of what those all
mean, but an important thing to
remember is that there is no hard border
where augmented reality begins and
where it ends.
There's also a lot of ways to provide
augmented reality
mobile augmented reality like Pokemon Go,
where the air conditioned
us perceive to a mobile device like a
smartphone as the most common
form today.
There's also projected augmented reality
where you have a project to superimpose
an image onto a real environment,
which is especially useful if you
have like collaborative scenarios where
the content should
be perceived and manipulated by a
group of people at the same time.
You can actually see this example
right out of the door.
There is a similar installation there,
and then there's what just toggles
or some molds mostly focus about head
mounted of mandatory Orochi,
where users wearing eyeglasses,
which can be seen through and
where the virtual content was projected
onto. And this is the most immersive
form of augmented reality.
And when you have sophisticated
technology that's more
or less indistinguishable from
the real world.
So that's that's basically the goal what
we want to get.
So but now is the question OK, why?
Why augmented reality?
What's so important? Why we have to talk
at all?
Yeah. For that, I want to quote
Tim Sweeney of the CEO of
Epic Games because it's always a good
idea to quote someone who's more
famous than oneself.
And he said that.
He believes that augmented reality will
be the biggest technology, the
technological revolution in our lifetime,
because once we have an air display, you
don't need any other form of display, you
just take your screen wherever
you go.
So that's a very powerful thing to say.
He also thinks that a revolution will
happen in the next 10 years,
which is very optimistic from my
perspective when you look at what the
current technology can do.
But nonetheless, I believe this
revolution is going to happen sooner
or later, so it's useful to familiarize
yourself with the term.
What is also important to note is that
the goal is not to just substitute
real displays with virtual ones,
but augmented physical objects
themselves that the augmentations really
have a relation with location.
They are situated.
So only then they are
will have really the power to
revolutionize our everyday lives.
So I
will elaborate on that
a little later on.
But first, a question like how likely
are fundamental changes in our society
triggered by augmented reality?
So if we compare world of smartphones
and the way they are used, I think it's
very likely because smartphones today,
our technology focus directly on
supporting the way
people live their lives every day.
So and also started as a research
long time ago before commercial
products were available.
And now they are ubiquitous and
they are an integral part of people's
life. And for some people, it might be
difficult to actually live without them.
And I think one areas
is likely to do the same when it's
focused on on the the things people
actually need.
And once the technology comes along.
But before we go to short,
very short history
of augmented reality so that you can see
what this is all coming from.
So actually, augmented reality is rather
old.
So the first augmented reality
virtual reality device
was built by Ivan Sutherland
in 1968.
It was called sort of Damocles, but
it was already had already had tracking
and see through optics.
So that's quite advanced.
For the time, I would say
the actual term augmented reality
was only coined twenty five years later
by called a mixer on 1992.
So quite a long time
in between. But of course, the research
still not still during that period.
Here's an interesting example that I
wanted to show you from 1994
by state at all, which shows
an ultrasonic image of a human
fetus directly superimposed over
a woman's belly.
And yet it shows that even on
a very early on, the people
were thinking about how we can use
augmented reality to really benefit
humans and a lot of ways, despite
the technology at that time being very
limited.
This is also an important step because
it was the first mobile AR headset
for usage outside of the lab
and with the wonderful name Turing
Machine by FINA
at all in 1997.
So even like early on, the question was
OK, how can we use this technology not
only indoors, but how can we use
it outdoors as well, which is very
important?
And then finally, the first day our
application using mobile devices
in this case, PDAs for the people
who still remember them with external
cameras.
And you can see those little markers
in the background, which are tracked by
the cameras and done little virtual
trains are overlaid
over the wooden train tracks, so it's not
really that practical just to
like a proof of concept.
More or less so.
But yeah, like I said, mobile AR today
is the most common form of augmented
reality. But maybe, maybe that might
change soon, because now we have like
the current leader to do the first
generation of really commercially
available augmented reality headsets
and therefore also an increased interest
and from the scientific community, but
also from the industry for solving
the various problems.
So this immediately brings us to the
areas of application and hopefully how
augmented reality may influence
our lives in a positive way.
First, a little bit about the research.
Actually, only twelve point five
percent of the research was actually
focused on application cases
for augmented reality based.
The statistics are based on the
International Symposium on Mixed
Reality, and the rest
is focused on things like tracking,
technology, interaction, rendering and so
on.
And of those application cases,
most of them are usually industry
centered and not so much.
On everyday life.
So we have things like, for example,
logistics who have things in the medical
sectors, and of course, they have
a great indirect influence on our
lives. We will still benefit from those
things. But I want to focus a little bit
more on on everyday use.
So how can we immediately benefit from
what went into reality and explore
that a little further?
Also, things like guides and cultural
heritage, for example, and
telecommunication and telepresence,
which also brings us to the first use
case, which is our telepresence,
which is more or less like video phoning
only more
freely avatars of the person you're
speaking with embedded directly into
the environment. So basically, like a
virtual avatar sitting on the chair next
to you, which is,
I would say, rather cool because it's
something that that's out of science,
sci fi novels or films.
And but now it's here, now we can
use it.
And despite being far from perfect,
are still very incredible,
at least from my perspective.
And you can not only have a conversation
on real science, but you can also like
scale it up and down as much
as you want and the
lower rate and much.
You can see that the girl is
standing on the pedestrian in
front of the guy
very small in size who can actually like,
have people, virtual people running
around your table away.
You do other stuff or talking to them.
So another very classic example,
I would say, is a navigation
system, a system by Google, which
is a direct advancement over the
smartphone navigation.
And I think despite being a very
obvious example of when you
think what they are can do for you, it's
also a very powerful one.
So basically, it means like when you want
to go somewhere, you project like,
for example, a line in front of the
people that you have to follow
to reach the destination.
It's very easy and very understandable.
Currently, there
are mostly specialized systems that
focus on something like airport
navigation or car innovation,
for example.
Very few for general pedestrian
use, but I think that's
likely going to change and the future.
So the next one
also maybe a
little obvious, finding places of
interest based on selected preferences.
So your example would be like, where's
the next postbox?
Where's a good restaurant or bar?
So this is, of course, possible today
with smartphones as well.
But the big difference is
that you don't have any abstraction,
so you don't have to match the map of
what you're seeing. The West is booming
that that says on my smartphone,
you get the information place
exactly at the point of interest itself.
So that makes it a lot of easier
and useful.
For example, of course, you can also show
something like user reviews
or, for example, the menu
of the restaurant so that you can find
a suitable match.
What's also very, very useful
is something like air
translation, where
you like provide an instant translation
of a foreign language in place.
So, for example, you look at a sign in
Russian and you get the
content in English.
This is actually Google Translate,
which maybe some
people already have used.
Yeah, it's like you would want when
you have use, you would say, Well, what
else would be practical, for example, and
when you use it if a head mounted device,
it's even more practical because you
don't actually have to like point a
device so much, you just see the text
and the language you prefer.
So but besides translation,
you can also offer context information
as well, of course, because you can not
only show an example
the direction, but you can also showed a
distance to the object.
And it's also suitable for places like
museums, where
space for text is usually very limited,
but space and they are generally is
not.
Which brings us to the next application
case, which is cultural
heritage and tourism
and tourism. A nice paper
that gives a good example of that because
it it can make history somewhat
more experience of war.
So any of the ruins, for example, of a
Greek temple like here you can
get an impression of what a temple might
have looked like directly situated
on the actual ruins,
or when you have the fields of antique.
After running tracks, you may have
a of affluence and augmented reality
that gives you an impression of how these
facilities were actually loose, like the
people running around doing spots and
stuff like that. And I think this is
really powerful. Thank you.
You just get to see
what, what, what it was look like in the
past.
But another important aspect and
I think a very powerful one,
a Saudi army have,
you may have technology may
have the power to make technology more
accessible again.
So today's technology
grows more complex and it's more and
more connected.
So that's even for for expert.
It's sometimes hard to actually say, OK,
what state is the system currently?
And for layman person, it's
even harder.
So I can help make just
as hidden information visible and again,
in a way that's easy to understand.
So just to give you a little example,
which is not perfect, but hopefully
sufficient to transport the idea.
Imagine you have a simple router at home,
for example, we have some stateless
allergies, but when, for whatever reason,
you and that breaks down or stops
working? They don't have you that much
for for debugging the actual problem.
So to get more information, you
have to most likely access weapons.
A phase of your still can remember
the IP of your device.
Of course, you can do what we have done
here and put a little piece of paper
on the device itself.
But it's hardly a practical solution.
Yeah. So imagine with augmented reality,
you can just look at the router, do
a simple gesture and then get the
information you were interested in
directly superimposed on the physical
device itself.
So which can help you immediately
recognize what the problem might
be? So maybe you just forgot to turn on
DHC or something like that,
but we can expand that concept to
not only include a router, but also the
various devices connected to it.
So one of the predominant features of
wireless LAN is that there isn't a wire.
So it's hard to see which devices
are connected, where they are located
and what type is and so on.
So if they are, we can simply draw
virtual connections to make that
information is easily available to
the user. So I do something like this,
but you can also use it to make
errors more recognizable.
For example, one of the devices may be
not be able to resolve websites
because there is no DNS server
registered.
And then we can, of course, also display
additional information like the bandwidth
for device users.
And when we have an actual physical
medium, we could actually
use that for displaying information
like a graph of the
bandwidth over time.
And it's very easy to understand what is
displayed because it's directly
located at the medium itself.
Yes. So I hope this this example gives
you an impression of how air can can
really help with understanding
technology. Again, we might
be we might talk a little bit about
that later on.
But first, let's come to some technical
challenges.
So how does that actually work and
what has to change so that we can really
use it every day?
Now, the first one is tracking, which
is one of the main challenges
because I have two to locate the user
somehow.
I have to know where he or she is
and, well, what she's looking at, for
example.
So for general positioning, I could use
something like GPS, but precision
is, of course, a problem, and I can't
really use it indoors.
So we need additional track tracking
technology.
And there are many
different approaches, but the current
state of the art is more or less infrared
tracking the time of flight.
So that means infrared
light is emitted, which is reflected
by the environment, and the time between
sending and receiving the light and pulse
determines the distance to to an object.
And with that, I can create a depth model
of a room which is more or less
looks like this.
And then I can not only
tell what users right now,
but also when he or she is moving around.
And while this technology is far from
perfect, I think the current tracking
technology is quite robust and useful
in that regard.
What's also important?
This display and
rendering so there are many different
technologies for head mounted devices.
One of them is video see through a camera
films the environment, which is
done to get the virtual content
rendered onto a display
in front of the user's eye.
But latency is a very big problem in that
regard because you were very easily
get sick and
other procedural objects using polarized
glass where the our content is projected
onto, and there
are even small laser projectors
which project directly
into the user's eyes.
But for some reason, a user acceptance is
not very high,
but ideal.
The ideal display would not require
any external display at all, but you
would directly manipulate the optic nerve
which sends.
The messages to the brain.
Well, we don't have that right
now, so we have to make sure
that what we have and this is basically
see true optics, which is right now
like the current state of the art.
So let's let's look
at what the problems are in that regard.
One of the problems opacity,
because when I have
a solid object like a human, for
example, no background
should bleed for.
So currently, for for
for the commercial headsets, this is not
so bad, but really,
depending on the lighting conditions,
when you have a lot of sunlight, you
can't really see anything anymore.
But you know, there's too much room for
improvement in that regard.
What might be even more important is
the field of view of the AR headset
because like a human has roughly
two hundred and ten degrees field of
view.
And as you can see here, like the
Microsoft HoloLens, has like 30 degrees
and emitter two as like 90
degrees, most of which for my
experience at least are pretty blurry.
So yeah, that's not.
There's still this still has to get a lot
of better until we can really
use it.
Also, very important, as
you know, when the person
wearing an M.D.,
what what does she see?
Like, how can I recognize
what, what a person was looking at
and how can I get data on
on to recognize objects?
So due to performance requirements, most
of the processing, we're most likely not
happen on the
head mounted device, but it will
very likely take the form of some
web service or similar services,
which not only process a constant visual
input stream of the cameras of the HMD,
but also have to
have to provide the data sources for
the various objects.
For example, when I have touristic points
of interest, I need to get some
information on them.
So this requires a constant data stream
and a very good connectivity
to make it very useful, and
it also requires a lot of services
readily available to use
by the device.
So this is quite a big challenge.
Maybe the biggest of them all.
So to give you a little impression how
that could work based on
existing research, which is called a
reality based information retrieval.
So imagine you have an air HMD
that feeds the constant life image to a
server to recognize objects.
The user is currently looking at, for
example, vegetables at a market,
so to serve was able to classify those
images by comparing done with a couple
of saved reference images
and gives a sense
a list of recognized objects and the
confidence value back to the HMD
and then the HMD.
You can query a different service
to get some recommendations
for meals that I can cook with
the vegetable.
So when I explore a market
and you have your real display with you,
you could not only like it could not only
tell you what a particular vegetable is
in case you might not know, but it could
also tell you what to do with it,
which more or less could be quite useful.
What's also important, like
the way our glasses are to become
everyday objects, ergonomics
and esthetics are going to be important.
So you probably don't want to wear
something like like this right now.
So for the most part, it means shrinking
the glasses down to the size of current
normal glasses, which was a form factor
that's more or less already accepted
within our society.
And as you can see and the comparison,
we are not really close
to being at that point.
And uh,
one of the most important questions is
not only how to display our conduct,
but also how to interact with the
content, because otherwise it's a very
limited experience.
So our objects might appear
to be part of our environment.
We can't really touch them.
So I can I can't actually press of
a button.
And there is research concerned with
providing haptics as well.
For example, those ultra haptics,
which uses ultrasound
to create resistance and mid air.
So do they have an natural resistance
when when it touches somewhere, but it's
still in a very early state.
So currently, mostly gesture interfaces
are used where my fingers are tracked
into line of sight, together with the
hand gestures I use to trigger
into action speech speech
input is also a common.
Solution, but use in public
environments is limited,
and another possibility
is also to use additional devices like
specialized controllers
or, for example, the touchscreen of a
smartphone for interacting
with go to a contact.
Case tracking that means tracking to
users eyes will
most likely also play an important role.
But right now, there's pretty
much no perfect solution.
And also still, a lot of research happens
in this regard. So this is a very hot
research topic right now.
So let's come to a possible dangerous
and other issues. So all the things that
might not be so great about ubiquitous
augmented reality.
You're the first one.
Pretty obvious problem is
information overload, where too much
information leads to excessive
cognitive load
by users. So virtual content
has to be used sparsely to best
support the users.
And the only way to make sure users are
not over strange is to leave them in
control of what and how much is
displayed.
But users
might not always have the means to
control it, so especially one
third party services are involved.
We may see something like
inverse of advertised
invasive advertisements, sorry
and other unwanted content.
And since head mounted air is already
a personal experience, these
ads are most likely to be personalized
as well.
So this direct leads to the question
of privacy and data security
that will most likely be a constant
stream of the user's current position
and a live video feed to various
third party services.
So this raises the old question How
can I control what happens
with my data and who gets access to it?
And privacy, of course, is also a big
issue because there's hardly anything
more personal than a constant live
feed of what I'm seeing.
So even if I myself decide
to don't use any device as
long as everyone else does, it hardly
makes a difference.
So at the center, maybe it's really
the question of who controls the
actual heart on software platforms
so similar to smartphones as likely
for a few global operating corporations
to not only offer the devices,
but also provide corresponding software
ecosystems as well?
So we see that already with the
direction, the HoloLens, but Microsoft is
taking it, but
they are conscious of even more sensitive
data than current smartphones.
So, yeah, will
we be in control of our own devices?
Do the companies producing them have any
interest to keep us in control?
Because most likely their primary
motivation is to make money?
And will people even care
because they hardly seem to care
of smartphones right now?
So I think this is an important question
and another
possible application area for augmented
reality, which I haven't talked about
as military used.
So head of heads up display,
some have been used in the military
and airplanes, for example, for
over a decade, and also have
been several scientific papers evaluating
the use of augmented reality and military
use.
So it's not difficult to imagine our
systems like telling soldiers
where to go and maybe even who was friend
or foe.
Microsoft has recently made a contract
with the US military for over
four hundred eighty million US dollars
to evaluate the use of the
HoloLens on the battlefield,
and the goal is to
increase lethality, mobility
and situational awareness of soldiers
on the battlefield.
So
I don't really want to provide any
judgment on that, but it's best to not
have any illusions.
What does technology can and eventually
will be used for?
And it's probably not all going to be
unicorns and rainbows.
So let's keep that in mind.
Another interesting aspect is
how does massive use of augmented reality
actually changed how humans interact with
each other?
So, for example, when we can project
ourselves everywhere at any time,
how important will it be to meet in
person?
So to give and to give you an impression,
does the novel Naked Sun
written by Isaac Asimov in nineteen
fifty seven?
Well, it's common for people to
communicate with photorealistic holograms
and even being naked in front of each
other. There's no problem, but it's
extremely unpleasant for people to be
in the same room with a real person.
So I'm not going to say this is what is
likely to happen, but I think it's
an interesting aspect to think about as
there will be some social changes in.
Loft, which we don't know yet.
There's also leads to the question
how our own way of thinking
is influenced by the constant use of
augmented reality.
So for example, how does our
perception of locations and how locations
are connected change when
we are guided by our own navigation,
which in the worst case means
following a line until we reach our
destination?
There has been research showing that
extensive usage of troops
might lead to an atrophy of the
hippocampus, increasing
the risk of cognitive disease cognitive
diseases like Alzheimer's.
Later on in life.
So it's important to be aware
that there might be issues, and it's
important to do the actual research
to figure out what issues
might be.
And of course, maybe even the
ultimate question
what is reality like?
How does our understanding and perception
of reality itself change when we use
air?
This is more a metaphysical
question, but I think
it's an interesting one nonetheless.
It's not so much of a problem for
moderate use of augmented reality,
for example, to to annotate objects,
but more question for photorealistic
augmented reality, which can
alter the way the world looks to each
person individually.
So if my world
looks vastly different from
your world and when they are, as always,
active, what does reality
really mean in this regard?
And what role, if any,
does the undocumented world
play in the lives of people anymore?
So this might be something to think
about.
And with that, I conclude my talk.
So hopefully I could show you that
augmented reality could have
a benefit in our life, but
that are also some risks involved.
And I hope you find it somewhat
interesting.
And now we can have some questions.
Thank you.
You for your fantastic talk,
a good overview of whatever is possible.
Thanks. I see some people you're queuing
to ask you some questions.
Let's go to a number two here.
Lisa, thanks
for the talk.
The previous slide on the red and blue
pill.
Can you elaborate a little bit on how
you, as a researcher and user
of augmented reality, um,
eventually better understand reality.
So you mean when we use augmented
reality, that might lead to a little
to a better understanding of what
reality is or or what
do you mean?
Yes. Yes, that's the question.
Do you feel like you were not just using,
but also researching?
Because in order to, for example,
when you have this slide on how the 3-D
scan works, you
use it as, let's see a metaphor
or shortcut on how our own brain and
visual system works or.
Yes.
Well, like I said, it's a rather
metaphysical question, so
it's hard to really answer the question
right now. It's more like you could
guess what it might,
how it might change for people, what
the perception of reality.
How does that change?
But I don't I can't really answer that,
to be honest. Like it's it's more of an
open question for myself as well, because
like when I think about augmented reality
and if it eventually will
be used by everybody every day
like I can think of some, some
like dystopian sci fi scenarios
where everyone lives in this happy world,
which is totally fake,
and the real world basically looks
awful. But nobody actually noticed
that because everyone is like
caged in his own own happy place,
for example. So but I don't know if
that's going to happen.
It's just a possible danger that you
could think of. But this is probably
something that will not happen under next
20 to 30 years because we
simply don't have the technology to do
that right now.
So maybe more or less answers your
question, I hope.
Yeah. Next one.
And yeah, the reason
I was thinking along this line.
Okay.
Sorry.
So to get
widespread consumer adoption, we really
need the miniaturization of the hardware.
Google Glass got kind of laughed out of
the room a few years ago, so we need to
be better than that.
Yeah, but Google Glass wasn't really
augmented reality.
It was like more like a heads up display
because you had those tiny screen
and the back of like a button to write
up upper part of your
visual field of vision.
And it was like you could just display
a limited amount of information there,
like when you have real augmented
reality, is basically
having the whole space to put information
or
I mean, more like it's a stupid looking
thing to walk around on your head.
So we've got to look better than that
when we're
friends, right? But that's that's why I
think that we have to go to like
medical glasses all right now because
they are very accepted on society.
So someone wearing glasses doesn't
get looked at in a funny way because it's
pretty normal. So if augmented reality
headsets look more or less the same,
I think we're fine.
So, so the question is, what are the
technological problems that we have to
solve to get there in a consumer device?
Yeah, we have to actually militarize the
stuff. So I think the laser projectors
actually are an interesting solution
because they are rather small and you can
project out into the eyes of the user.
So if you get like this user bias
of figuring out how we can
actually convince people that
this is a good idea or not dangerous at
all, we can shrink it down even further.
And if we have the the whole processing,
not on the device itself, but on third
party like datacentres
or something like that, we can also
shrink that down.
So we have to actually only stream
the inputs to the server and we have
to stream like the image back to the
device that we can build pretty
small devices, sort of thing.
So that's what we have to figure out.
But yeah, it's
I think this is something that's actually
going to happen.
I don't know in the next five years or
something like that because this is
actually something that's worked on right
now. Microsoft actually is building the
next version of HoloLens, which should be
smaller, which would have more features
like eye tracking and stuff like that.
But we have to wait and see.
Basically, like this is this is also,
I think, an important thing.
The hardware involved is very complex,
so it's not something that one person
can do in his garage or something like
that. So you pretty much only have
the chance to have those big corporations
do this stuff and do the research because
it's so complex now
with a little bit of imagination, we see
someone stepping in there from the
internet to answer a question
holographic project that they're next to
me on stage. Can you
take
the internet as a
related question?
How long do you think?
Will it take
until everyone uses that meant to reflect
reality like mobile
phones today?
I would. It's I think that really depends
on on the use cases.
I think this is the most important thing
for acceptance.
You have to provide functionality
that actually benefits the way
people live their lives.
For example, the idea of translation,
I think, is a good example because it's
common for people to one day are
traveling, for example, to
to run to signs or something like that,
which they can't understand because it's
a foreign language.
And if you provide an augmented reality
solution for this particular problem,
people are going to use it because it's
practical, because it's useful.
And the more functionality it's the same
with smartphones will be, the more
functionality you provide that goes
in this direction, the easier
the adoption will be.
So yeah, that's basically
we have to find
use cases which are important to people.
And then the adoption will basically
happen.
That itself is probably really
critical most.
And number three, please, sir,
thank you for a talk.
When you introduce the platforms, what is
with Facebook, with the Oculus Rift?
Is it not OK?
It's not virtual reality?
Yeah, it's virtual reality.
It's not really augmented reality yet.
I was thinking about influencing
it, but I still don't have any idea
where they are going with this.
So they have bought this company.
They have invested in this technology.
But yeah, I don't I don't see
what they are going off this right now,
what what their goal is, actually.
So this is why I didn't include it
thinking they will come in your direction
anyhow. But number two, please.
First of all, thank you for the
informative talk.
And what do you think will change from
privacy policy with when
you have an active live feed of what
you're seeing with augmented reality?
Yeah, I think
this may be the cynical way
of looking at it, but I think people
will stop caring about that.
What somebody is going to happen, like we
like to the current generation is
concerned with privacy and we
feel like for
us it's it's a very bad idea
to actually have a constant live feed of
what we are seeing transmitted to
somewhere on the internet.
But like I
said, a lot of younger people who
smartphones, they don't think about
privacy, pretty much they think about
what this device can do for them.
And I think dislike more or less the
social change.
Maybe that will happen.
People will stop caring about it, as will
just be a normal thing
that that your your field of vision gets
transmitted to somewhere on the internet
and people will simply stop caring.
I think that is what's called.
This is what's going to happen.
Yeah.
Thank you.
Okay. The next step number two?
Thanks. Um,
I saw, uh,
recently there was a company that
announced some, uh,
some sites and they had
been conducting some transmission.
So they didn't really project something
into the retina.
So they went away
around all the projects and
all the complexity of making this huge,
bulky headset.
Um, do you think this is a viable
way to go forward?
You've focused mostly on
visual inputs, but maybe other sensors
are better suited to
making an entry into an
augmented reality.
What do you think about it?
It's an interesting point.
Yeah, I focus a lot on
on the visual side of things.
But the important thing, I guess,
with all this mixed reality and virtual
reality stuff is that it's not limited
to the visual.
So basically, it should be a
whole sensory
experience, so all your senses evolve.
So yeah, maybe that's a good idea to not
only focus on the visuals so
much, but also maybe on things like
audio. Like you said, Um,
I don't like.
It's really the same question of to use
cases when you when you figure out a very
good use case where like an audio
augmentation helps people in their
everyday life, I think people will start
to use it.
But the way the reason why
I focused mostly on the visual part is
because I think it's the most,
strongest sensory
experience people usually have when
they have eyesight, at least.
Um, and I think this
is most likely also to be like the
selling point of augmented reality
will most likely be the visual part.
Yeah.
Okay. Another one.
Number two.
Thanks for the talk.
You mentioned that
one of the ways you see the
miniaturization of these devices
evolving is by streaming data into the
cloud.
But we we've seen I mean, especially
with with smartphones these days
having, you know, the equivalent
computational power of, you know,
computers from a decade ago that it is
actually possible to do a lot of these,
you know, machine vision
tasks on on a smartphone.
And I think some manufacturers, you
know, like basically trying to get
your smartphone to be your primary
computer. So do you see do you see that
as a likely alternative?
Because, you know, obviously this comes
back to the privacy question, because if
you can keep things local, then
it also comes back to what what
the the producers of the devices
want, want, want you to
to actually do with the devices.
So.
Yep. Of course, if you have like
when you have militarization is powerful
enough to put it like a whole computer
into something like normal glasses.
You could do that and you don't have to
stream that much information.
But I guess what you you still have
to actually do all the stuff because
you are not alone.
And the world basically of augmented
reality is sort of everyone else is using
augmented reality. You need to have that
actual data from what the others are
doing, like, do you have to build, for
example, and just and just building?
I have to build a constant room model of
how this building looks like.
So everyone who is moving forward is
building will constantly scan the
environment to to build a different
model of the environment.
But you would you have to share
that information so that when I move
into this building for the first time, I
still have the whole environment mapped
out because someone else already walked
through it. So you still have to stream
all that and you still have
your stuff to share all those data.
So I think even if you increase the
processing power of the devices itself,
um, this is not going to change much.
Thanks.
Okay, sir.
OK.
My question is very much related
with all the big players designing the
device. It's still a closed world,
and I would have to imagine I would have
to stream a live feed
to some Microsoft Server or whatever.
Are there any efforts to keep
at least interfaces open, open,
if not the whole software open source?
So, for example, the CCC could put
up a server I trust and send my
my life into.
To get the system
open or not to you can actually change
the location where your information is
transmitted to.
Yeah, well,
at least I don't know of any open
hardware, open software projects
who try to do augmented reality right
now. Of course, there's research
we such as more or less open most of the
time, but research prototypes right
now, while they are good at what they do,
they are hardly like consumer products,
so you can really mass, produce and
distribute them to the people.
So, yeah, you probably could do it.
But I don't see currently, I don't see
any movement in this regard.
Yeah.
I shouldn't do that, but just for the
previous question, I would suggest you
speak up, please.
Oh, I shouldn't do that.
But to answer briefly the previous
question where they are in some
effort from Mozilla or trying to bring at
least the highest level of this tech
in a business fashion for augmented
reality? So, OK, something to check.
Um yeah. I was wondering, for example,
you showed on your research in your own
lab about information retrieval,
those examples that are unable
to distinguish between one object another
listener pulled in a pair or
a tomato works well.
But I'm wondering how scalable it is,
because when you get to, yeah, more
precise example.
Yeah, that's that's that's that's a good
point, because like what we were using
was an actual food database for that.
So it was very easy to classify like the
vegetables because they are food.
But if you have a database with
everything in it, and of course, it's a
problem because like classification will
get you some weird was also it
may be the vegetable would be recognized,
I don't know as lamp or
something like that.
Yeah, that's that's a problem.
But this is only a problem.
Like in this particular research case,
it was more like a proof of concept to
actually show, OK, how can we use
augmented reality in some more practical
everyday scenarios?
It wasn't really much focused on
to find a perfect technical solution
providing like declassification of the
images. This is also why we use an
existing service for that,
and we didn't build our own.
So we just use what?
What was available?
Yeah, OK.
Unless someone is beaming himself
up from the internet, then
we have all the questions here
answered. Thank you very, very much.
Yeah, thank you. Hope to see you soon.