VR – Mechanical Sympathy

The Future Coming Into Focus

This isn’t the end, it’s just a stage of evolution (an annoying one).

We quickly get used to the idea that things will always stay the same. For a while there it looked like we’d all be on desktop computers, then laptops became more common and wireless internet matured in response to it. With stable wireless data, computers shrank again and changed form into smartphones. We’re still living in the age of handheld touchscreens but that too is beginning to change, and I’ve been lucky enough to get a glimpse of what’s coming next.

Last year we got some SHSM funding to explore virtual reality in our software engineering class. Students quickly integrated the HTC Vive we got into their software engineering process and were able to turn out 3d environments that they could then explore and perfect in much higher resolution within the immersive VR space. This year we’ve joined Foundry10, a VR research group, and are participating in research into how students react to and assimilate VR into their learning (it’s a powerful tool).

There are moments when technology pivots rather than simply modifying an existing process, and VR feels like one of those moments. The way we design interfaces and software as a whole will have to evolve to meet the demands of VR. Repetitive models and game-play might work on a screen (that kind of game-play itself evolved out of the even more passive watching of television), but it doesn’t work in VR. Immersion demands better everything.

If you think desktops take up a lot of room in a class, you ain’t seen nothing yet! Don’t cross the tape when someone is immersed in VR!

I’ve only had the Vive up and running in the classroom for a couple of months, but hundreds of people have passed through it, experiencing VR for the first time, and their response never gets old. The sense of immersion can be quite profound. As you move your head you remain in the digital space, you can’t see past the edges of a screen. At this point your mind does a lot of the heavy lifting, placing you within the elsewhere that you find yourself in a way that no window-like monitor ever could. Students coming out of VR often look like they are awakening from a dream.

VR is the whole shebang, you’re somewhere else. With headphones and goggles on you might forget you’re in a classroom at all (students have). The Vive is heavy, and wired to a powerful desktop PC, so there are limits (now being addressed), but as a first step into a new form of media immersion it raises a lot of interesting questions. A student who reads about D-day might have a minor emotional response to a well written piece on it. That same student watching the opening scenes in Saving Private Ryan will have a more visceral response.

A student in a well made VR simulation of D-day might end up with a virtual form of PTSD. That kind of VR experience doesn’t exist yet, though developers are hard at it and I give them only a couple of years until we’ve re-jigged software development to catch up with the demands of VR. When that happens we will be able to experience history (or fiction) first hand in a visceral way.

The kind of immersion VR offers raises a lot of questions, but it also creates some unique learning opportunities. If you need to grasp 3d scientific principles, like, say, how elements bond in chemistry, a VR headset would be invaluable. If you want to grasp geological concepts in a real world (ie: 3d) context, then a VR headset can place you inside an earthquake. It’s in the softer disciplines, like history or literature, that opinion can creep in. VR, with its sense of immersion and involuntary emotional response, would make a powerful tool for indoctrination.

Google Glass was a jab into a future we weren’t ready for. Future augmented reality lenses will seamlessly allow us to flit between the real and the digital.

I, for one, am just happy to see the end of a touchscreen in everyone’s hands period of distraction. In 20 years people looking at smartphones will be a gag everyone laughs at (can you believe we did that?).

Immersive screens don’t just mean alternate realities, they also mean augmented realities. When we aren’t experiencing deep, emotionally powerful virtual experiences, we will be accessing digital information without taking our eyes off the world around us. A digital revolution that is about enhancement and powerful immersion is going to be an educational treasure trove.

Architectural Responses to Virtual Mindspaces

I’ve been watching home reno shows over Alanna’s shoulder and noticed that in almost all cases everyone is knocking out walls and creating ‘open concept’ living spaces. I can’t help but think this is a side effect of personalized media.

Once you had a ‘TV room’ but it’s no longer needed. We still share media, but we don’t sit in a room staring at a cathode ray tube in groups. Without the need for shared broadcast media viewing spaces we open up our living spaces. Any time we want some privacy, we simply dive into a screen.

One of the unique features of digital technology is that it creates a self-directed, private virtual space for your interests. If you want to drop out of your surroundings you can do it in a moment on a smartphone or tablet. You can see people doing this in public spaces all the time, but it also works at home. We used to do this with watching TV, but the broadcast nature of that media meant not everyone watching wanted to. Even the ones who chose the show were passive consumers. In a world where some people wanted to watch TV and others wanted to read, we built up walls as the two aren’t mutually conducive. With personal devices and media you can have ten people all doing exactly what they want in media rich ways, all in the same space.

Digital media is much stickier and attention grabbing than broadcast media because it’s self directed and participatory instead of passive and consumptive. Digital immersion can happen in much busier places because we are active participants. It can also thrive in those places because digital media offers a richer variety of media. It effectively amalgamates all previous forms of media as well as spawning new ones.

Architecture reflects our communication habits: this space
is designed for the telling of information. Self directed
information gathering and collaboration are not what
this room is about.

Architecture adapts to changes in how we communicate. Classrooms in school are an architectural response to a model of teaching based on the verbal transmission of information. You couldn’t have twenty teachers all talking to their students in an open concept space, it wouldn’t work, so walls went up. Now that we’re evolving into personalized virtual spaces that offer access to information, communication and collaboration on a level unimaginable twenty years ago, what will physical classrooms evolve into? If you don’t have to wait for someone to verbally communicate information, what will schools look like?

We lament digital distraction as a scourge on society, but it is also an information rich immersive experience that offers us a new dimension of mental privacy. We are increasingly able to collaborate and communicate in complex, geographically irrelevant ways. Watching how architecture responds to this change in behaviour is one of the surest ways to see how influential this digital revolution has become.

Think Different

A grade 8 career fair last week had my senior computer
engineering students giving hundreds of grade 8s their
first glimpse of virtual reality.

Being one of the first to set up virtual reality in our area, I’ve had the pleasure of putting hundreds of students in it for the first time.

When they first find themselves in Google’s Tiltbrush, students tend to either scribble in 3d, write in space or, on occasion, try and build something intentionally three dimensional because they’re realize where they’re working. With a steady stream of students trying it for the first time on Thursday, this kept happening until something different occurred.

When you get a student who knows how to draw they tend to sketch quite effectively in the virtual space, though it tends to be based on 2d thinking (like they’re drawing on paper). We had a girl who had never tried VR before but obviously knew how to sketch enter the HTC Vive virtual space, but rather than working in 2d she immediately began sculpting 3d shapes.

Grade 8 Tilt Brush No Watermark by gking53 on Sketchfab

This immediately caught the eye of the gifted grade 12 I had operating the system. He got our attention and we watched her build out complex, identifiable 3d shapes. What made it more amazing was that she was doing this without moving her head. She was drawing in 3d but from a 2d perspective without even seeing what she was doing. Everyone around the VR sets stopped what they were doing to watch something special.

Afterwards her teacher came up to me and said she was ASD and not very verbal. I imagine the school system sees her as an expensive non-standard student but what we saw was a kind of genius. Our gifted VR operator certainly thought she was exceptional, and not in a bad way. Perhaps it requires an exceptional intelligence to recognize another exceptional intelligence.

***

POND Family day. One of the largest sources of data
on neuro-atypical children in the world and based in
Ontario! Our family is part of the DNA research and
our son volunteered to get fMRI’d as well.

On Saturday my family attended the POND Network’s family day at UofT. Having kids can often act as a kind of mirror, showing you more about yourself. Having an autistic son has made me more aware of how neuro-atypical I am (I’ve learned coping mechanisms, but they aren’t my natural state).

Where other people seem to require social interaction in order to be happy, I am very much an introvert. There are few cases where I find people who engage rather than drain me. I tend to go to ground after a week of teaching because I’m all peopled out.

The research presented by the Ontario Brain Institute was very interesting, and frustrating. Google has been doing fantastic open source computing work doing the heavy lifting with sequencing genome data for neuro-atypical brains, but the process is still in its infancy. We need much more data from more people and faster computers to narrow down the genomic complexities of neurological issues like ASD. The current thinking is that ASD isn’t caused by one or even a few genes, but by complex interactions between hundreds of them. Understanding this process will require many people providing data to a massive computing effort.

A moment occurred in the presentations when a parent asked how close they are to being able to give a biological rather than psychological diagnosis for ASD. He asked because students with a physical disability will have the earth moved to be accommodated, but students with psychological disabilities are generally warehoused and ignored, especially if they aren’t problematic. The example he gave was in education, where a school will spend tens of thousands of dollars on ramps and elevators for a student in a wheelchair to be able to access the building and integrate with their peers, but won’t offer a fraction of that to a student with a neurological issue. This got a round of applause from the audience.

The speaker had an even better answer. She said this is awkward because she’s a psychiatrist and the issue isn’t whether or not this is a physical or mental diagnosis but instead an indictment of the government and society in general’s stigmatization of mental illness. It doesn’t end at mental illness though. If you aren’t neurotypical, you aren’t accorded the same rights and access to care. The goal should be to enable all people to reach their potential, the type of diagnosis is irrelevant. This got a big round of applause too.

It also raised some hard questions around how we treat difference of thought. My son has a great deal of trouble organizing and completing linear tasks, but he can make diabolically difficult lateral connections. Having a conversation with him will force you to think laterally in ways you never had before (unless you’re too stupid or lazy to make the effort, in which case he sounds nonsensical). I’m a pretty good lateral thinker, but the connections he makes are astonishing, yet he’s considered substandard because he’s not at the level of his peers in a loud, socially driven classroom. He almost failed French because he wouldn’t speak it in front of the class – the kid with social anxiety and ASD wouldn’t perform like the other kids would. He’s sat in a desk in a row in a crowded, loud classroom with neurotypicals who thrive in this environment, and then he’s told he doesn’t stack up to them. Their accommodation is to give him access to a support room twice a week.
I often think that if the school system doesn’t destroy him, my son is going to grow up to do something exceptional precisely because he doesn’t think like everyone else.

If you look at a movie from the ’80s you’ll find that we’ve come a long way in how we treat gender and sexuality differences. If you watch a film from the 1950s you’ll see that we’ve come a long way in how we treat racial differences, but differences in how we think are still a place of stubborn prejudice.

Last year at a Head’s meeting I suggested that neuro-atypical people should be in teaching. They will cause it to change by offering different approaches that might improve the system as a whole. Our head of guidance thought this was ridiculous. Outliers shouldn’t be teaching or even in education. Education should be about moulding students to society’s expectations. I’ve never felt more disenfranchised by the education system than I did at that moment, and I’ve frequently felt disenfranchised by it both as a student and a teacher. I guess people will always find a systemic reason to identify and diminish another group of people for their own benefit.

When my son was first diagnosed with ASD I was hoping for a cure, now I believe that he isn’t thinking incorrectly, just not the same as most people, and that can offer us all a social advantage. It would be very shortsighted of us to try and stamp out that difference. His ability to make lateral connections of thought might one day allow him to solve a problem in a way that no one else could even conceive. This is assuming the education system doesn’t beat it out of him. Instead of exploring his differences of thought he’s repeatedly forced to perform neurotypical tasks in a substandard way and then rebuked for it. There is no point in his day where he’s allowed to explore his intelligence in the way that a gifted student is because his mode of thought is deemed foreign.

A good place to start would be to take away the distinction between physical and psychological diagnosis and treat all students to the same support. That might mean breaking down the systemic, grade based process of education by introducing purely individually driven learning goals and achievements. My son may not graduate on time because the system he is in seems designed specifically to not work with how he thinks, but he’ll get there eventually, and it would be nice if he wasn’t constantly being told he was a failure when he does. The chances of him going on to develop his unique talents in spite rather than because of his education would be much greater if he doesn’t feel like the rest of society thinks him a loss.

Education, like socio-economic status, is an invented sense of superiority. If you do well at something designed specifically for you, have you really done anything of value? If you struggle to do well in a system specifically designed to work against you, are you a failure? Neurotypicals might not be able to use their customized education to grant themselves social advantage any more, but can you imagine an education system in which every student was able to minimize their weaknesses while maximizing their strengths without some shortsighted idiot judging them? The human race would flourish in the diversity of ideas that would bloom from those graduates. We only have to get past our prejudices to get there.

***
Austim & History – where would we be without these people?
8 Inspiring People with ASD

Putting Students into VR for the first time shows many ommonalities, and exceptionalities…

ECOO16: Virtual Reality & The DIY School Computer Lab

A chance to see some of my favourite
people and study one of my favourite things!

ECOO 2016 is coming this week. As a chance to catch up with tech-interested teachers from across the province it’s unparalleled. It’s also a wonderful opportunity to see what those people are doing in their classrooms and get tangible information on how to work with technology in a classroom. I end up with a full brain and a great deal of enthusiasm after a few days at the annual ECOO conference.

I’m beginning the conference on Wednesday by demonstrating virtual reality to teachers from across the province at Brenda Sherry and Peter Skillen‘s Minds on Media. MoM (or in this case MEGA MoM) is a showcase of #edtech in action, and a must see event. As an emerging technology VR is going to have a profound influence on education in the future. Having a chance to give people a taste of that future is exciting. The only reason I’ve been able to explore VR as it emerges is because of the DIY lab I’m presenting on Friday.

I get to spend the Thursday soaking up the latest in technology and how it can amplify pedagogy. On Friday I’m presenting on why you should develop your own do it yourself school computer lab and how to do it.

I first presented the concept at ECOO four years ago. It’s taken me that long to develop the contacts and build a program that can do the idea justice. I’ve always felt that offering students turn-key no-responsibility educational technology was a disservice, now I’m able to demonstrate the benefits of a student-built computer technology lab and explain the process of putting one together. I realize I’m swimming upstream from the put-a-Chromebook-in-every-hand current school of thought, but that’s my way.

There are a couple of things that have changed over the years that have made this once impossible idea possible. Our board’s IT department underwent a major change in management and philosophy a few years ago. The old school was all about locking everything down and keeping it the same for ease of management. The new guard sees digital technology as a means of improving teaching rather than as an end in itself. They encourage and enable rather than complain and prevent.

The other major change was that my department got reintegrated into technology (it was formerly a computer science based mini-department of its own). Back in tech I was suddenly able to access specialist high skills major funding and support and found I was able to build the DIY concept – something I could never have done without our board’s tech-support funding model.

Thanks to that new, adaptive, open concept IT approach I’m able to access a BYOD wireless network with anything I want. I don’t have to teach students on locked down, board

imaged, out of date PCs. My computer engineering seniors helped me build what we now have and the results have been impressive. In addition to students in our little rural school suddenly winning Skills Ontario for information technology and networking, we’re also top ten in electronics and, best of all, the number of students we have successfully getting into high demand, high-tech post secondary programs is steadily rising.

When I thought it might be interesting for students to get their hands on emerging virtual reality hardware in the spring it was only a matter of finding the funding. We built the PC we needed to make it happen and then it did. We’ve had VR running in the lab for almost half a year now at a time when most people haven’t even tried it. Because we were doing it ourselves, what costs $5000 for people who need a turn key system cost us three thousand. We’re now producing those systems for other schools in our board.

A do it yourself lab is more work but it allows your students and you, the teacher, to author your own technology use. Until you’ve done it you can’t imagine how enabling this is. My students don’t complain about computers not working, they diagnose and repair them. My students don’t wonder what it’s like to run the latest software, they do it. Does everything work perfectly all the time? Of course not, but we are the ones who decide what to build and what software to use to get a job done, which allows us to understand not only what’s on stage but everything behind the curtains too.

If that grabs you as an interesting way to run a classroom, I‘m presenting at 2pm on Friday. If not, fear not, ECOO has hundreds of other presentations happening on everything from how to use Minecraft in your classroom to deep pedagogical talks on how to create a culture that effectively integrates technology into education.

Thursday’s keynote is Shelly Sanchez Terrell, a tech orientated teacher/author who offers a challenging look at how to tackle technology use in education. Friday’s keynote is the Jesse Brown (who I’m really looking forward to hearing), a software engineer and futurist who asks tough questions about just how disruptive technology may be to Canadian society.

If you’re at all interested in technology use in learning, you should get down to Niagara Falls this week and have a taste of ECOO. You’ll leave full of ideas and feel empowered and optimistic enough to try them. You’ll also find that you suddenly have a PLN of tech savvy people who can help, enable and encourage your exploration. I hope I can be one of them.

If you can’t make it, you can always watch it trend on Twitter:

#bit16 Tweets
note: to make a feed embed on twitter, go to settings-widget-create new and play with it, very easy!