Panopticon captures and examines video data

What did the team learn from recently capturing and examining video data of people in the lab playing Hotline Miami and Tekken 2?

We noted that Players exhibited a number of different behaviours based on what was happening in the game, including leaning forward when concentrating, and leaning back when tension was released. They tended to smile frequently – particularly when key game events occurred.

When playing the two-player fighting game Tekken 2, they displayed more facial expressions, and also interesting so when the single player recognised that someone was standing behind them!

These findings have led the team to consider what can be learnt about the experience of a game from a sequence of facial expressions pulled.

The Panopticon project has deployed a data capture set up at the National Videogame Arcade (NVA), aiming to capture sufficient video data of people playing, so that eMax can be trained to better recognise player behaviours and expressions automatically.

Photo by Element5 Digital from Pexels

If you’re visiting the NVA this week and want to participate in the Panopticon research project, or want to learn more, look out for us in the foyer!

 

Privacy, Law & Ethical Cross Cutting Theme update

In order to reflect on impacts for wider human values and embed safeguards into technologies being introduced by Services Campaign projects, Peter and Lachlan have been holding workshops with members of Memory Machine, In My Seat and Panopticon. These workshops used the Moral-IT and Legal –IT cards developed as part of the Towards Moral-IT and Legal-IT research ongoing at Horizon Digital Economy Research.

 

As mentioned in the previous blog, the Legal-IT cards translate a range of data related legal frameworks into card form, from the new EU General Data Protection Regulation 2016 and Network and Information Security Regulation 2016, to the earlier Cybercrime Convention 2001. The Moral-IT cards pose difficult ethical questions clustered under the themes of privacy, security, law and ethics, such as “IDENTITIES MANAGEMENT: does your technology enable users to hold and manage multiple identities?” or “SUSTAINABILITY AND eWASTE – What effects does your technology have on the environment from creation to destruction?”. These thought provoking questions help participants to think of unexpected implications of their technology.

During a workshop, participants were asked to reflect on the technology they were building and identify an overall ‘ethical risk’ that may impact the social desirability of the technology and for its users, particularly in relation to its use of personal data. This could include the identity risks from sensitive data being compromised by poor data security practices, or personal privacy harms for individuals’ private details being made visible to unexpected parties.   The groups used the Moral – IT and Legal-IT cards in a streamlined ethical impact assessment process to reflect on the overall risk, discuss and identify potential safeguards against these risks and also identify challenges of implementation of these safeguards. This activity resulted in a wide range of critical ethical questions being explored in relation to the technology with the cards and structure of the task enabling the participants to navigate the difficult ethical questions and link their technology to ethical and legal concerns more widely.

The cards were also used as part of workshop run by Lachlan and Martin Flintham, as part of their Digital Research funded project, to generate thought and encourage discussion about ethical implications of using the ‘Internet of Things’ in both the university and research environment.

We were pleased with how the participants took to the cards. They enjoyed using them and found them helpful in exploring and engaging with the ethical and legal issues in relation to their technology. They were received well, with their utility in structuring debate around complex topics. However, they also brought the wide range of issues to the fore. We are therefore encouraged that the cards have the potential to be a particularly useful tool in enabling technology developers and users to reflect on and navigate the complex ethics of their technology and produce more socially desirable technology as a result.

If you would like to know more, the Moral-IT and Legal-IT cards, and an outline of a way to use them, are now available to download online from ‘Experience Horizon’– a website which provides opportunities to try out some of the outputs from projects conducted at Horizon Digital Economy Research. If you do choose to investigate them further, we would really like to build up dialogue on who you are, how you are using the cards, why and any feedback you have on the tool/process. Please send these on to lachlan.urquhart@gmail.com.

Members of the Privacy, Law and Ethics Cross Cutting Theme are planning analysis and preparing a paper to submit to the Journal of Responsible Innovation, towards the end of the year.

Finally, following a presentation of the project, the Privacy, Law and Ethics Cross Cutting Theme project has been neatly summed up in a visual form as can be seen below – our thanks and acknowledgment to Rikki Marr of HAWK&MOUSE.

Written by: Lachlan Urquhart and Peter Craigon

Media and Memory

For the entirety of my adult life, I’ve been studying culture, based on the conviction that media products (however ‘mindless’ and ‘disposable’ many claim them to be) play an incredibly valuable role in all our lives. This is because they are bound up inextricably in our wider experiences of the world, of other people, and in our emotional reality.

It’s easy to identify moments from my own life that illustrate this point. Anaesthetising my teenage anxiety, while I waited to hear if I’d got my University place, by concentrating instead on the characters in a favourite book, Annie Proulx’s The Shipping News. Escaping to Middle Earth after my PhD examination by watching the Lord of the Rings Trilogy (extended editions) back-to-back. Euphorically dancing around the flat with my newborn daughter to Paolo Nutini’s Pencil Full of Lead singing “best of all, I got my baby”.

These formative experiences that stick in my memory are linked to and enriched by the media I consumed in those moments. And perhaps the stickiness of those memories is reinforced every time I encounter that content again. Certainly particular pieces of media trigger particular memories, and that nostalgia can be quite visceral. For example, Beyoncé’s Crazy in Love reimmerses me in another swelteringly hot summer – 2003 – when that hit single seemed to be continuously blasting through the open windows of every vehicle in London.

Lots of amazing, imaginative work is being done to take advantage of the propensity of media to ‘transport us’ in time and space, especially when memories and/or media become harder to access. The WAYBACK is a virtual reality film, funded by £35,000 pledged to a Kickstarter campaign, that recreates Coronation Day 1953 to help those living with Alzheimer’s and their carers recall the conversations, music and atmosphere of a street party. In situations when people’s cultural worlds become restricted, digital apps can also help maintain access to content and all its benefits. Armchair Gallery is developing an app to enable digital access to, and creative interaction with, artworks in collections for those who cannot physically visit them.

What excites me about the Memory Machine idea is imagining an in-home media repository cum player that could automatically connect personally important content (e.g. a pop song) with a period of time (e.g. when you added it to your music collection or listened to it a lot) and with other contemporaneous media (e.g. a film or advert of the time that featured the song). This has the potential to generate multi-layered, multimedia connections between individual and historical context. More than that, a system that could link one person’s cultural experiences with those of people around them would also transcend the artificial limitations we all apply to media on the basis of personal taste. I think it would be wonderful if my daughter could one day, as an adult, get a sense of the love and joy she brings me by being played a pop song from ‘before her time’.

Written by Dr Sarah Martindale