The Blank Canvas is a platform for VR science storytelling. Exponential potential for learning on an infinite, immersive virtual canvas. Our mission was to make science media cool. This experience was chosen as the first batch put (for free) on the Steam 360 Player, alongside Hunger Games, Lego Batman, Halo...see it here.
Shown at the Cannes Film Festival 2017, premiered at Stockholm's VR Sci Fest. Powered by Unity for modeling, Houdini for fluid sim, Maya, and two other storyteller engineers Boo Aguilar and Peehalho Magalhaes.
An ongoing project combining VR, EEG and biofeedback technologies for detection of racially biased fear responses and nudges away from them. Won the MIT Future of People Hackathon 12.3.16, where I was grateful to be named a Luminary. Shown at Notre Dame Peace Conference, now housed in MIT's Center for Civic Media and Harvard Kennedy School's Future Society. Working with the wonderful Marie-Therese Png alongside Esam Goodarzy, Ryan Lee, Genevieve Hume (Harvard GSE, MIT IDM, MIT Brain and Cognitive Sciences).
A performance piece in which neuroscience and art converge to transform the art experience. We skip the unpredictability of the aesthetics, the art piece, and instead induce the art experience directly with emotional induction techniques from science. How much do we want to be quantified selves, measured and measuring? And how reducible are we, after all, to measurements?
Piece commissioned by the Boston MFA. A bunch of friends made it with me: Nicole, Ani, Xin, Gershon, Rebecca, Akito, Sands, and Rainar, from across myriad MIT laboratories.
Brain science has given us tools to see ourselves in ways previously impossible! This is an image of changing patterns in neuronal network connectivity as mindfulness increases. Looking at this image entails, in a real way, a completely new kind of human cognition: an objective take on our subjective self-reflection on experience, cognizing on metacognition. An expanded view of science means an expanded view of ourselves.
Giving presence to artificial intelligence. Lucky to have been involved in bringing this ambitious project to life and to be working now on new projects with this lovely team. Boo Aguilar and Adam Roth led dev for a Cognitive Computing VR experience for Hacking Arts 2016. Check out the video here!
This experience was picked 2nd for the Vision Summit Technical Achievement Award, as a runner up to Ghostbuster's The Void.
Ongoing work linking body-mind representations for anchoring in schizophrenic patients. A bluetooth wearable which converts audio into vibrations for patients to feel external voices and easily distinguish internal hallucinatory voices. Similar work shows results eliminating hallucinations, currently pending publication. Advice and collaboration from many friends: Ishaan Grover, Rébecca Kleinberger, Mina Khan, Kana Okano, Clemens Bauer.
Science and art intersect allowing new, material inquiries into our subconscious cognition. How can we think about things we know but do now know we know?
This project creates a space where people can encounter their subconscious through physical, digital, and environmental sleight of hand.
An ongoing project that began in my Human Machine Symbiosis class with Prof. Pattie Maes. Every night, each of us loses a whole stage of sleep worth of creative thought--the hypnogagic Stage 1 dreamstate. We're using EEG sleep spindle and K-complex detection and feedback to keep users suspended in hypnagogia while recording new insights. Read more and see a prototype here. Working with Ishaan Grover and Sophia Yang! Check out how artists have harnessed this state in the past.
I led curation for the launch of the Algorithmic Justice League at the Boston Museum of Fine Arts, fabricating hardware, writing and editing content, designing signage and layout, helping to build the beginning of Joy Buolamwini's amazing movement for diverse and inclusive technology coming from the MIT Media Lab's Center for Civic Media.
How does pattern recognition create bias, in humans and machines? How can we fight it? Read more here
I'm lucky to organize the Consciousness Hacking community here in Cambridge. We gather together as a community of makers building and exploring new science/tech in service of human flourishing. Our latest event, at Harvard Divinity School, brought together brain scientists with religious thinkers from around Boston to discuss meditation. Crimson article here and HDS article here, little tv segment here.
I'm the Creative Director of MIT Hacking Arts, a collective of engineers , entrepreneurs and techies who create projects and spaces for tech and art to intersect. What happens when a VR engineer and an architect get to create with a ballerina and light artist for 24 hours?
Proud to have built a hackathon, museum installations and partnerships alongside Georgiana Vancea with Autodesk, Adobe, Unity, the MFA, Formlabs, Boston Cyberarts, RISD, Le Lab and many more. Written up in TechCrunch and The Atlantic
A connection between an open-source, 3D printed Brain Computer Interface and the amazing ArtMatr painting robot from Tal Achituv/Ben Tritt. In this video, Owen Trueblood and I are sending motor cortex electrical signals from to the printer. Turning that readout into interesting printer movement means thinking paintings. Then why not paint our dreams? Footage from Hacking Arts Hackathon @ MIT
A splitter plays braille alphabet simultaneously via in-ear-audio and vibration attached to the stomach. Passive haptic learning and multimodal input. What can we teach our body? What are the memory and chunking limits of passive learning experiences? Tools for cognitive exploration, and experimental learning paradigms.
How does bodily communication connect us when words cannot? Gershon Dublon and I built two benches that translate audible frequencies into inaudible ones, delivered through powerful pistons along bench braces. At the Boston MFA, we took over Gallery 175 for 6 hours of vibrations--infrasound crying, telling inaudible secrets, heartbeats and more, for an entirely embodied experience. Project realized with help from Nicole L'Huillier, Rebecca Kleinberger, Ani Liu, Xin Liu and Juan Necochea. Why? More Here!
MAI has asked me to lead the partnership between the performance art institute and Google's Cultural Institute.
Performance art inspires presence and empathy in person, how can we bring that online? Digital empathy, technology for presence, new media possibilities rooted in art.
Teamed up with old Brazilian friends--the amazing performance artist Tathy Yazigi and designer Elisa Gijsen--for a performative, interactive SXSW workshop on neuroscientific and artistic approaches to augmenting creativity. I focused on embodied cognition, transient hypofrontality and self-regulation.
A linguistics-inspired interface for extracting the most representative phrases from iconic political speeches and mixing them together. Tech reveals commonalities between heroes and devils we might otherwise ignore. Language without syntax is off-putting, and empathy is easier achieved when we are off-balance together. A tool for collective understanding.
I'm part of an ongoing project at MIT's Gabrieli Lab studying the brain mechanisms of mindfulness, meditation and mind-wandering. I run functional connectivity data acquisition and behavioral data analytics. Super cool because there are immediate, broad implications for education and wellness. Meditation is cheap, effective, easy to distribute, proven...and poorly understood.
Alongside Art Basel, and sharing the stage with amazing people like Mayor Levine and Google X's Jack Hidary, I was invited to speak about unseen connections in neuroscience--specifically between brains, cities and art.
I combined science of meditation and memory to assess the claim that meditation "expands your consciousness." Measuring pre-post on the often overlooked 'Iconic Memory', storing contents of consciousness, which grew as a result of 10-day meditation as compared to a language training control group ( t(26)= 3.389, p=.002.). Science of the Self, objective and subjective at once. Contact for details.
I was hired by IPG to select and program a bot for a public futuristic breakfast-making experience. I'm here with the Rethink Robotics Baxter bot programming a proxy for cereal stirring. What makes a machine comfortable to interact with? What public art experiences can we create with humanoid machines?
I'm an Officer of VR@MIT, an organization that has done some wild things already in its 1 year of existence--like created a VR Makerspace at MIT's Martin Trust, run the first VR Course at MIT, and led the largest VR Hackathon (Reality, Virtually) ever put on...
The champions of this group are Jacob Loewenstein, Eswar Anand, Judith Amores and Natalie Pitcher
I'm lucky enough to work on acquisition and analytics of fMRI and DTI at MIT's Martinos Center for BioMedical Imaging on questions as distinct as dyslexia and mindfulness. Experimental Design is a UI/UX problem tweaking subject experience for the extraction of certain sorts of truth. Especially important for trying to quantify the qualitative, the science of the self. Check out this study, the 1st I got to work on in my lab, chasing down sense of self in the brain!
Ants, hive minds and eusociality. After a talk on similarities between ants, brains and cities at SIME/Art Basel I did this project on a Scanning Electron Microscope, putting an ultra thin coating of gold on ants. The resulting images flip scale in wonderful ways. An ant eye feels like a whole world. And maybe it is.
What does an individual in a collective body think, feel, see? How similar are ants to neurons in their particle/collective relationship? I want to investigate ants, and then build mechanized proxies!
I had the honor of helping structure the 1st Harvard Food Law Student Leadership Summit, "among the Summit's chief architects and advocates since its earliest days, bringing it from idea to reality" (Professor Broad-Lieb). This one Summit had 50-law schools, opening Harvard Law wide and bringing new young voices into the national conversation on food justice. I managed design for the summit--graphic, content, environmental--including this logo done in tandem with the wonderful Meaghan Lueck. Design has much to contribute to movement-making.
Along with Caty Rezendes I organize the 250 person Cambridge chapter of Consciousness Hacking, a 10,000 member global group started by Mikey Siegel out of the MIT Media Lab focused on building and hacking persuasive wellness technology. See here.
The Gallant Lab's Semantic Map, showing whole-brain co-activation of words, is a neural thesaurus that I see as a first-ever map of George Lakoff's Metaphors We Live By. Jack Gallant was kind enough to share his data matrixes, and I'm experimenting with VR/AR experiences writing poetry based on this map of subjective-objective perceptual language. Writing words with knowledge of the other words they activate! An objective subjective. A biological thesaurus.
An exhibit for the Boston Museum of Fine Arts, an exploration of the uncanny. A cat café populated by robotic cats and waitresses from the future. A menu full of options like switches, pacer motors and programmable voice boxes. Make your own monster. See here.
Alginate life casting split glass, seamed, reconstructed piece by piece with gold leaf. Light leaks through it.
High speed documentation of contact between bodies. A russian grandmother pulls my cheeks, a pat on the back. Small beauties that slip by unnoticed every day.
I was lucky enough to encounter Keepon and My Keepon through neuroscience research into childhood development. These bots are designed for non-linguistic empathetic connection, often with kids who have language difficulties, like autistic children.
I brought this bot, amongst empathic tech I had constructed, to a curated conversation about different ways people can connect with one another, presented at the Boston MFA. Bodies are often especially honest communicators. Tech can show us this.
I initiated and led a collaboration between MIT and the Boston MFA from September-December 2016 on bringing science inspired art and tech projects to the MFA's first ever overnights.
7,000 visitors each night encountered Markov chains doing similarity comparisons between opposed politicians, robotic cats, racially biased algorithms, and much more.
I got to participate in the curation process and speak alongside Marina Abramovic, the 'grandmother of performance art', at her amazing art/science interactive Terra Comunal in Lino Bo Bardi's SESC Pompeia, São Paolo.
We spoke about how neuroscience and performance art intersect in their understanding of presence. The 400,000 person huge, free, open exhibit initiated one of the more diverse conversations I've had the pleasure of participating in. See Terra Comunal for more.
Working on building up the process for scanning scientists into virtual environments so we can scale up our Virtual Reality science education program. Hoping to excite, educate, inspire, allow more playful storytelling by scientists and more engaged learning experiences for viewers.
My interest in applied neuroscience led me to applied behavioral economics at city-scale. I joined Providence, RI, as the capital city's City Fellow, to understand the inner workings of municipalities. I focused on Smart Cities--possibilities for inclusive, data-driven policy making.
My time there has been hugely educational. See Providence Talks, PlayCorps, OpenPVD, and What Works Cities for examples of ongoing work. See the Providence Innovation and Design District to understand my excitement.
Part of the Providence Smart Cities platform is building up infrastructure for open governance with open data. Work on this platform began under Mayor Taveras, and continues today under Mayor Elorza.
Part of my job in Providence has been helping to prioritize sensor acquisition and implementation, always with a mind to how city data is handled when received. I think this open data platform is a pretty good start!
An electrified flowerbed I made for groups making music together. Play, performance, education. Makey Makey, wildflowers and Scratch.
Invited to Brazil to participate alongside Marina Abramovic in an 'Inspiration at the Intersection' focused workshop. Where STEAM (science, tech, engineering, art, mathematics) can meet and make each discipline more than it was before. Where these vocabularies diverge, and work needs to be done to reunite ways of seeing our world.
A lecture I was invited to give to the arts and tech community in São Paolo. Wonderful city, wonderful people at Flagcx and IBM. See here!
Tired of Hackathons being distanced from the body, distanced from play, I created the Hackython. Half Hackysack, half Hackathon. An exercise in extended educational silliness. Drone workshops and dancing with robots alongside Religious Studies professors discussing the ethics of circular discussions and hackysack circles. Just love.
I'm so grateful my interests in Science, Tech, and Art/Design lead me into such varied worlds and I recognize how lucky I am. I take seriously my role as a connector between people I encounter, and as much as I have to power to do so, I put synergistic people in touch. I've been mapping my 'connector' work over the past year. We'll all be better off with more openness.
See an interactive map here and give me a shout if you're looking for a new community or set of partners!
Experimental Darkroom Photography--Solarization, Composite Negs. An animal scratches its back.