Author: Kerr, Haydn

Integrated Design & Media

As a research-active program within NYU Tandon School of Engineering, Integrated Design and Media (IDM) faculty engage in collaborative research integrating digital media and society. Their projects span various domains, from reimagining theatrical performance through motion capture technology to pioneering uses of virtual/augmented reality for health and wellness. IDM involved in integrating STEAM learning into special needs education and developing citizen science tools empowering NYC residents to monitor and address noise pollution. Additionally, they contribute to NASA JPL's efforts in advancing user interfaces for space exploration and aid in the search and visualization of New York City's historical records.

Tandon IDM students are highly sought after by industry leaders, from established giants to dynamic startups. Their internship course offers the chance to gain valuable experience in your field of interest while earning credits toward graduation. Here are some of the companies where IDM students have interned or found employment:

- American Express
- Apple Corporate
- Etsy
- Instagram
- Google
- HTC China
- Major League Gaming
- New York Stock Exchange
- Sony Music Entertainment
- Verizon

The IDM curriculum blends project-based learning with the exploration of historical, legal, and philosophical dimensions of emerging media. They prioritize skill development applicable across a wide spectrum of media, fostering both individual and collaborative work. Guest lectures and conferences enrich the curriculum, providing students with direct access to leaders across business, advocacy, service, entertainment, and education sectors.

The program culminates in a thesis that integrates theory and practice, showcasing students' creative and technical proficiencies. This fusion of theory and practice defines the program's essence, reflecting the powerful convergence of emerging media, technology, creative mastery, and critical thinking.

 

SCI-Arc

Southern California Institute of Architecture

SCI-Arc (Southern California Institute of Architecture) is a well-known independent architecture school located in Los Angeles, California. It was founded in 1972 by a group of faculty and students who wanted to challenge the traditional architectural education model. SCI-Arc is known for its experimental approach to architecture, emphasizing innovative design, technology, and sustainability.

The school offers undergraduate and graduate programs in architecture, as well as postgraduate programs and research initiatives. SCI-Arc's curriculum often incorporates digital technologies and fabrication techniques into the design process, and it encourages students to explore unconventional ideas and forms.

SCI-Arc has gained recognition for its influential faculty, including architects like Frank Gehry, Thom Mayne, and Eric Owen Moss, who have taught or been associated with the school. The institute's public events, exhibitions, and lectures also contribute to its vibrant architectural community.

Overall, SCI-Arc is celebrated for its avant-garde approach to architectural education and its impact on the field of architecture globally.

Visit SCI-Arc

The Frank-Ratchye STUDIO

The Frank-Ratchye STUDIO for Creative Inquiry

The Frank-Ratchye STUDIO for Creative Inquiry stands as a beacon of innovation within Carnegie Mellon University's vibrant ecosystem. Established in 1989 by visionary artist Golan Levin, the STUDIO serves as a dynamic laboratory where creativity knows no bounds. With its ethos rooted in anti-disciplinary exploration, the STUDIO embraces collaboration across diverse fields, inviting artists, scientists, technologists, and thinkers from around the world to push the boundaries of what is possible.

At the heart of the STUDIO's mission is a commitment to atypical research—projects that defy traditional disciplinary boundaries and challenge conventional thinking. Here, experimentation reigns supreme, fueled by a spirit of curiosity and a relentless pursuit of the unconventional. Whether it's harnessing the power of computation to create interactive installations, exploring the intersection of robotics and art, or delving into the possibilities of emergent technologies, the STUDIO provides a fertile ground for groundbreaking exploration.

Through its Visiting Fellows program and a wide range of initiatives, the STUDIO fosters a culture of collaboration and exchange, where ideas flourish and evolve in unexpected ways. It serves as a catalyst for innovation, empowering individuals to push beyond their comfort zones and embrace the unknown. With its rich history of pioneering projects and its unwavering dedication to pushing the boundaries of creativity, the Frank-Ratchye STUDIO for Creative Inquiry continues to inspire and challenge the next generation of artists, researchers, and innovators.

Visit Studio

Introspection Game

The Introspection Game

by Power Nap

A poetic narrative generated by your own body, The Introspection Game sends you to a journey within, using Oculus Rift, a breath sensor, and a pulse sensor.

Participants are invited into an empty room one at time, wearing a breath sensor waistband, a pulse sensor, and an Oculus 3D head-mount. Once the Virtual Reality experience starts, the participant is temporarily teleported into a virtual space resembling the actual room he/she sits in.

A VR Headset sits in an empty room on a chair
A VR Headset sits in an empty room on a chair

Depending on the breathing pattern, the participant gradually descends upon a land surrounded by infinite ocean. As breaths become ocean waves, heart beats become both audible and visible, the participants gradually start to direct their attention inwards, becoming aware of less obvious body senses.

Visit Site

Power Nap Studio

Power Nap is a research oriented interactive art and design studio. It produces simulations, games, web and mobile experiences and interactive installations. Their work has shown in places like The Palace Museum of China, Cleveland Museum of Arts, MoMA, National Museum of China, Power Station of Arts and many more.

Power Nap Studio (ZZYW LLC) commits to research and produce Interactivity and Generativity. They work closely with clients to help them reach their goals through creativity. Immersive installations, simulations, mobile apps, video games are the common forms of Power Nap Studio outcome.

They are a small, agile, and interdisciplinary team comprised of designers, researchers, full-stack engineers, game developers, digital artists, sound engineers, filmmakers, writers, and electronic engineers. With nearly a decade long experience working in the field, Power Nap Studio is on a mission to produce digital interactivity that is meaningful and memorable.

Creative World Building

Creative World Making

ThingThingThing is a computational environment that facilitates the creation and interaction of digital entities. Developed through collaborative workshops, it allows participants to define entities within certain parameters. Once introduced into the system, these entities exist and interact autonomously, evolving without further direct human intervention.

The visual design of ThingThingThing is characterized by its abstract, geometric aesthetic. The creatures and the environment they inhabit are intentionally non-realistic, highlighting the project’s focus on systemic interactions rather than visual fidelity.

Live Servers

US Server | China Server

Technical realization

ThingThingThing utilizes Unity, a video game engine, as its frontend, and Github, an open-source code repository, as its backend on a technical level. The platform incorporates a web-based code editor, enabling users to establish interaction guidelines among creators. Whenever ThingThingThing is showcased, we collaborate with the exhibiting institution to organize a public collaborative world-building workshop, effectively bringing the artwork to life. During these workshops, we provide demonstrations of the interface and offer guidance to participants in crafting rule-based entities. At the workshop’s end, a unique simulation with its own narrative is created and made available online.

Workshop

ThingThingThing has been hosting a series of workshops with museums and art institutions around the world. The workshop enables everyone from students, artists, designers, architects and technologists to create their own programmed creatures with intelligence. Past collaborators include:

  • http://worldonawire.net/, curated by Rhizome of New Museum
  • NEW INC, New Museum, New York, NY
  • Power Station of Art, Shanghai, China
  • Macy Art Gallery, Teachers College, Columbia University, New York, NY
  • City University of New York (CUNY), New York, NY
  • Guangzhou Academy of Art (GAFA), Guangzhou, China
  • Creative Tech Week (CTW), New York, NY
  • Asia Art Archive in America (AAA-A), Brooklyn, NY
  • Power Station of Art (PSA), Shanghai, China.

Visit ThingThing

Strelka Institute for Media, Architecture and Design

Strelka Institute for Media, Architecture and Design(https://strelka.com/en/) is a non-profit international educational project, founded in 2009 and located in Moscow. Strelka incorporates an education programme on urbanism and urban development aimed at professionals with a higher education, a public summer programme, the Strelka Press publishing house, and KB Strelka, the consulting arm of the Institute. Strelka has been listed among the top-100 best architecture schools in 2014, according to Domus magazine.[1]

The Institute has been directed since 2013 by Varvara Melnikova.

Education programme

The Institute aims to educate the next generation of architects, designers and media professionals, enabling them to shape the 21st century world.[2] Each year, Strelka welcomes young professionals and gives them the opportunity to work together with experts in the fields of urbanism, architecture and communications from all over the world. During this nine-month post-graduate programme, the researchers explore the issues related to Russia’s urban development through a multidisciplinary method conducted in English. Experimental methods, a holistic approach to architecture, media and design, and an emphasis on research are the main characteristics of the programme. The prominent architect and architecture theorist, Rem Koolhaas (AMO/OMA), contributed to the designing of the Institute’s education programme.[3]

Since 2010, Yuri Grigoryan, architect and head of the Meganom architectural bureau], has served as director of the education programme.

Since 2012, the curriculum has been designed by two programming directors: Anastassia Smirnova – partner in the Rotterdam-based architecture and research bureau SVESMI, and David Erixon – founder of the Hyper Island school, and member of the Megafon board of directors.

The theme, programme structure and list of lecturers are updated every year. The 2013/14 programme includes a three-month introductory course composed of discussions, lectures and seminars, an urban development contest, work in one of four research studios, and a final exhibition of student projects.

Since 2016, Benjamin H. Bratton, design theorist and author of The Stack: On Software and Sovereignty, is programme director. The program theme, The New Normal, focuses on long-term urban futures in relation to technological, geographic and ecological complexities.

Some notable faculty at the Strelka Institute has been : Keller EasterlingBenjamin H. BrattonWiny MaasBrendan McGetrickAnastassia SmirnovaFelix MadrazoMETASITU (Eduardo Cassina and Liva Dudareva), Joseph Grima, Laura Baird, metahaven (Vinca Kruk and Daniel van der Velden), Reinier De GraafCarlo Ratti, and Rem Koolhaas.

Summer at Strelka

From the end of May until mid September, Strelka’s courtyard hosts a public programme that is open to all. Its programme includes: lectures by prominent architects, urbanists, designers, social activists and scholars; discussions on topical urban issues; workshops; film screenings; theatre performances; concerts and fairs.

Strelka Press

Strelka Press publishes books and essays on modern issues of architecture, design and urban development in both English and Russian. The publishing house releases both printed and digital books.[10] Strelka Press is based in London and Moscow. Senior editors of the publishing programme – Justin McGuirk and Andrey Kurilkin. Strelka Press has published books by Rem Koolhaas, Boris Groys, William Mitchell, Donald NormanKeller Easterling, Vladimir Paperny, and others.

Microsoft FUSE Lab

Microsoft’s Future Social Experiences(FUSE) Labs https://www.microsoft.com/en-us/research/ was started by Ray Ozzie and is run by Lili Cheng. The group focuses on real-time and media-rich experiences and is located in Bellevue, WA. It used to have offices in Cambridge, Massachusetts, and Cambridge, UK. A similar, earlier initiative was Microsoft Live Labs, a collaboration between Microsoft Research and MSN which ended in 2010.

Selected Projects

  • Microsoft Bot Framework & Conversational AI tools for developers.
  • Bing Twitter – Find out what topics are hottest on Twitter.
  • Docs.com – Discover, create and share Office docs with your Facebook friends
  • So.cl ([2]) – Social search service
  • Kodu Game Lab – Kodu Game Lab.

AI Now Institute

https://ainowinstitute.org/

Artificial Intelligence systems are being applied to many arenas of human life – across major sectors such as education, health care, criminal justice, housing, and employment – influencing significant decisions that impact individuals, populations, and national agendas.

But the vast majority of AI systems and related technologies are being put in place with minimal oversight, few accountability mechanisms, and little information about their broader implications. Those developing these systems are generally private companies, whose incentives do not always align with those of the populations on whom they are used, even as these systems are rapidly integrated into core social domains.

To ensure that all AI is sensitive and responsive to the people who bear the highest risk of bias, error, or exploitation, we will need to develop new ways to identify, understand, analyze, and ensure these systems –– and those developing and deploying them –– are accountable.

The AI Now Institute at NYU produces interdisciplinary research and public engagement on the social implications of artificial intelligence. We aim to:

  • Measure and understand the effects of AI in society.
  • Work with those directly impacted by the use of AI to shape standards and practices that mitigate harm and inform just AI deployment.
  • Help shape a rigorous and inclusive field focused on these issues.

Currently, our research focuses on four key domains: rights and liberties, labor and automation, bias and inclusion, and safety and critical infrastructure.

Founded in 2017, AI Now is housed at New York University’s Tandon School of Engineering, where it fosters vibrant intellectual engagement and collaboration across the University and beyond.

On The Measure of Intelligence

François Chollet is a French software engineer and artificial intelligence researcher currently working at Google. Chollet is the creator of the Keras deep-learning library, released in 2015, and a main contributor to the TensorFlow machine learning framework. His research focuses on computer vision, the application of machine learning to formal reasoning, abstraction, and how to achieve greater generality in artificial intelligence.

Chollet graduated with a Master of Engineering from the ENSTA Paris school in 2012 and started working at Google in 2015. His papers have been published at major conferences in the field, including the Conference on Computer Vision and Pattern Recognition (CVPR), the Conference on Neural Information Processing Systems (NeurIPS), the International Conference on Learning Representations (ICLR). He is the author of Xception: Deep Learning with Depthwise Separable Convolutions, which is among the top ten most cited papers in CVPR proceedings.

Chollet is the author of Deep Learning with Python, the co-author with Joseph J. Allaire of Deep Learning With R, and the creator of the Abstraction and Reasoning Corpus (ARC) Challenge

Publication

On the Measurement of Intelligence by François Chollet, a widely influential paper on prevailing models of computational learning and intelligence.

https://arxiv.org/pdf/1911.01547.pdf

To make deliberate progress towards more intelligent and more human-like artificial systems, we need to be following an appropriate feedback signal: we need to be able to define and evaluate intelligence in a way that enables comparisons between two systems, as well as comparisons with humans. Over the past hundred years, there has been an abundance of attempts to define and measure intelligence, across both the fields of psychology and AI. We summarize and critically assess these definitions and evaluation approaches, while making apparent the two historical conceptions of intelligence that have implicitly guided them. We note that in practice, the contemporary AI community still gravitates towards benchmarking intelligence by comparing the skill exhibited by AIs and humans at specific tasks such as board games and video games. We argue that solely measuring skill at any given task falls short of measuring intelligence, because skill is heavily modulated by prior knowledge and experience: unlimited priors or unlimited training data allow experimenters to “buy” arbitrary levels of skills for a system, in a way that masks the system’s own generalization power. We then articulate a new formal definition of intelligence based on Algorithmic Information Theory, describing intelligence as skill-acquisition efficiency and highlighting the concepts of scope, generalization difficulty, priors, and experience. Using this definition, we propose a set of guidelines for what a general AI benchmark should look like. Finally, we present a benchmark closely following these guidelines, the Abstraction and Reasoning Corpus (ARC), built upon an explicit set of priors designed to be as close as possible to innate human priors. We argue that ARC can be used to measure a human-like form of general fluid intelligence and that it enables fair general intelligence comparisons between AI systems and humans.

Podcast

François Chollet: Measures of Intelligence | Lex Fridman Podcast #120