Make-Your-Own-Device (M.Y.O.D) and upcycling approaches will be combined to attain our common goal.

Keywords: digital artefacts, raspberry PI zero, upcycling, make-your-own-device, creativity, touchless man-machine interaction, zone of proximal development, electronic ink, algorithmic drum circle

Contacts

Prof. Dr. Dr. Daniel Hromada


  • daniel at udk-berlin.de

  • Room 313, Medienhaus

  • Sprechstunden 12:30 - 13:30


Tutors & SHK


  • Astrid Kraniger a.kraniger@udk-berlin.de

  • Nikoloz Kapanadze nikoloz-kapanadze@medienhaus.udk-berlin.de

MODEA #2 Program

Date Topic
11.4 Introduction
18.4 Art & Artefacts
25.4 Tools & instruments
2.5 Material 
9.5 Modules and components
16.5 Making the Itty Bitty Beat Box
23.5 ECDF visit - Wilhelmstrasse 67
30.5 NO COURSE (Christihimmelfahrt)
6.6 Format 
13.6 Shell
20.6 Berlin Open Lab - Einstein Ufer UdK
27.6Optimizing & testing
4.7 Goal

Overall Entwurf

WiSe 2018/2019 Bootstrapping & exploring
SoSe 2019 Playing, specifying, defining
WiSe 2019/2020 E-paper
SoSe 2020 Machine learning, speech technologies, handwriting recognition
WiSe 2020/2021 Testing & optimizing
SoSe 2021 Deploying

WiSe 2021/2022
???

Main communication channel

https://kastalia.medienhaus.udk-berlin.de

MODEA #2 knot 4162 (i.e. https://kastalia.medienhaus.udk-berlin.de/4162 )

Validation

You'll get the signature only when actively participating on creating of an artefact which DOES something, e.g.


  • digital primer

  • music instrument for algorithmic drum circle

  • garden guardian

  • digital primer

  • light source

Main principles


  1. M.Y.O.D. :: Make Your Own device

  2. Upcycle !

  3. Explore the "adjacent possible".

  4. Uniqueness and not mass production.

MODEA #2 - Forum

This is the place where we should start communicating.

last_test

test2

test2

Hello world (correct)

heureka!

test

test

test4

test4

What to do ?

I am completely lost, what should I do ?

I  T E C

T U R E

P H O T

O G R A

P   H   Y

G R A P H I C D E S  I  G  N

Last works

Here are the

This project is a mereological suggestion based on the serial repetition of discrete parts that the architecture shapes the life of a decentralized and non-hierarchical society after a possible virus catastrophe.

I hiked many hiking trails in beautiful Norway in summer of 2017. I was overwhelmed by magical nature and created such a work.

Photography: Beauty of singularity in Norway

Design: Ortabahçe Magazine 

 # 

sarimakif  

test3

test3

test6

test6

test7

test5

test5

test6

test6

Airplane Tutorial

Hello

Hello world

test1

test

test2

Should save the creator information now.

Session 2 - Art & Artefact

Before doing the theory let's test our paper airplanes!

Artifact

artifact (plural artifacts)



  1. An object made or shaped by human hand.

  2. (archaeology) An object, such as a toolweapon or ornament, of archaeological or historical interest, especially such an object found at an archaeological excavation. 

    The dig produced many Roman artifacts.

  3. Something viewed as a product of human conception or agency rather than an inherent element. 

  4. structure or finding in an experiment or investigation that is not a true feature of the object under observation, but is a result of external action, the test arrangement, or an experimental error.

    The spot on his lung turned out to be an artifact of the X-ray process.


  5. (biology) A structure or appearance in protoplasm due to death, method of preparation of specimens, or the use of reagents, and not present during life.

  6. An object made or shaped by some agent or intelligence, not necessarily of direct human origin.

  7. (computing) A perceptible distortion that appears in a digital image, audio or video file as a result of applying a lossy compression algorithm.

Art

  1. (uncountable) The conscious production or arrangement of soundscoloursformsmovements, or other elements in a manner that affects the senses and emotions, usually specifically the production of the beautiful in a graphic or plastic medium
    There is a debate as to whether graffiti is art or vandalism.
  2. (countable) Skillful creative activity, usually with an aesthetic focus.
    She's mastered the art of programming.
  3. (uncountable) The study and the product of these processes.
    He's at university to study art.

Our definitions

Akif - used to be in purpose of creating/reaching Beauty

Anna - creative way of dealing with the world

Kohei - unconvenient and innovative

Ozcan - expression of thoughts/intuitions/desires

Handouts

Some articles related to our course.

Alan Kay - A personal computer for children of all ages

The KiddiComp concept, envisioned by Alan Kay in 1968 while a PhD candidate,and later developed and described as the Dynabook in his 1972 proposal "A personal computer for children of all ages", outlines the requirements for a conceptual portable educational device that would offer similar functionality to that now supplied via a laptop computer or (in some of its other incarnations) a tablet or slate computerwith the exception of the requirement for any Dynabook device offering near eternal battery life. Adults could also use a Dynabook, but the target audience was children.


Part of the motivation and funding for the Dynabook project came from the need for portable military maintenance, repair, and operations documentation. Eliminating the need to move large amounts of difficult-to-access paper in a dynamic military theatre provided significant US Department of Defense funding.


Though the hardware required to create a Dynabook is here today, Alan Kay still thinks the Dynabook hasn't been invented yet, because key software and educational curricula are missing.

Session 3 - Tools and Instruments

Nik - soldering iron
Daniel - screwdriver
Anna - pen
Kohei - measure
Akif - Swiss knife
Gero - pen

Session 4 - Material & Components

Let's start making it real.

Anna - Water
Akif - Leather, Neopren
Kohei - Metal (Aluminium)
Gero - Displays  
Daniel - paper
Nik - wood, paper, cardboard, fabric, tin

What is nice:
Ceramic, Epoxy, Stones, Marble, Resin, Fibers

Nobody mentioned:
Plastic, Concrete,  

Raspberry pi 

Der Raspberry Pi (engl. Aussprache: ˈɹɑːzbɹi 'paɪ) ist ein Einplatinencomputer, der von der britischen Raspberry Pi Foundationentwickelt wurde. Der Rechner enthält ein Ein-Chip-System von Broadcom mit einem ARM-Mikroprozessor, die Grundfläche der Platine entspricht etwa den Abmessungen einer Kreditkarte. Der Raspberry Pi kam Anfang 2012 auf den Markt; sein großer Markterfolg wird teils als Revival des bis dahin weitgehend bedeutungslos gewordenen Heimcomputers zum Programmieren und Experimentieren angesehen.[1] Der im Vergleich zu üblichen Personal Computern sehr einfach aufgebaute Rechner wurde von der Stiftung mit dem Ziel entwickelt, jungen Menschen den Erwerb von Programmier- und Hardware­kenntnissen zu erleichtern. Entsprechend niedrig wurde der Verkaufspreis angesetzt, der je nach Modell etwa 5 bis 35 USD beträgt.


Bis Ende 2017 wurden mehr als 17 Millionen Geräte verkauft.[2] Die Entwicklung des Raspberry Pi wurde mit mehreren Auszeichnungen bzw. Ehrungen bedacht. Es existiert ein großes Zubehör- und Softwareangebot für zahlreiche Anwendungsbereiche. Verbreitet ist beispielsweise die Verwendung als Mediacenter, da der Rechner Videodaten mit voller HD-Auflösung (1080p) dekodieren und über die HDMI-Schnittstelle ausgeben kann. Als Betriebssystem kommen vor allem angepasste Linux-Distributionen mit grafischer Benutzeroberfläche zum Einsatz; für das neueste Modell existiert auch Windows 10 in einer speziellen Internet-of-Things-Version ohne grafische Benutzeroberfläche. Der Startvorgang erfolgt gewöhnlich von einer wechselbaren SD-Speicherkarte als internes Boot-Medium. Bei der neueren Generation mit dem BCM2837 ist der Start auch von einem USB-Massenspeicher[3] oder Netzwerk[4]möglich. Eine native Schnittstelle für Festplattenlaufwerke ist nicht vorhanden, zusätzlicher Massenspeicher kann per USB-Schnittstelle angeschlossen werden, beispielsweise externe Festplatten bzw. SSDs oder USB-Speichersticks.

Connecting Pi Zero non-wireless to internet through intermediate Linux host

#!/bin/bash

ifconfig eno1 192.168.1.1

modprobe iptable_nat

echo 1 > /proc/sys/net/ipv4/ip_forward

iptables -t nat -A POSTROUTING -o wlp110s0 -j MASQUERADE

 

ifconfig enp0s20f0u1i1 192.168.23.1

iptables -t nat -A POSTROUTING -o enp0s20f0u2 -j MASQUERADE

iptables -A FORWARD -i eth0 -j ACCEPT

 

Pi Zero (no wireless) :: Setting up ethernet through usb

#initialize SD card with OS image
dd bs=4M if=2019-04-08-raspbian-stretch-lite.img of=/dev/mmcblk0 conv=fsync#eject and reinsert the SD card, then:


Step 3. Enable ssh


There was a security update to the Raspbian images. Now to enable ssh by default you have to do the following:


touch /Volumes/boot/ssh

This will write an empty file to the root of your Raspbian image. That will enable ssh on startup.


Step 4. Edit config.txt



  • In the root folder of the SD card, open config.txt(/Volumes/boot/config.txt) in a text editor

  • Append this line to the bottom of it:
    dtoverlay=dwc2


  • Save the file


Step 5. Edit cmdline.txt



  • In the root folder of the SD card, open cmdline.txt(/Volumes/boot/cmdline.txt) in a text editor

  • After rootwait, append this text leaving only one space between rootwait and the new text (otherwise it might not be parsed correctly):
    modules-load=dwc2,g_ether


  • If there was any text after the new text make sure that there is only one space between that text and the new text

  • Save the file


On a fresh image that has never been booted, you may see extra text after rootwait. But if you boot the pi from the disk at least once, that extra text may go away. That is why you must put the new text directly after rootwait - so it doesn't get accidentally deleted.

Step 6. Edit etc/network/interfaces


    Put something like 
      auto usb0
      iface usb0 inet static
      address 192.168.23.23
      netmask 255.255.255.0
      gateway 192.168.23.1

into /etc/network/interfaces of SD card's root partition.

Step 7. Boot the Pi Zero



  • Put the SD card into the Pi Zero

  • Plug a Micro-USB cable into the data/peripherals port (the one closest to the center of the board -- see picture above)

  • You do NOT need to plug in external power -- it will get it from your computer

  • Plug the other end into a USB port on your computer

  • Give the Pi Zero plenty of time to bootup (can take as much as 90 seconds -- or more

Hardware

                                               Devices           Office          Daniel    Nikoloz         Georgy    Students    
Pi Zero w                                                        1
Pi Zero                                       1
Raspi 3B+                                  2                    
Raspi 4B+                                  2                     2
Raspi 3A+                                  2                    
Respeaker 4mic                                               2
Respeaker 2mic                                                                     1                                ?
Phat Dat                                                         1
Speaker Phat                                                  1
Witty pi small    2                       1                     1
Witty pi big                                                      2
Inky Phat                                                        1
Grove Sound                                                   1
Grove Ultrasound                                             1
Grove Gesture                          9?
Raspicam                                 1                     1                    1
PITFT                                                              1
Resistive HDMI                         1
Raspi B+                                  1                     1
Phat Stack                               1                      1
Skywriter                                 1                     1
E-ink                                       1
Capacitive HDMI                                              2
Strompi                                                          1
The Slate                                1 MISSING
Raspberrypi Charger               1 MISSING
E-ink 6 inch                             4
E-ink 9 inch                             2                      1 +1 BROKEN
E-ink 4.3 UART                        2                                                                                        1

Session 5 :: Modules and components


  • What is modularity ?

  • What are modules ?

  • What are advantages of a modular system ?

  • What are disadvantages of a modular system ?

Interfaces


  • USB

  • HDMI

  • SPI

  • I2C

  • I2S

  • ... ?

Raspberry Pi Modules


  • HATs

  • pHATs

  • ...

fibel.digital :: Phase 0 :: Permutations

Prof. Dr. Daniel D. Hromada (ECDF Juniorprofessor for Digital Education) and Nikoloz Kapanadze (Kunst und Medien; Tutor)
 
We present multiple digital artefacts which emerged first stage of construction of a digital Primer. These include: touchscreen&HTML5-based prototype; e-ink screen (recently broken) with touchless sensing embedded in an upcycled old book; and OID-enriched paper page from the Primer "Wir Kinder vom Zirkus Palope". 
 
Aside this, we'll present some additional digital artefacts exploiting the modularity and extensibility of Raspberry Pi technology: Make Your Own Instrument kits, touchless PONG-game, speak2listen headphones and a touch-the-plant botanics education setup. 

 

Session 6 :: Format


  • In what domains of human activity do we speak about formats ?

  • In these disciplines, what kinds of formats do we know ?

  • Can we imagine other types of formats ? What are their advantages ? What are their disadvantages ?

  • What kinds of formats should we use ?

Paper format (series A, norm ISO 210)

Raspberry Pi 3A+

Image result for raspberry pi 3a+ drawing

Raspberry Pi Zero

Connecting a Bluetooth speaker to a Raspberry Pi Zero W running Raspian Stretch Lite


  1. sudo apt-get update && sudo apt-get dist-upgrade

  2. sudo apt-get install bluealsa

  3. sudo service bluealsa start

  4. Switch on your bluetooth device

  5. sudo bluetoothctl

  6. scan on

  7. pair XX:XX:XX:XX:XX:XX (replace the XXXXX with your device ID)

  8. trust XX:XX:XX:XX:XX:XX

  9. connect XX:XX:XX:XX:XX:XX

  10. exit

  11. aplay -D bluealsa:HCI=hci0,DEV=XX:XX:XX:XX:XX:XX,PROFILE=a2dp /usr/share/sounds/alsa/*

Respeaker 2 Bluetooth Alsa stream

arecord -Dac108 -f S32_LE -r 16000 -c 2 om.wav & sleep 1 ; aplay -c 2 -D bluealsa:HCI=hci0,DEV=FC:58:FA:BF:4E:0E,PROFILE=a2dp om.wav

 

AE49SOSERundgang R311 Artefact List




Artefacts presented at AE49SOSERundgang in R311 of UdK's Medienhaus

Credits: Nikoloz Kapanadze, Astrid Kraniger, Kohei Kimura, Akif Mehmet Sari, Ozcan Ertek, Anna Petzer

Coordinator: Prof. Dr. Dr. Daniel Devatman Hromada (ECDF Juniorprofessor for Digital Education)

sonic

(with Nikoloz Kapanadze)
sonic is an experiment on the topic of screenless computers. what would our smart devices look like, and act like if they were not bound by the rectangular standard of the screen. sonic is a pair of headtracking headphones powered by a Raspberry Pi. the headtracking information is used to control a supercollider program that performs binaural processing. in  other worrds the spatial positions of sound sources are  decoupled from the listeners frame of reference. so to say the sounds stay in place as the user changes the orientation of their head. its like VR but for your ears not your eyes.

the device can also record stereo audio using the two microphones mounted on the two earcups. having microphones so close to where one's ears would be gives the sound a lot of presence.  the componnts are mounted on a pair of headphones that i've had for around five years now and the whole assembly is modular, meaning that faulty components can be easily swapped out.

sonic uses twin i2s mems microphones( SPH0645) for audio recording and a accelerometer+gyroscope+magnetometer(LSM9DS1) ic for head-tracking.

developed by Nikoloz Kapanadze

CyberPlant 0

(with Ozcan Ertek)

cyberplant.py

#DDH, based on code from Adafruit industries, mrGPL

import os,glob

import pygame

DRUM_FOLDER = "KidsDay/drums2"

BANK = os.path.join(os.path.dirname(__file__), DRUM_FOLDER)

 

pygame.mixer.init(44100, -16, 1, 512)

pygame.mixer.set_num_channels(16)

 

files = glob.glob(os.path.join(BANK, "*.wav"))

files.sort()

 

samples = [pygame.mixer.Sound(f) for f in files]

 

 

import sys

import time

 

import Adafruit_MPR121.MPR121 as MPR121

print('Adafruit MPR121 Capacitive Touch Sensor Test')

 

# Create MPR121 instance.

cap = MPR121.MPR121()

 

if not cap.begin():

    print('Error initializing MPR121.  Check your wiring!')

    sys.exit(1)

 

def handle_hit(sensor_id):

    # event.channel is a zero based channel index for each pad

    # event.pad is the pad number from 1 to 8

    samples[sensor_id].play(loops=0)

    print("You hit pad {}, playing: {}".format(sensor_id,files[sensor_id]))

 

# Alternatively, specify a custom I2C address such as 0x5B (ADDR tied to 3.3V),

# 0x5C (ADDR tied to SDA), or 0x5D (ADDR tied to SCL).

#cap.begin(address=0x5B)

 

# Also you can specify an optional I2C bus with the bus keyword parameter.

#cap.begin(busnum=1)

 

# Main loop to print a message every time a pin is touched.

print('Press Ctrl-C to quit.')

last_touched = cap.touched()

while True:

    current_touched = cap.touched()

    # Check each pin's last and current state to see if it was pressed or released.

    for i in range(12):

        # Each pin is represented by a bit in the touched value.  A value of 1

        # means the pin is being touched, and 0 means it is not being touched.

        pin_bit = 1 << i

        # First check if transitioned from not touched to touched.

        if current_touched & pin_bit and not last_touched & pin_bit:

            print('{0} touched!'.format(i))

            handle_hit(i)

        # Next check if transitioned from touched to not touched.

        if not current_touched & pin_bit and last_touched & pin_bit:

            print('{0} released!'.format(i))

    # Update last state and wait a short period before repeating.

    last_touched = current_touched

    time.sleep(0.1)

 

Zeus erscheint Eva in Gestalt einer elliptischen Kurve

Touchless Ukulele

(with Anna Petzer)
This upcycled, portable, cable-less digital artefact combines touchless gesture-based recognition (Skywriter sensor)with a Raspberry pi 3a+ and integrated bluetooth loudspeaker.

TASK: Play with speed (time), position (space) and quality (suspense) of your hand movements. 

INSTRUCTION OF USE: You interact with the device by moving Your hand in front of the Skywriter sensor (above the sound hole of the instrument). Play the string to observe how the string vibration deforms the field measured by Skywriter. 

Carboard Primer

(with Astrid Kraniger)
First functional cardboard-embedded artefact combining touchless gesture-based recognition (Seeed Grove Gesture Recognition Sensor PAJ7620U2)with an e-ink controlled by IT8591 board and some ANSI C coded  for the purpose of diagnostics of difficulties in acquisition of learning and writing (Leserechtschreibschwierigkeiten - LRS).

Diagnostics focuses on so-called "Rapid Automatized Naming" which is considered to be one among the most important LRS-predictors.

Visual content ("animal pictures") scanned from reedition of Lumen Picturae et Delineationis (Amsterdam, 1660, BE310).

Instead of a signature, this artefact contains a four-leaf clover (harvested in July) attached by duct-tape above the e-ink screen. Bottom of the cardboard shell is photovoltaic, making it possible to transform PappeFibel 0 or one of its derivatives into an energy-autarch ("eutark"; Hromada, 2019, AE49) digital education artefact.

TASK: Identify mismatch between visual and textual modality. 

INSTRUCTION OF USE: You interact with the device by moving Your hand in front of the Gesture Recognition Sensor (to the right from e-ink screen). Movement along vertical axis (up/down) maps to boolean (true/false, JA/NEIN) answers. Movement along horizontal axis (left/right) is used to browse the content. Rotation is used to switch between "learning" and "testing" mode.

CAVEAT: When changing modes of operation, new data has to be loaded into the buffer of the e-ink controller. This takes few seconds. Be patient. Breathe.

Bowl

(with Kohei Kimura)
Skywriter + raspberry Pi zero + 3W shaker + tibetian singing bowl + physical setup by Kohei Kimura 

In a Praise Of Void

The stable "wall" is the very basis of land creatures and thus by "having responsive space rather than the linear presentation of the wall," the body is suddenly made aware of the situation it is in.

With the current housing crises and the reduction of the living space per person, the effect of the occupancy and void becomes more valuable day by day. But this concept, void, which can only be defined by its contrast: fullness, and which can change the perception of everyday spaces we are accustomed like a room, is not easily readable. This situation removes the concept from our daily practices and traps it in the dusty pages of abstract architectural books.

The project based on an example ordinary wall of living space offers a responsive space that will bring up a concept of void on the agenda in order to challenge perceptions of living space and physical context.

This exploration simulates an extreme architecture of responsive variable structure by suggesting a technological infrastructure with hypothetical material.

The narrative analyzes the benefits and limitations of these projects but avoids explaining the necessity and result of living in such a space. It remains speculative, is leaving the questions open for the next phases.

Avatar 0

(with Chris Schmidts, Akif Sari)
Head-shaped tridecahedral (13-plane) wooden shell crafted by Chris Schmidts and filled with Raspberry pi 3A+, Seeed Respeaker (4mic circular array, ac108 converter; APA102 12-LED RGB pixel ring) enriched with UltraSonic Ranger System sending UDP packets to "active wall" installation by architecture student Akif Sari.

6-inch e-ink displays page 4. of McGuffey's Ecclectic Primer, a well-known Fibel of Victorian Era. Display is currently powered off and as such has zero carbon dioxide trace (hallo Gretha!) while still teaching Alphabet. To see more interactive e-ink setup please check the artefact CardboardFibel0.

mutantC

https://mutantc.gitlab.io/index.html

Over the years we’ve seen the Raspberry Pi crammed into almost any piece of hardware you can think of. Frankly, seeing what kind of unusual consumer gadget you can shoehorn a Pi into has become something of a meme in our circles. But the thing we see considerably less of are custom designed practical enclosures which actually play to the Pi’s strengths. Which is a shame, because as the MutantC created by [rahmanshaber] shows, there’s some incredible untapped potential there.

The MutantC features a QWERTY keyboard and sliding display, and seems more than a little inspired by early smartphone designs. You know, how they were before Apple came in and managed to convince every other manufacturer that there was no future for mobile devices with hardware keyboards. Unfortunately, hacking sessions will need to remain tethered as there’s currently no battery in the device. Though this is something [rahmanshaber] says he’s actively working on.

The custom PCB in the MutantC will work with either the Pi Zero or the full size variant, but [rahmanshaber] warns that the latest and greatest Pi 4 isn’t supported due to concerns about overheating. Beyond the Pi the parts list is pretty short, and mainly boils down to the 3D printed enclosure and the components required for the QWERTY board:  43 tactile switches and a SparkFun Pro Micro. Everything is open source, so you can have your own boards run off, print your case, and you’ll be well on the way to reliving those two-way pager glory days.

We’re excited to see where such a well documented open source project like MutantC goes from here. While the lack of an internal battery might be a show stopper for some applications, we think the overall form factor here is fantastic. Combined with the knowledge [Brian Benchoff] collected in his quest to perfect the small-scale keyboard, you’d have something very close to the mythical mobile Linux device that hackers have been dreaming of.


Keyboards:

https://hackaday.io/project/158454-mini-piqwerty-usb-keyboard

https://hackaday.com/2019/04/23/reaction-video-build-your-own-custom-fortnite-controller-for-a-raspberry-pi/