Campus Innovation

Order of the day

Introduction & Bildung (Öko)digitale

Example ("digital school") & definition ("carbon neutrality")

die Energiebilanz

Rhytmic devices and services

Eutark devices and buildings

Raising awareness

Administrative Post Scriptum

Einatmen 1 :: Bildung Biodigitale

Bildung BioDigitale = humanism + digitalisation + ecology

Goal 1: Establish a bridge between organic (carbon-governed) and digital (silicon-governed) realms

Goal 0: Survive

Method: Education

A Digital School ?

desktop PCs,notebooks, tablets, smartphones, raspberry PIs & IoT devices, GPUs, beamers, displays, audio (amplifiers, active speakers, broadcasting systems), interactive whiteboards, fiber optic adapters, routers, switches, hubs, WLAN access points, antenas, printers (including plotters, 3D printers, lasercutters, CNC cutters etc.), augmented / virtual reality environments, surveillence & security setups, different kinds of "smart" sensors and controllers, power supply and power management units, TPUs, ASICs, servers, automats, robots etc.

Carbon-Neutrality

* https://dictionary.cambridge.org/dictionary/english/carbon-neutral

If a person, organization, event, etc. is carbon-neutral, it does things such as planting trees to reduce carbon dioxide by the same amount as it produces it.

die Energiebilanz :: operational costs

Das Ergebnis dieser Bilanz:

das System ist aus der Balanz.

wasted energy                                                   (a "multiple-with-time" formula)

Rhytmic devices & services

a circadian device                                                                   (a "digital Primer" example)

das Rezept

Raspberry Pi Zero + wittyPi + optimized OS + e-ink + "small-data" + solar

Eutark devices

"We define an energy-autark (or simply "eutark") device as a device able to produce energy necessary for its own operation."

A little note

Once loaded, the content displayed by an e-paper (e-ink) device can transfer information (or even teach) without consuming any energy.

Raising awareness

Eutark buildings and CO2-neutral campus

trees instead of lawns

plants, plants, plants

photovoltaics

heat the building with machine-generated excess heat

heat pumps, heat pumps, heat pumps

algae photobioreactors

carbon-sequestrating paints ...

P.S. Verwaltung

"Repair cafes", "Nachhaltigkeitbureau", "Energieberatung" u.s.w., das alles ist schön und nett und besser als nichts.

Aber der Klimanotstand ist schon da.

Was wird also dringend gebraucht sind nicht nur Berater(innen) sondern Inspektor(innen), Beauftragte und Referate mit Befugnis zum Handeln.

*

* *

Auf jedem Campus und in jeder Schule. ASAP.

herzlichen Dank für Ihre Aufmerksamkeit

OEB.global 2019

Order of the day

Bildung Digitale

Reform Pedagogy

MYOD

some examples

further advices

All which shall be presented is work-in-progress.

Bildung Digitale

Bildung Digitale = digitalisation + education + humanism

Reform Pedagogy

Freinet Pedagogy

"Through Life - for Life - through Work."

learning by doing work or providing services

usefulness-oriented activity

"Expression libre"

printing press plays important role / pupils create their own tangible media

more "hands-on" and anti-authoritarian than Waldorf or Montessori

Montessori Pedagogy

"Help me to do it myself !"

four domains of focus: Practical Life, Sensing, Language and Math

free choice from didactic instruments pre-selected by the Teacher

importance of classrom's spatial setup

more "cognitive" (e.g. Polarization of attention) than Steiner or Freinet

Waldorf Pedagogy

"Thinking / Feeling / Willing"

artistic / creative practice integral part of an epoch-based curriculum

older students or parents create instruments for younger kids

preference for natural (wood, clay, wool) materials

more φαντασία -oriented than Montessori or Freinet

Commonalities among Waldorf / Montessori / Freinet

"Head. Heart. Hand"

child-oriented and NOT market-oriented attitude ("We are teachers and not businessmen.")

integrative, holistic and synthetic

increased amount of manual, haptic or corporal activity

higher amount of parent and pupil participation

egalitarian interaction between classes and ages

own instruments and media

MYOD

Make Your Own Device (MYOD) is a didactic approach aiming to increase student's digital literacy by inviting (him|her) to MAKE an own digital artefact addressing a concrete individual, social, scientific or artistic Goal.

MYOD procedure (v0.01)

• Teacher introduces main concepts (Computer, Input, Output, Sensor, Motor, Display, Interaction etc.)


• Student / Pupil defines a goal (WHY?), a recipient of the final result (FOR WHOM?) and a vision (WHAT?)


• Teacher provides hardware & software components and material which are necessary to achieve the goal


• Students / Pupil works on attainment of the goal, assisted by other students and supervised by the Teacher

Our inventory

HW :: Raspberry Pis (A+, B+, Zeros, Compute modules), Arduinos, Touchless interaction sensors (Skywriter theremin, PAJ7620U2), e-ink displays

OS :: Linux (collaborative coding with terminal + ssh + screen -x )

Code :: Python, C++ (mostly copy & paste code reuse, of course), HTML

Making :: cardboard, old music instruments, old books, wood, acryl ...

Some examples

Avatar 0

sonic

Carboard Primer

Bowl

Touchless Ukulele

CyberPlant 0

Further advices

Recommendations

recommended age: secondary level (e.g. 10 years and older)

recommended facilitator / apprentice ratio: 1 facilitator per 5-7 apprentices

recommended Goal: create media / instruments / tools which can be used by primary level pupils

Ideal output

Older students : education-about-digital
↓
Younger students : education-with-digital

Major problem

Thanks for Your attention

Post Scriptum

MY*D

MYFD = make Your friend's device

MYSD = make Your sibling's device

MYCD = make Your child's device

Symposium-reihe "Über Lehre 0"

• 2019 Ethik und Mathematik 
• 2020 Musik
• 2021 Bild
• 2022 Tanz
• 2023 Sprache

HEIBRiDS AE50

From text to categories and beyond:   You don’t need deep learning to do it

Program

Who am I

What is this lecture NOT about

What is this lecture about

Introductory concept (Cognitive plausibility, Distributional hypothesis)

Random projection, Random indexing, Reflective random indexing

Light Stochastic Binarization

Evolutionary Localization of Semantic Attractors

Grammar Induction

Who am I ?

@d.hromada:medienhaus.udk-berlin.de (Matrix) / daniel@udk-berlin.de or better (E-mail)

Digital Education juniorprofessor (Berlin University of the Arts / Einstein Center Digital Future)

degrees in Humanities (Charles University in Prague), Linguistics (Universite de Nice Sophia-Antipolis), Human and artificial cognition (Ecole Pratique des Hautes Etudes); doctorates in psychology (Universite Paris 8) and cybernetics (Slovak University of Technology)

author of > 20 articles (& one 423-page monography) few scholars care about (in domains spanning data science , developmental psycholinguistics, computational rhetorics, machine morality etc.)

installed first BBB system (bbb.medienhaus.udk-berlin.de); assisted Viktor & Ronald to launch the 2nd (bbb.udk-berlin.de) and doing my best to convince UdK's critical mass to switch to BBB in the long run

What is this lecture NOT about ?

connectionist (neural network-based) models of machine learning

computer vision, speech recognition, physical systems, big data

regression (e.g. estimating quantities)

What is this lecture about ?

multi-class classification

vector space architectures

random projection & "the scandinavian school"

evolutionary computation

induction of concepts and rules from text

cognitively plausible computational models of categorization and grammatical inference

geometrization of the concept of "category" and "category prototype"

Introductory concepts

Cognitive plausibility

Distributional Hypothesis

"a word is characterized by the company it keeps" (Harris, 1954, Distributional Structure)

"the more semantically similar two words are, the more distributionally similar they will be in turn, and thus the more that they will tend to occur in similar linguistic contexts" (https://en.wikipedia.org/wiki/Distributional_semantics)

"For a corpus linguist, distributional hypothesis means, mutatis mutandi, the same thing as Hebb's law for a neuroscientist." (Prolegomena, p.157)

"

Problem: construction of N x N co-occurence matrices from documents with N tokens yields very sparse matrices

Random projection

beautiful method of dimensionality reduction

based on lemma Johnson-Lindenstrauss (1984, Extensions to Lipshitz mapping into Hilbert space)

"if we project points in a vector space into a randomly selected subspace of sufficiently high dimensionality, the distances between the points are approximately preserved" (Sahlgren, 2005, An introduction to Random Indexing)

Take home

(Reflective) Random Indexing is a very elegant approach how You can make Your entities-to-be-classified and their features inhabit the same vector space (VS)of fairly low dimensionality (N<500)

You can characterize Your classes/categories either as spheres within such VS; or as constellations of category prototypes "which are as close as possible to all true members of the category and as far away as possible from all false members"

search for most accurate categories can be optimized by means of evolutionary computation

Some references to end with ...

Cohen & Widdows (2010) Reflective Random Indexing and indirect inference: A scalable method for discovery of implicit connections

"the Scandinavian school" (Kohonen, Kanerva, Kahlgren, Sahlgren)

Gardenfors (2000) Conceptual spaces

Hromada (2019) Prolegomena Paedagogica :: https://wizzion.com/PP.pdf

daniel@udk-berlin.de

Thanks for Your attention

Digital Sandpits 

What is Medienhaus/ NOT ?

Medienhaus/ is not, oh-my-God-yet-another-platform-to-log-in

it is not Zoom, it is not Microsoft Teams, it is not Dropbox and it is not Slack

it is not a commercial product

What is Medienhaus/ ?

Medienhaus is nice neoclassicist building in Berlin-Schöneberg which hosts all hardware and software components of the Medienhaus/ project

Medienhaus/ an Open-Source project named after the building in which it emerged

complex & fine-tuned alloy of state-of-the-art open-source projects like JITSI (videoconferencing), riot.im (messaging, file exchange & secure 1-to-1 communcation), streaming & web (HTML, X3D) technologies

a network of systems federating content by means of the Matrix protocol (e.g. io.medienhaus.udk-berlin.de federating with oxford.medienhaus.udk-berlin.de)

a bridge

little bit of Glasperlenspiel ...

...and little bit of 3D

1st onboarding on Monday 18th May 11:00 CET / 10:00 BST at #welcome:oxford.medienhaus.udk-berlin.de

Münster Workshop

Bauanleitung einer digitalen Fibel VON und FÜR ihre Schüler.

Digital Primer Construction Manual

Part 0.0 :: Who we are

Daniel Hromada :: ddh :: Juniorprof. for Digital Education at Einstein Center Digital Future / Berlin University of the Arts; doctorates in cybernetics (Slovak University of Technology) and cognitive psychology (Universite Paris 8)

Paul Seidler :: pls :: Artist & Programmer; wissenschaftliche Mitarbeiter; plsdlr.net

Nikoloz Kapanadze :: nik :: Electrical & Computer Engineering; studentische Hilfskraft; Kunst und Medien Absolvent candidate

open-source advocates

Part 0.1 :: Aim of digitale Fibel / Digital-Primer project

create a new kind of digital, safe & secure, portable and sustainable Bildungsinstrument fulfilling the "23 Properties specification"

help elementary school pupils to learn how to read, write, solve basic arithmetic problems and develop algorithmic thinking

develop a new type of diagnostic & therapeutic tool for children & adults with Leserechtschreibschwächen

expand a community around an open-source & open- hardware, DIY, Make-Your-(School's|Class|Child's|Own)-Device project

Specification :: Properties 1-4

Book-like or embooked

Moderately voluminous

Modular

Unique and adaptable

Prototype 1.0

Part 2 :: Hardware

Raspberry Pi Zero WH

6 inch (800x600px) e-ink displays with IT8951 controller with <1s full refresh rate

ReSpeaker dual-microphone expansion board with WM8960 stereo audio codec and Grove I2C ports

Grove I2C gesture recognition sensor (PAJ7620U2) for touchless interaction (seeed)

wittyPi3 for clock, voltage \& current sensing and implementation of circadian boot and shutdown sequences

battery, micro USB charging circuit (TP4056), solar panel

Nik's introduction

Part 3 :: Apps

Apps :: narrator.py

Apps :: lesson.py

Apps :: BDLP.py

Apps :: record.py

Part 4 :: Future projections

alias to 9. Münsteraner Workshop zur Schulinformatik presentation

Please click here to access the presentation "Make Your Pupil’s Embooked, Voluminous, Modular and Unique Digital Primer"

Some Links & references

After smartphone :: Towards a new digital Education Artefact :: https://doi.org/10.3917/enf2.193.0345

This presentation :: https://kastalia.medienhaus.udk-berlin.de/7980

This video :: https://fibel.digital/videos/muenster2020.mp4

https://github.com/hromi/Digital-Primer

https://bildung.digital.udk-berlin.de

AG Schulung

BBB :: Introduction

open-source on-line learning system

https://bbb.medienhaus.udk-berlin.de // https://udk.baumhaus.digital // https://medienhaus.udk-berlin.de/learn

all a teacher normally needs to create "teaching rooms" and not much more

BBB: synchronous audiovideo streams, screencasting, chat, break-out rooms, (anonymous) EtherPad, status icons, surveys, presentation board (PDF, many image formats), YouTube/vimeo/dailymotion video integration, shared canvas/whiteboard, telephone call-in

Greenlight: user & room administration interface/database, possibility to have unregistered 1-time users, mail-based registered users and ...

... use OASE LDAP accounts !

BBB September

cca 350 users with account (unknown number of users without an account); cca 570 rooms

integrated with LDAP (You can log in with OASE account)

until now just positive feedback from people using it

survived with dignity 1st major crashtest: Medienhaus/ Oxford Bergfest

comparable / better ? experience for groups with ~30 participants to Zoom / Webex

recommended from privacy / Datenschutz point of view

2nd BBB installation (ZIV/CTC, Studium Generale) still not real (no DVOrg hosting yet) ;(

break out rooms / UdK2030

possible to integrate medienhaus BBB integrated matrix rooms as so-called "widgets"

BBB :: Zustand

cca 300 users with account (unknown number of users without an accountwith 500 rooms)

survived with dignity 1st major crashtest: Medienhaus/Oxford Bergfest

until now just positive feedback from people using it

comparable / better ? experience for groups with ~30 participants to Zoom / Webex

June is the 1st month when BBB is used without "TerminPlaner"

BBB :: Datenschutz

Last week, we discovered that BBB stores "raw" data even when nobody clicked on "start recording".

Immediately afterwards "one click" recording functionality was completely deactivated.

All "raw" data removed from the server.

Since this moment "raw" folder is empty.

BBB :: Future

centralisation or decentralisation ?

personal opinion: decentralisation on the per-building/faculty + CTC + ZIW level makes most sense

advantages of decentralisation: load distribution, lower latency, possibility to address different Datenschutz scenarios

KKWV udk2030.digital goes 3D Minipräsentation

der Kontext

Dokumentation für dritte Zukunftstag der UdK (6.11.2020) (auch Hochschultag oder UdK2030 genannt)

erste digitale Aufgabe - udk2030.digital

erste UdK2030 unter SARS-CoV-2

Angela Merkel: "Teil-Lockdown ab 4.11"

Unseres Anliegen

unseres Vorhaben

manch ein physischer Raum ?

Medienhaus Serverraum

(Haus|Wohnung|Balkon)besuch beim ZUV; UdK2030-OrgaTeam Mitglieder; Workshopleiter etc.

Kochsküche ?

Looking Glass ?

Wer ?

prof. Dr. Daniel D. Hromada :: Fakultät Gestaltung / Institut für Zeitbasierte Medien :: Einstein Center Digital Future :: Digitale Bildung :: in 2020 für Dokumentation des Zukunftstag zuständig

erste KKWV Antrag (Unterstützt von UdK2030 community)

Studierende

• Dirk Erdmann - Visuelle Kommunikation - New Media (Sauter) Klasse
• Ozcan Ertek - Kunst und Medien - Generative Kunst (deCampo) Klasse
• Astrid Kraniger - Alumni Kunst und Medien

UdKs erste holo-Chronik (kleinformat)

Danke für Ihre Zeit

OEB.global 2020 / AE50

1.

Once upon a time ...

0. Berlin University of the Arts

also known as UdK (Univesität der Künste)

origins of UdK's precursor institutions (e.g. Brandenburg-Prussian Academy of Arts) date back to 17th century

UdK received the title of University in 2001

largest art school in Europe (cca 3500 students)

four Faculties specialising in fine arts, architecture, media and design, music and the performing arts

decentralized (cca 15 buildings) all around Berlin

pre-CoVid Digitialisation @ UdK

Mail (POP3)

typo3 website ( www.udk-berlin.de )

Moodle

Mailinglists

NextCloud (hosted by TU)

many small little services and systems (Wordpress, Agenda etc.)

few made-in-UdK projects like Kastalia KMS (in which this presentation is created)

CoVid-19

2.

 Dramatis Personae

1.

 Administration

12.3.2020 20:21 / AE50031220:21 / 10 days before lockdown

Betreff: Online Lehre Treffen

Liebe Kolleginnen und Kollegen,

In Anbetracht einer nicht möglichen Präsenzlehre aufgrund

von COVID - 19 gilt es Möglichkeiten der kunstgerechten Online Lehre

zu untersuchen. Ich lade Sie und interessierte Personen

ein, mit mir die didaktischen, technischen und disziplinarischen 

Bedingungen zu untersuchen. Treff morgen 1500 Uhr @Einsteinufer R510.

Ich freue mich auf ein fachliches Treffen unter diesen besonderen 

Umständen. 

Grüße 

Erster Vizepräsident

0.

  "Education" Industry

Microsoft, Google, Cisco, Adobe, Zoom, LinkedIn, Udemy, edX, Udacity, Coursera, Squirrel AI, Skillshare, Notion, Facebook, Apple You name it ...

within the rest of this narrative, we shall denote these corporations as well as other associated entities (NSA, Five Eyes etc.) with a label "hydra with many heads"

2.

 AG Online Lehre

  *   Themenfeld 1-Musik und Klang (Fakultät3,4, ZIW, JIB),
  *   Themenfeld 2-Raum und Material (Fakultät 1,2)
  *   Themenfeld 3- Zeit und Körper (Fakultät 1,4, HZT),
  *   Themenfeld 4-hybride Techniken (alle Fakultäten)
  *   Themenfeld 5-Text und Sprache (alle Fakultäten)
  *   Themenfeld 6- Infrastruktur und Kommunikation
  *   Themenfeld 7-Schulung

3.

UdK's digital changemakers

1.

 The Plot

0.

 pre-semestral Lockdown

1.

 Summer Semester 2020

2.

Semester Evaluation

4.

 Climax ?

Medienhaus/ goes into production

winter semester starts

...meanwhile among Berlin's mighty ones ...

 udk2030.digital

5.

 Vision

6.

 Moral of the story

open-source is the way to go

listening to young people (e.g. students) and supporting them is more optimal long-term strategy than outsourcing digitalisation of your institution to profit-seeking private sector

Matrix protocol will soon start to glue Academia together

Thank You

DigEd AE50 SumUp Gathering

P.S. AE50

What didn't work ?

until now, the Fibel project did not help any single child

a year ago we had two enclosed prototypes (1 x 1-screen, 1 x 2.5 screen) now we have 1 enclosed and 2 opened ones

only 1 publication with very low impact

inconsistency with our own proposals (please re-read the Fibel papers)

very little colaboration with other Einstein Center colleagues

What did not work for You ? (Hibiki: problems with Witty; Dorothea: bugs in textrec;  Paul: IT8951 buffer; )

AE50 Team update

January: Georgy, Astrid, Nikoloz, Daniel

December: Paul, Hibiki, Dorothea, Fred, Daniel (+ collateral support from Nikoloz, Astrid, Ozcan)

Plan for AE51

Before March: submission of the DFG DHAR project

Before April: extension of the Patent to EPO

Before June: at least 3 papers and 1 bigger publication (UdK Covid Compendium)

Before July: 8 functional enclosed Fibel prototypes out of which 4 can be charged with solar

Before September: teacher.solar set ready to be deployed

Until end of next year: at least 2 additional papers and 12 additional prototypes

Anything else which should not be forgotten ?

What worked ?

Patentanmeldung (only German patentamt, though)

Extension of audiotext corpus (thanks everybody!)

BigBlueButton (and open-source in general) recognized by UdK as important tool

transition from mail-based to Matrix-based communication

Fibel code refactored to more solid architecture

DigEd JuniorProfessorship extended (there are counter-forces, though...)

teacher.solar && Sfifterverband Senior Fellowship

first UdKs holograms, udk2030 ...

we are alive, healthy and everybody is paid for his effort

What worked for You ? (Dorothea: Kastalia; Paul: TFlite on armv6; Fred: jupyter-lab; )

BigBlueButton Schooling (Level B1)

Introduction

BBB goes UdK (a little narrative)

in 2011 informed about BBB's existence by my Paris PhD. supervisor

raised little interest back then because BBB's use of "Flash" technology

February 2020 :: realization that BBB moved from Flash to HTML5

March 2020 :: instance 0 deployed at bbb.medienhaus.udk-berlin.de

May 2020 :: bbb.medienhaus modified to support UdK's LDAP

June 2020 :: digital sandpits @ bbb.medienhaus

October 2020 :: another instance (bbb.udk-berlin.de) administered by Viktor and Ronald joins the club

Autumn 2020 :: interconnection with other BBB-positive high education institutions (Beuth, Humboldt)

November 2020 :: udk2030.digital

December 2020 :: meetings.udk-berlin.de :: a stable, UdK-wide solution

from 2021 onwards :: the ball is in Your playground

BBB competence reference framework

1. Level A1 : user (browser, link, room, echo test, webcamera, chat, shared notes, status icons)
2. Level A2 : presenter (screen-casting, shared whiteboard, presentation upload, video sharing)
3. Level B1 : moderator
4. Level B2 : room operator (Greenlight)
5. Level C1: system administrator
6. Level C2: cluster artifex

auto-catalytic system: one should be able to teach levels below (at B1, You should be able to teach A2 etc.)

ACHTUNG, Baustelle!

Epilogue

Level B1

Advantages of BBB 

local (lower latency, smaller CO2 trace, more robust to unpredictable changes)

open-source ("security by transparence", community driven, integratable in other hybrid projects)

browser-based (no need to install an "app")

built for on-line learning

contains all necessary features You know from elsewhere (Break-out rooms, Telephone call-in) + some more

Main concepts

User roles, their visual representations (circle, square, blue icon) and associated functions

Participant (A1): Turn on audio, video, chat, shared notes, modify layout, change status 

Presenter (A2): screencast, upload / modify /move in presentation, share external video, start survey

Moderator (B1): break-out rooms, take & give moderator/presenter, mute meeting, save user names, download notes / chat log, end meeting

TIMTOWTDI

Help others & Prevent errors

when someone's audio is "choppy", tell him/her to connect through cable or do telephone call in

think thrice before You click on "end meeting" and give moderator rights only to people who also think thrice

be aware of "mute" and "kick" functionalities. In the best of all possible worlds You do not need to do them but sometimes You can save somebody from quite "peinlichen" situation

Invent new use cases

synchronic (all together) reading / singing / writing

diachronic (one after another) reading / singing / writing

a good old "Being nominated I now nominate" introductory game (in bigger groups, make sure to ask people to change their status icon after being nominated)

free associations (either transparent in chat or anonymous in shared notes)

collaborative scribbling and underlining

collaborative ASCII art in Etherpad

You name it...

Develop own teaching style

"natural" background (there are ways how to setup a virtual background, google for "bigbluebutton hintergrund")

"theory" of Ausatmen / Einatmen course setup (thanks, BZHL!)

a useful Ausatmen approach: Break-out room

frontal teaching :: screencasting & commenting Kastalia KMS knots opened in a dedicated browser tab

discussions with students & giving presenter to them to make them lead the dance

little bit of collaborative reading, little bit of external video watching (also to fill pauses)

between seminars, we principially use Matrix rooms (medienhaus/ and baumhaus) to communicate in a less synchronous manner

0. Invitation to Kastalia Knowledge Management and Archivation System

0. Relevancy for UdK & AG Online Lehre

1. Vergangenheit

"pedagogical province" in Hesse's Glasperlenspiel :: https://en.wikipedia.org/wiki/The_Glass_Bead_Game#Castalia

activist and artist social network kyberia.sk

tradition of KuM &VK Einführungveranstaltungen

Einführungveranstaltung Examples

kastalia.medienhaus.udk-berlin.de/kum

kastalia.medienhaus.udk-berlin.de/vk

2. Philosophy

Kastalia is composed of "knots" which have attributes and relations ("bounds") to other "knots".

Everything (e.g. user, institution, event, presentation slide, fairy tale, musical piece) is a knot.

A knot is a "Ding an sich". 

Bounds are predicated. (hello sir Berners-Lee, hello Wikibase, hello "semantic web")

A knot is presented to an observer (e.g. human user) by means of a template.

Combination of a knot, other knots which are bound to it and a template yield "Ding für uns".

Note 0 :: Generativity of Kastalia KMAS

Example 1 :: Different views of one knot

ou bien un petit peu de 3D ?

3. Gegenwart

the UdK instance - currently contains cca 12000 knots - is supervised by Medienhaus IT-admin Frederik Mueller and is, for all practical purposes, independent from its inceptor

for the purpose of fibel.digital and "open online learning" teacher.solar projects another instance was deployed at baumhaus.digital and is further developped by my company wizzion.com UG

since 2021 it is possible to transfer "knowledge branches" between Kastalia instances

fibel.digital example

fibel.digital/GermanFairyTales

fibel.digital/AnDieFreude

4. Zukunft

additional study programs ? (in case of interest please contact me ASAP)

UdK archive / NFDI4culture ?

versatile backend for plethora of not-yet-existing web-based knowledge bases (e.g. gardens.digital)

the most important web-based composition of my life

Thanks for Your attention

teacher.solar lightning talk

What ? Outdoor online teaching ?

it is more healthy (Vitamin D, lower CO2 concentration, different body posture, burn-out prevention)

by harnessing the solar energy, OOT reduces the CO2 trace of one's digital activities

outdoor activities are indispensable part of many artistic curricula

nature is beautiful!

Achtung, Experiment !

During the SoSe2021 seminar "Gestaltung und Einsatz eines solarbetriebenen Online-Bildungsinstruments: Klang & Ton" students will build solar-driven, batteryless sound artefacts.

During the SoSe2022 Summer University seminar "Gestaltung und Einsatz eines solarbetriebenen Online-Bildungsinstruments: Papier & Tinte" students will build solar-driven, batteryless artefacts with electrophoretic (e-ink) displays.

In both cases, teacher will be outdoor (potentially walking, consistently with principles of Σχολή Περιπατητική), off-the-grid and shall communicate with students through combination of well-tailored open-source tools (Matrix Protocol, teacher.js) .

If it will rain then I have a problem ;)

teacher.solar Entwurf

Was hat Sie zu Ihrem Lehrvorhaben veranlasst?

videodominierte Paradigma

Lehre in Innenräumen vs. Lehre im Freien

CO2 macht uns dumm

Künstler brauchen ANDERE Schnitstellen

Welche Herausforderungen bei der Umsetzung des Vorhabens zeichnen sich ab? Wie wollen Sie ihnen begegnen?

technisch-gestalterische Komplikationen

ich werde sie mithilfe meiner Studenten begegnen

Wetter

vis maior

technisch-gestalterische Komplikationen

Problem: low bandwidth

Lösung: focus on audio and text-based protocols (matrix, "browse together")

Problem: Batterien sind keine ökologisch sub-optimal

Photovoltaik und Superkapazitoren

Transfermöglichkeiten

Kunst: Bildende Kunst (Malerei/Zeichnung/Skizze), Architektur, Netzmusik, kollaborative Dichterei

Naturwissenschaften: Botanik, Öko- und Umweltwissenschaften, Landwirtschaft

Geisteswissenschaften: Anthropologie, Geschichte/Archeologie, Philosophie

theoretische mathematisch-informatische Wissenschaften

Unterstützung von anderen Fellows ?

Frage an anderen Fellows

ECDF Partner talks DigEd / Cornelsen 2021

Digital Primer Project

Personal Primer Demo

Personal Primer :: Main Tenets

Current Features

Gesture Sensor (contact-less)

MYOD - Make your own device

Circadian - device can be programmed for deep sleep and automatic wake-up

In the process of Implementation:

Offline (edge-computing) Speech recognition

LRS Diagnostic toolbox (Berliner Digitale Leseprobe)

fibel.digital WebApp

Berliner digitale Leseprobe

inspired by established LRS-diagnostics tool like WLLP-R or SLS

web-based and not paper-based

focus on phono-graphemic associations

can provide deeper qualitative insights into state of pupil's reading competence than just quantitative comparison with the norm

hope is to reduce the harm done to basic literacy of elementary school pupils caused by CoVid-induced disruption of alphabetisation curricula

support from Cornelsen (e.g. field access etc., data storage, legal aspects) in allowing the BDLP to go into German-wide "production" modus would be very much appreciated

Haptic interface for audio-textual segmentation

fast & frugal way how to create associations between segments of text and segments of audio (e.g. speech)

web-based, involving human annotators

allows to segment speech into other words than just words (e.g. syllables, c.f. https://fibel.digital/KleinesSyllabischesLexikon )

BPMA application submitted in October 2020, EPO patent application in 2021

Lines of research

Speech recognition on edge devices (low-power controllers, browser)

Open source technologies for on-line learning (BigBlueButton, Matrix protocol)

Outdoor Online Learning (Stifterverband Senior Fellowship for teacher.solar project)

multi-predicative Knowledge Management and Archivation Systems (kastalia KMS, NFDI4Culture)

decentralized storage of information and value (Ethereum, blockchain, Non-fungible Tokens)

bildung.digital.udk-berlin.de

Berlin Open Lab Symposium #0

Berlin Open Lab Symposium #0

mini-introduction to fibel.digital & teacher.solar projects

UdK/ECDF Digital Education Team (Frederic Brodbeck, Hibiki Ishijima, Dorothea Müller, Paul Seidler & prof. Daniel Hromada)

https://bildung.digital.udk-berlin.de

https://fibel.digital

Small syllabic lexikon

English Tongue Twisters

https://teacher.solar

If it will rain then I have a problem ;)

Achtung, Experiment !

During the SoSe2021 seminar "Gestaltung und Einsatz eines solarbetriebenen Online-Bildungsinstruments: Klang & Ton" students will build solar-driven, batteryless sound artefacts.

During the SoSe2022 Summer University seminar "Gestaltung und Einsatz eines solarbetriebenen Online-Bildungsinstruments: Papier & Tinte" students will build solar-driven, batteryless artefacts with electrophoretic (e-ink) displays.

In both cases, teacher will be outdoor (potentially walking, consistently with principles of Σχολή Περιπατητική), off-the-grid and shall communicate with students through combination of well-tailored open-source tools (Matrix Protocol, teacher.js) .

Digital Primer Intro

Personal Primer Demo

Personal Primer :: Main Tenets

Current Features

Gesture Sensor (contact-less)

MYOD - Make your own device

Circadian - device can be programmed for deep sleep and automatic wake-up

In the process of Implementation:

Offline (edge-computing) Speech recognition

LRS Diagnostic toolbox (Berliner Digitale Leseprobe)

Snippets

Digital Primer Intro

Personal Primer Demo

Personal Primer :: Main Tenets

Current Features

Gesture Sensor (contact-less)

MYOD - Make your own device

Circadian - device can be programmed for deep sleep and automatic wake-up

In the process of Implementation:

Offline (edge-computing) Speech recognition

LRS Diagnostic toolbox (Berliner Digitale Leseprobe)

https://teacher.solar

If it will rain then I have a problem ;)

Achtung, Experiment !

During the SoSe2021 seminar "Gestaltung und Einsatz eines solarbetriebenen Online-Bildungsinstruments: Klang & Ton" students will build solar-driven, batteryless sound artefacts.

During the SoSe2022 Summer University seminar "Gestaltung und Einsatz eines solarbetriebenen Online-Bildungsinstruments: Papier & Tinte" students will build solar-driven, batteryless artefacts with electrophoretic (e-ink) displays.

In both cases, teacher will be outdoor (potentially walking, consistently with principles of Σχολή Περιπατητική), off-the-grid and shall communicate with students through combination of well-tailored open-source tools (Matrix Protocol, teacher.js) .

UdK goes AI (the GWK AE51_SoSe edition)

What is AI about ?

0. Generalization

1. Prediction

2. (Machine) Learning

3. Operations with (and on) numbers

4. Agency

What is AI NOT about ?

How to create reveal.js presentations in kastalia KMS ?

How to create a first slide

go into profile knot (click on "self")

click on "create child knot"

fill in the content for the first slide

scroll to the bottom of content text area and click on "create child knot"

How to implement presentation "fragments" ?

enter the "what You see is what You get editor"

go to Tools -> Source code

if some messy HTML appears, remove it

start each line with <p class="fragment">

end each line with </p>

How to attach picture to a slide

in "actions" section click on "attach file"

keep the img_url attribute intact

choose file and select file on Your disk

"attach file" (the bottom one ;)

thnxalot4Yourattention

teacher.solar

about

https://teacher.solar/

additional links

• https://www.digital-future.berlin/en/news/news-in-detail/news/innovation-in-der-hochschullehre-prof-hromada-ausgezeichnet/?tx_news_pi1%5Bcontroller%5D=News&tx_news_pi1%5Baction%5D=detail&cHash=007fe214d60ba674b25ad731c14aa4c4
• https://www.linkedin.com/feed/update/urn%3Ali%3Aactivity%3A6810842214646722560/

description

the teacher.solar web application has the following features:

• matrix chat (via an embedded hydrogen client)
• webrtc audio conferencing (using janus + audiobridge plugin)
• synchronization between the client with the instructor role and all other clients via websockets, so that students will always see what the teacher sees:
  • reveal.js presentations
    • connected clients are notified about slide changes, etc.
  • wikipedia pages
    • connected clients are notified about changes (page transitions, jumping to specific sections within the page, etc.)
• recording of teaching sessions (to be replayed at a later time)
  • the links to any opened presentation or wikipedia page are automatically be posted to a matrix room
  • the audio conference is saved to a file
  • relevant events (caused by the presentation / wikipedia module, etc.) are time-stamped and logged to a file on the server

architecture overview

conventions

• this repo uses git-flow
  • stable / production branch: master
  • development / testing branch: develop

setup

install dependencies:

git clone -recursive <this-repo> teacher.solar
cd teacher.solar
npm install

cd src/hydrogen
npm install

config

rename src/.env-example to src/.env and edit according to your needs.

run

• run server: DEBUG='T.S:*' npm run server
  • uses https://github.com/visionmedia/debug for logging
• run webpack dev server (client): npm run dev
• run hydrogen dev server: cd src/hydrogen ; npm run start
  • runs on port 3001 by default

then open http://localhost:8080.

build

production build:

npm run build:prod

building hydrogen:

cd src/hydrogen
npm run build # output will be in src/hydrogen/target

deploy

TODO

HAPTIC INTERFACE FOR SEGMENTATION AND ANNOTATION OF AUDIOTEXTUAL CORPORA

a little demo ???

sublexical segmentation

song / dialect annotation

am Anfang war die Geschichte ...

we are currently extending the interface with OCR / region-of-interest manual selection functionality

Haptic Interface

summary

browser-based tool for fast & frugal segmentation & annotation of sonic corpora

associates segments of sonic stream to discrete symbolic sequences (e.g. labels)

JSON metadata stored in the header of ogg/opus file (potentially also coupled with a PNG file)

coupling between visual (graphemosymbolic) and sonic mediated by means of a haptic modality (e.g. "finger pointing")

useful there where other approaches (e.g. automatic speech recognition) would fail (dialects & idiolects, ancient languages, artistic production etc.)

uses Kastalia Knowledge Management System as a backend

lexical segmentation

*

... to be continued ...

UdK Rundgang (29.10 - 31.10)

Tabula Rasa (Urania Berlin, 30.10)

Digital Education Hackathon (https://fibel.digital/digieduhack, 9-10.11)

teacher.js

Overview

Demo

1. What is teacher.js ?

2. Why teacher.js ?

https://teacher.solar

1 teacher :: 1 (class)room :: 1 server(node)

Outdoor Online Teaching

teaching != screen sharing

screencasting paradigm

COSTLY: Encoding, streaming and decoding of Megabytes of video signal to N participants incurs significant network and processing costs and is not feasible in low-bandwith areas or in use cases were radical reduction of energy consumption is an issue.

ASEMANTIC: The rich internal structure of many screen-casted contents (presentation slides, web documents etc.) is lost during its encoding into video signal. This prohibits viewers to execute any other interaction with the content, apart from passive consumption (e.g. students cannot click on links displayed on a screen-casted website, cannot search for a term in a displayed text document, increase the font size, etc.).


(Hromada & Brodbeck, ECEI 2022 paper)

#codecasting

3. teacher.js architecture

audio mixer (Janus audiobridge/WebRTC)

teacher.js 1.0 (available modules)

4. a BigBlueButton/ teacher.js comparison

BBB / teacher.js summary

next steps

shared video-viewing (code-casting)

whiteboard (spacedeck)

collaborative reading

client-side facial keypoint detection and artificial avatar/face synthesis

Summer Semester 2022 Online Gardening course

secure funding & create community

summa summarum

it is possible to have an online teaching toolkit running on a Raspberry Pi hardware

replacing video-streaming with code-casting paradigm leads to significant bandwidth reduction...

...and has many additional advantages (e.g. students can actually work with the source document)

the aim of teacher.js project is not to develop yet-another-videoconferencing-tool, but to provide a motivated teacher a minimalist yet modular & extensible toolkit containing everything he or she should need to do a great online course or hybrid online-offline course

links & references

https://github.com/freder/teacher.js

Hromada (2021) Three principles, 2 sub-principles and one magic wand for harm minimization and prevention of technological addiction in human children. Educational Innovations and Emerging Technologies).  EIET 2021/12 Vol.1, Iss.1 : 48-57 https://doi.org/10.35745/eiet2021v01.01.0005

Brodbeck & Hromada (2022) teacher.js: A low-bandwidth online teaching tool. Proceedings of 5th IEEE Eurasian Conference on Educational Innovation 2022

Thanks for Your attention

DigiEduHack / DigiEduPrimer challenge #0

Day 1 (Tuesday 9.11.2021)

10:00 Opening & Overview

10:15 DigiEduHack MainStage Stream

10:30 Challenge Overview

11:00 Resource Overview

11:20 Communication tool overview

11:40 Mentor&angel (re)introduction

11:55 Final advices

if You need anything, do not hesitate to ask!

based on Your demand we will gladly organize little interventions / presentations about any topic (Zirkus Palope, fibel.digital audiotext recording, machine learning of syllable classifiers, Matrix, BigBlueButton, reading difficulty diagnosis, You name it...)

this room stays open for next 24 hours but it is recommended to use matrix rooms as Your main communication channel

should some inappropriate behaviour (e.g. insults, hate-speech etc.) occur, the concerned person will first be notified (yellow card) and subsequently banned (red card) from the event

jurors were advised to give extra positive points to solution(s) where participants do not compete against each other but work with each other

12:00 Let's hack !

Day 2 (Wednesday 10.11.2021)

Live-Coding session (10:30 - 11:15)

Main Stage Call in (12:20)

Solution Pitches

Jury decides ...

Team X :: DigiEduBerlin (Dorothea, Viktor, Paul, Daniel & co.)

Thanks for Your time

Audial Creatures

Touchless Ukulele

CyberPlant 0

cyberplant.py

Bowl

Synthux Design Hackathon @ UdK / Audial Bodies 0th edition

Sense, Transform, Resonate

Sensors :: capacitive, temperature, distance, light, proximity, ...

Microcontroller :: Daisy Seed

Actuators :: motors, speakers

Audial Creatures

Touchless Ukulele

Bowl

CyberPlant 0

Synthux Hackathon year 0 @ Berlin University of the Arts

Synthux Hackathon year 0 @ Berlin University of the Arts

Daniel Devatman Hromada, Berit Greinke and Hyungjoong Kim

0. Context

0. Berlin University of the Arts

also known as UdK (Univesität der Künste)

origins of UdK's precursor institutions (e.g. Brandenburg-Prussian Academy of Arts) date back to 17th century

UdK received the title of University in 2001

largest art school in Europe (cca 3500 students)

four Faculties specialising in fine arts, architecture, media and design, music and the performing arts

decentralized (cca 15 buildings) all around Berlin

1. Studium Generale / Kollisionen

Studium Generale (SG) over-arching meta-curriculum in which all UdK students need to participate

every first working week of the year, SG organizes a "Collision-week" where two professors from two distinct fields organize a seminar together

great opportunity to onboard students from completely distinct fields

and that's how it all started ... on 26th October Roey contacted SG office and less than 4 months later, here we are!

2. Audial Bodies

1. Learning, Making, Hacking

Day 0 (Monday 3.1. / AE520103)

Day 1 (Tuesday 4.1. / AE520104)

day of frustration

4 + 1 projects crystallized

coaching session by Archil

introduction to the concept of ADSR

first sketches uploaded by Arduino IDE, first waves generated

problems with sensor communication

quite dense communication with Electro Smiths (7 mails from Stephen)

Day 2 (Wednesday 5.1. / AE520105)

day of hacking

Morning:

first data flowing from sensors into daisys

first and only group decides to abandon daisy and continue working with arduinos

Evening:

all groups have synths generating sounds

there are 7-8 to functional daisys modulating sound based on input coming from Gyroscope-Accelerometer-Mag / Time-of-flight / Magnetic field sensors

Day 3 (Thursday 6.1. / AE520106)

exploration day

after first successes with modulation of sound by means of sensor data, students start exploring the parametric space

parallel to these, other students focus on creating the prototype, a lot of cutting, knitting etc. takes place

many ideas emerge, most of them are abandoned in spite of being the best ones, actually

from teacher perspective, the most stupid thing would be to interfere with the process, so I rather went through half Berlin to pick up the Stemma QT cables

Day 4 Friday 7.1. / AE520107)

the presentation day

intervention by Tim Summers, professional violin player, Mahler chamber orchestra member, music-in-VR pioneer and programmer having a harmony theory of his own

all groups making videos of their prototypes

zero fake, everything which You will see is real stuff recorded & presented on day 4

2. Outputs

Group 1 :: Mask

Group 2 :: Pinguin

Group 3 :: Glove

Group 4 :: Jacket

Group 0 :: Drum & harp

Teachers also want to have fun!

"The Drum" artefact :: magnetic sensor attached below the membrane of the shamanic drum, reacting to touchless input from the other hand carrying a neodymium ring

"Polyphonic conductive harp" artefact :: neodymium ring magnets attached by means of conductive fibers to capactivie touch sensor

both use shakers (transducers) to vibrate the resonator to which they are attached and are thus fully portable

https://github.com/hromi/SeedInstruments

3. Summary

being the institution zero of the year zero, it wasn't easy (Zollamt, that sweet moment when You realize that among those few components You did not order to keep the budget low, there is the most important one, etc.)

HOWEVER, the goal to materialize some novel ideas and generate some vibes was achieved by each student group

majority of students obtained important insights about morphisms between numbers, waves and sounds

focus was put on wearables and portables

after a very nice closing session, students disappeared without a trace so there's very little from us on the synthux conf website

Roey, Archil and Stanley/ElectroSmiths are absolute overlords

4. Future

Synthux Hackathon 2023 :: yes, please ! (but with a less tight time-schedule)

SuperCollider support for Daisys would be helpful to attract UdK audio-guru community

more environmental awareness :: the amount of plastic and material "generated" by such a hackathon is enormous, more focus on upcycling ?

TensorFlow Lite on a Daisy ?

"Make Your Own Instument" curriculum for younger pupils ? (Synthux4Kids edition?)

Congrats & Thanks