Conversation

Maggie πŸ”œ visting SFO πŸ‡ΊπŸ‡Έ
@Mappletons
Can anyone point me in the direction of academic research and/or well-researched material on non-linear, visual-spatial hyperlinks? As in, sections of images/space linked to other images/space, rather than text linked to text. In pursuit of the non-textual web...
15
112
Phil Dokes
@PhilDokes
...so, we're essentially talking about wordless/silent comics then, right?!?! You could use montage & associative imagery studies in cinema if that's so i'd think
1
juan jose fernandez ꩜
@imagetextimage
what if words in comics were indexable + connected to networks of words + images, all images able to be somewhat broken down semantically? you could navigate the network of images of birds, images of noses, of red color fields, etc... all from a panel as a jumping off point.
1
1
juan jose fernandez ꩜
@imagetextimage
You could do it top down semantically, but you could also use machine learning to make associations w/ other pixel arrangements that would be nodes: a network of things that look like birds, things that look like landscapes... many of which would be the things, though not all.
2
1
Maggie πŸ”œ visting SFO πŸ‡ΊπŸ‡Έ
@Mappletons
Yes! You're channelling my visual-search-engine networked dreams. It is absurd to me that all visual search begins with typed words, and nothing else. Keywords are great, but I want a "draw here" search box I can either doodle in, or drag an image/screencap into.
1
1
Maggie πŸ”œ visting SFO πŸ‡ΊπŸ‡Έ
@Mappletons
Obviously, we have Google reverse image search (only finds duplicates/identicals, not category-level similars) ...and Pinterest's "more ideas" feature is getting very close to the ideal But want to do this kind of associated image search from an inline reading experience...
Image
1
1
Maggie πŸ”œ visting SFO πŸ‡ΊπŸ‡Έ
@Mappletons
Strongly agree being able to select areas of an image/comic/visual explanation, and see a networked cascade of similar pixel arrangements without leaving the reading experience would be profound in helping people discover visuals and develop an understanding of visual vocab.
1
juan jose fernandez ꩜
@imagetextimage
I recognize that these are very difficult problems to solve for intuitive, ubiquitous use, but we've gotten this far, no? It would be a revolutionary to be able to make a framework for communicating via arrangements visual utterances that were be linked to visual "dictionaries".
1
2