Conversation

Maggie πŸ”œ visting SFO πŸ‡ΊπŸ‡Έ
@Mappletons
Can anyone point me in the direction of academic research and/or well-researched material on non-linear, visual-spatial hyperlinks? As in, sections of images/space linked to other images/space, rather than text linked to text. In pursuit of the non-textual web...
15
112
Phil Dokes
@PhilDokes
...so, we're essentially talking about wordless/silent comics then, right?!?! You could use montage & associative imagery studies in cinema if that's so i'd think
1
juan jose fernandez ꩜
@imagetextimage
what if words in comics were indexable + connected to networks of words + images, all images able to be somewhat broken down semantically? you could navigate the network of images of birds, images of noses, of red color fields, etc... all from a panel as a jumping off point.
1
1
juan jose fernandez ꩜
@imagetextimage
You could do it top down semantically, but you could also use machine learning to make associations w/ other pixel arrangements that would be nodes: a network of things that look like birds, things that look like landscapes... many of which would be the things, though not all.
2
1
Maggie πŸ”œ visting SFO πŸ‡ΊπŸ‡Έ
@Mappletons
Yes! You're channelling my visual-search-engine networked dreams. It is absurd to me that all visual search begins with typed words, and nothing else. Keywords are great, but I want a "draw here" search box I can either doodle in, or drag an image/screencap into.
1
1
Maggie πŸ”œ visting SFO πŸ‡ΊπŸ‡Έ
@Mappletons
Obviously, we have Google reverse image search (only finds duplicates/identicals, not category-level similars) ...and Pinterest's "more ideas" feature is getting very close to the ideal But want to do this kind of associated image search from an inline reading experience...
Image
1
1
juan jose fernandez ꩜
@imagetextimage
Replying to
@Mappletons
and
@PhilDokes
I recognize that these are very difficult problems to solve for intuitive, ubiquitous use, but we've gotten this far, no? It would be a revolutionary to be able to make a framework for communicating via arrangements visual utterances that were be linked to visual "dictionaries".
1
2
Maggie πŸ”œ visting SFO πŸ‡ΊπŸ‡Έ
@Mappletons
I really hope there's a small cadre of HCI / IxD grad students in a basement somewhere doing this for us... sadly it'll just get written up in an all-text academic publication and we'll never find out πŸ˜… Hopefully, it's a waiting game though; reliable visual ML is still new-ish
1
2
Show replies