WIP (coming soon to substack): To be competitive you need to "outsource undifferentiated heavy lifting." Usually that means relying upon existing, solid, managed backends. Almost inevitably, those exist to make ad-driven business models viable. Data engineering binds us all.
-
Show this thread
-
If there's a term for this, please let me know. But in my head, it's like... ...the Great Social Tech Filter.
1 reply 1 retweet 2 likesShow this thread -
Want to know why you have weak controls over your attention and interactions on social media? Feed materialization is a hard problem at scale, and when users pay you with their attention alone, optimization necessarily entails minimal controls, which are expensive.
1 reply 1 retweet 3 likesShow this thread -
💥 (wannabe) Ƀreaker of (the Bad) Loops 💫 Retweeted 💥 (wannabe) Ƀreaker of (the Bad) Loops 💫
@paulg had a tweet that I can't find essentially saying the same about building new startups on them. I pretended it was wrong for about as long as I could. That delusion ended last week.https://twitter.com/generativist/status/1216770253264322568 …💥 (wannabe) Ƀreaker of (the Bad) Loops 💫 added,
1 reply 0 retweets 1 likeShow this thread -
1. It is foolish. Don't build your sandcastle on someone's private beach. 2. I was trying to solve the wrong problem. You're not going wring out appreciably more control from twitter. The problem is built into the data engineering design.
1 reply 0 retweets 7 likesShow this thread -
Replying to @generativist
Thought you might know after looking into this stuff -- do you know a way to find who I ought to follow but dont, given my existing follows? Like hubs that many of my "authoritative" follows follow themselves? I cant stop wanting that!
1 reply 0 retweets 1 like
Not yet, no. That was gonna be the "discovery" module of what I was building. I've done it for myself with my local graph data and python — it is as useful as your intuition suggests.
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.