Tweetovi
- Tweetovi, trenutna stranica.
- Tweetovi i odgovori
- Medijski sadržaj
Blokirali ste korisnika/cu @nhfruchter
Jeste li sigurni da želite vidjeti te tweetove? Time nećete deblokirati korisnika/cu @nhfruchter
-
Nathaniel Fruchter proslijedio/la je Tweet
This is your regular reminder to people in the tech industry that the choices you make in your job matter.https://twitter.com/tomgara/status/1222897591702081537 …
Hvala. Twitter će to iskoristiti za poboljšanje vaše vremenske crte. PoništiPoništi -
And that's a wrap!
@benadida passing the torch to@dseabraoliveira and@LeaKissner as next year's chairs for@enigmaconf 2021 (Oakland). Thanks everyone!#enigma2020Hvala. Twitter će to iskoristiti za poboljšanje vaše vremenske crte. PoništiPoništi -
Remaining problems: - Units! How do we standardize / compare measurement of abuse. It's an open question for the audience. - Systems! How can we combine different approaches into a unified system? - Reporting! Trustworthy signals from user-sourced reports.
#enigma2020Prikaži ovu nitHvala. Twitter će to iskoristiti za poboljšanje vaše vremenske crte. PoništiPoništi -
Philosophy of measurement: Goodhart's Law: "When a measure becomes a target, it ceases to be a good measure." Uncertainty principle: "Any abuse signal can be used for measurement or enforcement, but not both."
#enigma2020Prikaži ovu nitHvala. Twitter će to iskoristiti za poboljšanje vaše vremenske crte. PoništiPoništi -
Hvala. Twitter će to iskoristiti za poboljšanje vaše vremenske crte. PoništiPoništi
-
The gold standard: human labeling. FB uses stratified sampling to oversample suspicious activity due to base rates of abuse content.
#enigma2020Prikaži ovu nitHvala. Twitter će to iskoristiti za poboljšanje vaše vremenske crte. PoništiPoništi -
Approaches to measurement: 1. Count what you blocked. Are spikes good or bad? 2. Have users do the labeling (reporting). Reporters have inherent biases though (not necessarily bad), and data can be a bit unreliable.
#enigma2020Prikaži ovu nitHvala. Twitter će to iskoristiti za poboljšanje vaše vremenske crte. PoništiPoništi -
Benefits of measurement: track progress/regressions, data for models, deep dives, retroactive takedown.
#enigma2020Prikaži ovu nitHvala. Twitter će to iskoristiti za poboljšanje vaše vremenske crte. PoništiPoništi -
Measuring abuse: the dark ages. - Prioritization: who yells the loudest? - Impact: blocked actions over time. Next age ("the renaissance"): - Prioritization: volume x relative harm = rank - Impact: how much did you *not* block?
#enigma2020Prikaži ovu nitHvala. Twitter će to iskoristiti za poboljšanje vaše vremenske crte. PoništiPoništi -
What's the relative impact of 1 spam post to 1 account takeover? We don't necessarily know.
#enigma2020Prikaži ovu nitHvala. Twitter će to iskoristiti za poboljšanje vaše vremenske crte. PoništiPoništi -
Adult content, merchandise spam, scams... there's a lot going on out there. But it's hard to measure. Issues: no common units, unknown unknowns, adversarial response, category imbalance, no good concept of ground truth.
#enigma2020Prikaži ovu nitHvala. Twitter će to iskoristiti za poboljšanje vaše vremenske crte. PoništiPoništi -
Speaking of metrics, though: how do we figure out what to do? How do we measure the impact of our work in anti-abuse? How do we prioritize?
#enigma2020Prikaži ovu nitHvala. Twitter će to iskoristiti za poboljšanje vaše vremenske crte. PoništiPoništi -
"Sometimes I wished I worked on ad ranking..." It's easier to determine what works in ads. [Or is it? Today's earlier talk about metrics in ads...]
#enigma2020Prikaži ovu nitHvala. Twitter će to iskoristiti za poboljšanje vaše vremenske crte. PoništiPoništi -
Now: David Freeman from
@Facebook on the "abuse uncertainty principle" and measuring online abuse.#enigma2020Prikaži ovu nitHvala. Twitter će to iskoristiti za poboljšanje vaše vremenske crte. PoništiPoništi -
Incidents are opportunities to improve! This relatively small program created relatively massive dividends.
#enigma2020Prikaži ovu nitHvala. Twitter će to iskoristiti za poboljšanje vaše vremenske crte. PoništiPoništi -
Reservists gave back 76 days worth of time to the team, which allowed for breathing room and more proactive work to be done.
#enigma2020Prikaži ovu nitHvala. Twitter će to iskoristiti za poboljšanje vaše vremenske crte. PoništiPoništi -
Reservist model = pool of auxiliary crisis managers (voluntary!) that has prior experience. Incentives for reservists: engagement, training, collaboration, gained knowledge.
#enigma2020Prikaži ovu nitHvala. Twitter će to iskoristiti za poboljšanje vaše vremenske crte. PoništiPoništi -
What if we analyzed the incident data for trends? Netflix created forecasts of future incident load, as there are a lot of (seeming) correlates about time, quarter, area of incident, etc.
#enigma2020Prikaži ovu nitHvala. Twitter će to iskoristiti za poboljšanje vaše vremenske crte. PoništiPoništi -
- Raised the bar on what an incident was - built a high-level, distributed process for response. Turned team into an escalation point. - Efficiencies: crisis mgmt automation tools for support/admin. This reduces cognitive load on responder and time to assemble.
#enigma2020Prikaži ovu nitHvala. Twitter će to iskoristiti za poboljšanje vaše vremenske crte. PoništiPoništi -
Obviously don't want this to happen again, but scaling incident response is hard! Goals: detect quickly, respond effectively, and limit the blast radius from the incident.
#enigma2020Prikaži ovu nitHvala. Twitter će to iskoristiti za poboljšanje vaše vremenske crte. PoništiPoništi
Čini se da učitavanje traje već neko vrijeme.
Twitter je možda preopterećen ili ima kratkotrajnih poteškoća u radu. Pokušajte ponovno ili potražite dodatne informacije u odjeljku Status Twittera.