Many a disappointed partner team has enthusiastically told me about their super-fast starting-point. Then we put the real site on the bench, with real hardware, with real link conditioning. Turns out, point-in-time visibility isn't worth very much if you don't keep looking.
-
Show this thread
-
-
Replying to @mjackson
https://www.webpagetest.org/easy will run a LH analysis if you ask it to (bottom checkbox, "Run Lighthouse Audit"):pic.twitter.com/YDzlvAlWAF
1 reply 0 retweets 3 likes -
Replying to @slightlylate @mjackson
As this thread started about Gatsby, here's a public-sector site built on this stack, running through WPT/easy in this config: https://www.webpagetest.org/result/190829_F7_a00e889c76d1c198ec401361ec901904/ …
2 replies 0 retweets 5 likes -
Replying to @slightlylate @mjackson
What's different about this run vs. opening up devtools locally is: 1.) the location in the network (this is in a rack in Dulles, VA thanks to the generosity of
@patmeenan) 2.) the quality of the network emulation. WPT uses dummynet: https://github.com/WPO-Foundation/wptagent#traffic-shaping-options-defaults-to-host-based … 3.) the hardware2 replies 0 retweets 7 likes -
Specifically, WPT drives Chrome in this config on a *real MotoG4*: https://www.gsmarena.com/motorola_moto_g4-8103.php …
1 reply 0 retweets 2 likes -
Here's the resulting LH report: https://www.webpagetest.org/lighthouse.php?test=190829_F7_a00e889c76d1c198ec401361ec901904&run=3 …
1 reply 0 retweets 1 like -
WPT also gives you the timeline paired with screenshots and video. If you click "filmstrip view" here on one of the test runs: https://www.webpagetest.org/result/190829_F7_a00e889c76d1c198ec401361ec901904/ … You can see the scrubbable waterfall: https://www.webpagetest.org/video/compare.php?tests=190829_F7_a00e889c76d1c198ec401361ec901904-r%3A3-c%3A0&thumbSize=200&ival=100&end=full …
1 reply 0 retweets 1 like -
...and generate video: https://www.webpagetest.org/video/view.php?id=190829_543b6196144502098b95ce61e61eec1f17f5d3ea …
2 replies 0 retweets 1 like -
But the difference between the LH reports from http://web.dev and http://webpagetest.org/easy should give you a sense for how important it is to be running your tests on the real HW you're trying to optimize around: …https://lighthouse-dot-webdotdevsite.appspot.com/lh/html?url=https://open.fda.gov/ … vs. https://www.webpagetest.org/lighthouse.php?test=190829_F7_a00e889c76d1c198ec401361ec901904&run=3 …pic.twitter.com/zS364KZyJo
3 replies 0 retweets 17 likes
A 25 point difference (out of 100). If you were a decision maker, and your team told you "we score 85!" and then I show up in a meeting with you and say "wow, 60, you've failed pretty badly"...that would be an unwelcome surprise. Hence the value of real-hw testing = )
-
-
Replying to @slightlylate @patmeenan
Oh wow, that's a huge difference. Thank you for taking the time to explain :) I don't think I'd ever noticed this little disclaimer on http://web.dev before
pic.twitter.com/1W7iG2LpKL
0 replies 0 retweets 15 likesThanks. Twitter will use this to make your timeline better. UndoUndo
-
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.
& Web Standards TL; Blink API OWNER
Named PWAs w/
DMs open. Tweets my own; press@google.com for official comms.