I still wonder if it's necessary.
I worked hard moving from a 85 to a 95 result on
https://tools.pingdom.com/
It didn't help me getting better ranks on Google.
And on one site I've even lost a lot maybe be cause I've made too much changes to get the speed results.