Here are the results from my early ‘tests’ of GPS/oHR and elevation accuracy. I’ll endeavour to keep this post updated with new results for a month or so, so pop back for updates.
Return to the main Garmin Fenix 6 Review
FYI: When I got the watch, it immediately updated firmware to the production firmware ie v3 and GPS firmware to v2.5, so that might explain better results found by others in pre-production firmware and/or GLONASS/GALILEO might produce different results.
I always try to use GPS-only mode so that results can be compared between devices although, in Garmin’s case, it might also be fair to use GPS+GLONASS as Garmin seem to have tinkered with that over an extended period. I would assume that they are still tinkering with GLONASS and am pretty sure that they are REALLY tinkering with GPS+GALILEO ;-). There is little point in me testing stuff that Garmin may well change the next day.
Having said that my formal test did show GALILEO (71%, good) as being slightly better than GLONASS (69%, almost good) and GLONASS better than GPS-only (62%, average).
Let’s start off with an easy one
Garmin Fenix 6 Pro – oHR Accuracy – Swim (OWS + Pool)
This does NOT look too great and the Garmin oHR data is from the newly added oHR-when-swimming feature.
The green line is based on my old HRM-TRI, which might be on its last legs. However, the HRM-TRI data does look right. I didn’t bother to line up the curves over time as they clearly wouldn’t match.
Here are two more that I would class as ‘acceptable’ and you could argue I should have had a third device. But I didn’t.
Here’s two more, the first in a pool shows the Fenix 6 +Elevate as being almost good but with the other one in OWS…I’ve no idea how to line these 3 up. The blue line is probably right.
This shows the danger of relying on ELEVATE when swimming. The tracks looks reasonable with no unusual troughs or peaks but it is 10bpm higher than HRM-SWIM – which I assume to be correct and which looks correct for this easy 30 minute swim
Garmin Fenix 6 Pro – oHR Accuracy – Bike
This are two fairly long rides and are good ones to use as there are some hard efforts in there as well as bumpy roads
Despite these tracks trending similarly to each other you can see quite big differences in the overall average HR. That may, or may not, be OK for you and will depend on the purpose to which you are putting the data. I’d remind you that the Firstbeat algorithms work a LOT on the HR data. (Garbage in…garbage out.)
Having said that, given the bumpy Surrey conditions, I’d say it was alright but that I’ve seen better…even from Garmin on very similar Surrey routes.
This was was segment hunting in Surrey so there are a few short and hard efforts in there and the Fenix 6 did well compared to the H10.
Next, we move to a TT bike with some fairly hard efforts on a reasonably good road surface, the Fenix should have done better here.
These two were two bike legs from the same brick session on a TT bike and both were at low intensity and each shared a similar route on the same kind of roads. As you can see one is inexplicably ‘not good’.
Here’s another that’s quite good until the end
Garmin Fenix 6 Pro – oHR Accuracy – Run
This was a fairly long and steady aerobic run. I’ve aligned the starting points of the curves to make it readable. The phrase “spot-on” comes to mind.
Here’s 2x 20 at sub-threshold running with some of it on grassland, again Spot On.
This one is not great, however. I think I could have had the F6 tighter so, perhaps, as my arm got sweatier the slightly extra weight of the F6 combined with the sweat to give some movement and then it just became wrong. Incidentally, the extra 10 minutes of VO2max effort DID mess up my Firstbeat metrics. I also inadvertently paired the H10 to both the 935 and V800 so excluded the 935’s curve.
I need to be careful, I’m actually trying fairly hard at the moment as this one shows on a 4-3-3-1-1-1-3-3-4 run. Even here the F6 is not quite as good as the Forerunner 945 – even though the sensor is the same (presumably the exact same firmware commands as well). If anything I had the V800 banging onto the 945, so the 945 should have been worse. Maybe the weight of the F6Pro, whihc was on TIGHT, has something to do with the very sliht errors. NEvertheless, this performance is perfectly acceptable IMHO.
Finally, a nice long tempo run and the ELEVATE on the F6 mostly handles it well. Interestingly as it started to rain there were a few incorrect (orange) spikes from the F6.
Garmin Fenix 6 Pro – GNSS Accuracy – Bike
I don’t have any major issues with the GPS accuracy on the Fenix 6 when cycling. Sure there are a few feubles here and there but nothing I’m concerned about.
I’ll just give a few examples that support and contradict my lack of concern here 😉
This was a long ride and both the Wahoo and Fenix 6 were more than acceptable. Surprisingly I would say that the wrist-mounted Fenix bettered the ROAM on the handlebars. That should NOT happen Wahoo. Just sayin’.
The first of these two images shows the Fenix 6 beats the WAHOO ROAM (blue line) which cut corners, especially when there were trees involved. But that wasn’t always the case and there were occasions when the ROAM did better (second image)
These three images reflect a similar picture of the Fenix 6 (red) bettering the ROAM (Blue), as does the Forerunner 945 (green). A good cycling day for the Fenix 6 with GPS.
Another day, another ride but the same good results. One of the images shows the Fenix 6 seeming to go off the road but the deviation from the actual route is still well within an acceptable +/-5m. It jus tLOOKS worse when the track goes off the road rather than to the other side of the road. Fenix 6 (Green), Edge 820 (Red), Bolt (Blue)
This one was with GALILEO and the Fenix (green) did very well for the entire ride. It was just this one small section (and another less serious one) in well over 60 mintues of riding that was thrown out by some trees. Such a small error is of little concern to me. (Edge in Red, Wahoo in Blue)
Garmin Fenix 6 Pro – GNSS Accuracy – Running
This is REALLY not great, with blatant erroneous tracks that anyone could spot.
Here we have red (Fenix 6), Blue (Ambit 3 Run – different day, best ever track), Green (Coros Vertix)
And again, #Pants
And again, although it’s strange that the Garmin and Coros agree with each other. I was, for sure, exactly where the blue line is (+/-2m).
And again. It’s simply off-course at times like this
Despite the obviously numerous wayward wanderings, the Garmin did a good job at the overall distance getting accuracy to within 100.17%, although don’t expect to replicate that level of accuracy for a 10km run in a full built-up area.
The Fenix 6 also showed the instant running pace to be frequently >10 secs/km faster than it should have been with both GLONASS and GPS-only. Presumably, also 10secs/km slower in order to get the right overall distance but I only ever spotted it having me go faster…strange.
I might put some GALILEO charts up but, for now, the words are: GPS+Gallileo *DOES* seem to smooth the pace MUCH better than either GPS or GPS+GLONASS. Running with Galileo is sometiems actually GREAT but there are too many other times (in the same run) where the tracks are 5-20m off course.
Unfortunately for the Garmin Fenix 6, this was my ‘proper’ GPS running test and it scored 62% which is definitely POOR. In comparison, on a different day but exact same test methodology, the AMBIT got 85%. So a really quite big difference and this result is NOT up to Garmin’s normally ‘good’ standards. (Garmin never seem to score ‘excellent’).
Here is the methodology I follow, a results spreadsheet and all the source FIT files. You are more than welcome to come to different conclusions.
In fact, that run was not a one-off and I get similarly weird RUNNING results for GPS with the Fenix 6. It shouldn’t be as bad as it is and, as you’ll see further below it’s the same with GLONASS. Performance should be as good as the near-identical Forerunner 945…but it’s not.
Here we have the V800 (Blue), 945 (Green) and the Fenix 6 in Red. This first image is zoomed OUT a lot but you can still see the significant deviationS of the Fenix 6. There are some trees here but they’re not too challenging.
A little bit further on during the same run, there are some more dense trees and we can see again the Fenix 6 going off-piste when the other two agree. The trees here ARE more challenging and it’s difficult to know for sure the correct track (but it isn’t the red one!)
The rest of the same run included both challenging AND easy sections (first and second image respectively). and there’s no obvious winner but you can see the red line (F6) is more bouncy/jagged even when it is on the correct path.
Garmin Fenix 6 Pro – Running GNSS Accuracy – GLONASS
Perhaps the super-duper GLONASS is better.
Errr. Nope. Clearly not. The devices all were properly satellited up and the poor performance of GLONASS is towards the end of the run in any case. Although that did almost exactly coincide with going past Kiera Knightley’s parents’ old house (cnr Trowlock Ave). Maybe that was it? Fair enough.
A re-test over my standard route with GPS+GLONASS scored a modest improvement to 69%, which failed to beat the Coros Apex on the same run. Overall distance accuracy improved to 100.41% with GLONASS. (Both the 935 and 945 score about 75% with GPS-only, and I’d consider that performance level respectable).
On another day with the V800 and 945+GPS, the F6 Pro (Blue, GLONASS) is CONTINUOUSLY off the others. The 945 has the exact same chip. Other than the F6Pro’s metal casing I can’t see any reason for this persistent error as I get the same kinds of error with GPS-only as well. Elsewhere on this run the 4/5/6 year old V800 is clearly the best device…so much for old GPS-tech being rubbish.
IMO, there’s something slightly wrong with running GNSS on this watch!
Garmin Fenix 6 Pro – Running GNSS Accuracy – GALILEO
Galileo isn’t notably different in my opinion from lots of runs HOWEVER the GALILEO test came in as the best and at a GOOD level.
In a tricky route next to house and, on the right, shops. You can see the 945 (red) really struggles whereas the V800 (blue) and Fenix 6 (green) are similar but the Fenix has me on the wrong (Northerly) side of the road.
I added the Casio WSD-F30 (green) into the mix and that has good GPS but here the Fenix 6 (red) almost keeps up with it and I don’t know what the 945 (blue is doing) in htese relatively benign GNSS conditions
Further on in the same run the Casio is still doing very well and the F6 generally well, but struggling in places. Elsewhere (not shown) the Fenix 6 was OK but didn’t match the WSD-F30.
Here we have the Casio WSD-F30 (red), Fenix 6 (GLONASS, green) and Ambit 3 (blue). The tree lined paths were handled well by the Fenix 6 and Casio but the latter lost the plot when the signal was lost in an underpass on the 3rd image. Indeed these 3 iamges are fomr my GLONASS ‘test’ for the F6 and the whole track SUPERFICIALLY looks mostly alright but on closer inspection there were notable and persistent deviations throughout the run. Nevertheless the Garmin scored nicely enough.
GNSS Accuracy – Open Water Swimming
Garmin released some errant firmware earlier in the year which messed up the OWS performance. I’m happy to say that the Fenix 6 (red) put it a good performance here at Shepperton Lake and is very close to the normal/actual route taken. (Coros Vertix=Blue)
Here’s another one…pretty darn good.
Next I turned Galileo on for the OWS and got a good track against the 945. However digging below the superfically good track it just looks like there are infrequently recorded location points – I’m really not that good a swimmer that I can swim THAT straight in OWS. The 945 (blue, GPS-only) doesn’t look quite right either but it is perhaps a better attempt at getting the times when I did deviate from a straight line inbetween the buoys.
Garmin Fenix 6 Pro – Elevation Accuracy
This looks good enough for me.
Some things to point out though.
- The FIT file seemed to have no elevation in it at all. Strange. Yet there was elevation on Garmin Connect, so I exported a TCX from Garmin Connect and all was fine. I’m not sure what’s going on there (elevation correction disabled BTW). I’ve not delved deeper than that, maybe I made a mistake or there was some naming change in the file. Either way, the data looks cool
- Inadvertently I used GPS+GLONASS on this one.
- This was from a 5-hour cycle ride on a day with stable weather. That might explain why there was little drift in the elevation.
- I’m not entirely sure if DEM data was used, I’m assuming not. The Garmin results do not tally with the ‘correct elevation’ track (from another DEM source) so I’m assuming the figures I show below are based on barometric altimetry-based, perhaps with a bit of GPS tinkering going on in the algorithm to periodically reset the elevation.
I’m a little disappointed here as the all round performances were not quite as good as I hoped.
Whilst the poor GPS & GPS+GLONASS running tests are final results I might do a re-test or two or try GALILEO. I sensed when looking at the watch that the oHR was better than it really was. Contrast that to the running GPS where I KNEW something was amiss from frequent consultation with the instant paces (testing a watch involves more than just sticking it on your wrist and looking at the data afterwards).
- oHR performances seem to be going in the right direction. It still needs tinkering to beat the previous hardware iteration IMO
- Elevation looks GREAT
- GNSS/GPS looks mixed and in need of improvement especially with running
It’s still a super impressive watch though just buy STRYD and keep on using that chest strap if you want accuracy. 😉
Return to the main Garmin Fenix 6 Review