Here's a simple program I wrote that takes a JPG photo as a command line argument, extracts its GPS information and shows it as a marker on google maps (in your browser). For your convenience it is wrapped as a static shell context menu extension, meaning it is available when you right-click on a JPG file in windows explorer or xplorer².
Minimum requirements: windows Vista or later (32 or 64 bit)
While browsing your pictures folder, right click on a JPG photo, and use Show on map menu command, then you will see it in your browser (the big red marker is the exact GPS picture location):
If instead of google maps you see an error message, most probably your JPG doesn't have latitude/longitude information stored. Make sure your phone has GPS and that your camera is allowed to store GPS information in the photos you take.
Another slight problem is that only one picture at a time can be seen on its map location. If you right click on 10 photos, you will get 10 browser windows. Picassa is sorely missed in this respect.