You may think I'm nuts but this seemed incredibly fun and possibly helpful. I took a screenshot of my place using Google Maps and then drew a diagram to show where things were being grown.

My place is kind of rural so the detail isn't great but I still think this may be handy.