Another thing to keep in mind is that sound recorded outdoors usually has very little low-end information. When I'm tracking in studio to match tracks done in the field, the first thing I do is start rolling off the lows at 100hz and then just push the start of the curve up until it sounds about right.
You also hear some wind noise on those "Let It Be" mixes, but it's not like a SFX: The wind actually interferes with vocals, etc. Have you thought about just recording it outside? Is that feasible?
Apple Logic Pro X 10.4.4 ~ OS X 10.14.3 ~ 12-core 3.33Ghz MacPro w/32gb RAM, Radeon 7950 GPU, 3 Tb of internal SSD storage ~ UAD-2 ~ Waves Diamond ~ Komplete ~ Misc. plugs from Antares, Plogue, etc.