Oldest videos and photos not extracted, ~100 GB total is missing

[raucous66]

I made an unencrypted backup of an iPhone 11 Pro with pictures dating back to 2012.

It has ~300 GB of pictures.

After I extracted everything from the unencrypted backup, the resulting output directory only contains about ~200GB of jpg, mov, and heic, and no directories prior to 2015.

Looking over the extracted directories' contents which start at 2015 and comparing them to the equivalent directories on the iPhone in explorer, a lot of stuff is missing from those first directories. And as far as I can tell, the latest directories seem mostly correct although I didn't do a detailed comparison.

So it seems the extractor is ignoring the older media on the iPhone.

The iPhone doesn't use iCloud storage for photos. All the pictures/movies are on the phone and I can browse them in Windows explorer.

__e

[joz-k]

Hi. Basically I see two main possibilities for this problem happening.

1. For some reason the iPhone backup is not complete. You can try doing a full unencrypted backup again to see if that makes a difference.
2. iPhone (or the iTunes/Apple Devices app) is storing old media files in an unusual location that I'm not yet aware of.

I would appreciate it if you could send me the output of the command with the --dry and --verbose parameters. --dry means that nothing will be copied and --verbose will print additional information that may be helpful in investigating this problem. Feel free to remove any personal information from the output, such as the phone serial number/ID or the exact names of directories, etc. I'm mainly interested in warnings like

Warning: Cannot determine filename from ...

[raucous66]

There's thousands of lines of output like this -

Warning: Cannot determine filename from "Media/PhotoData/CPLAssets/group99/91867A9C-4E8A-43A2-AE36-CA30DCA20B32.JPG"
fileID: 090dbcb6fcb5feb82c727f5818537e9082193bd4
Warning: Cannot determine filename from "Media/PhotoData/CPLAssets/group99/962D752F-C099-4CC9-A229-06C5359B64C6.JPG"
fileID: 1066d653500a2a59bbbfa85a08f7621498eaee3b
Warning: Cannot determine filename from "Media/PhotoData/CPLAssets/group99/9716E5CE-E9C2-498D-9CB8-46E5F7232583.JPG"
fileID: e0dd01364fc6825b0d0f6eb61a70fe0c2b9dcdd2
Warning: Cannot determine filename from "Media/PhotoData/CPLAssets/group99/9AFF8C51-0765-49D6-9BE6-319D8D45CF20.JPG"
fileID: 614fab3d5340cc9a820c5eaa66f66b9d53fb0f53
Warning: Cannot determine filename from "Media/PhotoData/CPLAssets/group99/9B00640B-77D6-4BCD-AACB-E4DE7BBD7EDC.JPG"
fileID: 268b2b5a81f11fdfacc1b926ecbdd9fa2e910430
Warning: Cannot determine filename from "Media/PhotoData/CPLAssets/group99/AA8F24FA-2E19-475E-A4CD-C365AE899658.JPG"
fileID: 860bce2342498afcbade83a5473b4c6aadd38ede
Warning: Cannot determine filename from "Media/PhotoData/CPLAssets/group99/B800570B-704B-4668-80E7-6157AA72B257.JPG"
fileID: 483152196f38b3d2c0f8457b09925fae4a9882e3
Warning: Cannot determine filename from "Media/PhotoData/CPLAssets/group99/BDCB5F57-1606-4177-B9A4-CA81DC3CAEED.JPG"
fileID: 3e904c129ed00a73278671347caa32fa383959cd
Warning: Cannot determine filename from "Media/PhotoData/CPLAssets/group99/D8C98928-19CC-4EAB-8008-9D05D1CEAC94.JPG"
fileID: 63d5913a860ac3564d43599eabc3ca2c224e32a8
Warning: Cannot determine filename from "Media/PhotoData/CPLAssets/group99/EC477CAD-F39C-4AF7-BA41-8AA06C10345F.JPG"
fileID: 00969c5f3680772bbbcca6feea838667b736e736
Warning: Cannot determine filename from "Media/PhotoData/CPLAssets/group99/F8D46805-B065-4EED-A812-E79F09A60642.JPG"
fileID: ce3d91aa1d6f55ee2347c8ae5598d7eae107650e
Warning: Cannot determine filename from "Media/PhotoData/CPLAssets/group99/FA216BA5-A025-42EF-87A8-27DEDABB4BF7.JPG"
fileID: f6b395c158d1819f146f0c4bb48e343a104ff735
Warning: Cannot determine filename from "Media/PhotoData/MISC/PXPlacesAlbumImageCached.jpg"
fileID: 14def1c989bbf8cf831b7924e117d219902104b3
Warning: Cannot determine filename from "Media/PhotoData/MISC/PreviewWellImage.jpg"
fileID: 826ed281dc525e89f2b1f5a7b6e76c6f125ef46f

30250. (b7/b77869a732f7e2cdf754e928050530b353f42025) IMG_0204.jpg → , Skipping...

30251. (9b/9b2f109ef295a23e28a226da4de6780888502070) IMG_0252.jpg → , Skipping...

30252. (5a/5aedd1b4a7a4127c20c824294cc213016cc7d868) IMG_0259.jpg → , Skipping...

30253. (0f/0f9111fb3e5653c415e9946b26e1f026bd97c8d3) IMG_0323.jpg → , Skipping...

30254. (5f/5f8bdda2b0213860287ad952781f61affe9b54c3) IMG_1330.jpg → , Skipping...

30255. (65/65f40da4371c1eeb67c54210b49052d2ff027310) IMG_1332.heic → , Skipping...

30256. (de/de978bab635dfb47e5e1b862d453a247af6c32de) IMG_1338.heic → , Skipping...

Warning: Cannot determine filename from "Media/PhotoData/Mutations/PhotoData/CPLAssets/group1/34165856-E425-4724-A836-47696DDD5D69/Adjustments/FullSizeRender.jpg"
fileID: c445b97a53c34377d2a048bccc97cb91cc06b18e
Warning: Cannot determine filename from "Media/PhotoData/Mutations/PhotoData/CPLAssets/group10/48F620F9-ED66-4339-873E-29EBD6276AF0/Adjustments/FullSizeRender.jpg"
fileID: 061f6a9cd13e4a364e614d470a67fbb093aadc06
Warning: Cannot determine filename from "Media/PhotoData/Mutations/PhotoData/CPLAssets/group100/74776F81-77F1-4E3C-88DC-7F92FC12D8FE/Adjustments/FullSizeRender.jpg"
fileID: 7a417a7c58771bb58af2d36b4e6691c2ac4029e3
Warning: Cannot determine filename from "Media/PhotoData/Mutations/PhotoData/CPLAssets/group101/3D9E8979-E6B1-4048-8B9A-84580DC7F8D4/Adjustments/FullSizeRender.jpg"
fileID: de9afb3749f45407dcfed81403791f518b8e05bb
Warning: Cannot determine filename from "Media/PhotoData/Mutations/PhotoData/CPLAssets/group102/3E99C9CA-066E-480A-80E1-CBF3326FDD54/Adjustments/FullSizeRender.jpg"
fileID: b2d360ebf7d01c69a7adee51c6597e07da084059
Warning: Cannot determine filename from "Media/PhotoData/Mutations/PhotoData/CPLAssets/group102/8F1DB973-3AF3-4655-9917-1B71B922CC7D/Adjustments/FullSizeRender.jpg"
fileID: 9e4627054291aee7b29be6a1fd6e37b1179cade6
Warning: Cannot determine filename from "Media/PhotoData/Mutations/PhotoData/CPLAssets/group104/572DF003-0DE6-4F29-8824-55941734B2A8/Adjustments/FullSizeRender.jpg"
fileID: b97f503bbe766a80887c4d81d045ba565f157322
Warning: Cannot determine filename from "Media/PhotoData/Mutations/PhotoData/CPLAssets/group104/D3B242CE-41F4-4D33-93AC-C406CCD7E6D1/Adjustments/FullSizeRender.jpg"
fileID: a31f7fee31b7de5c17bd6bc14f1f8963220122ef
Warning: Cannot determine filename from "Media/PhotoData/Mutations/PhotoData/CPLAssets/group104/F723E37A-5299-4605-ADDC-9471FF5652C0/Adjustments/F723E37A-5299-4605-ADDC-9471FF5652C0.JPG"
fileID: 48f9ce46a88a2de0aece7307b3d576f673b4af43
Warning: Cannot determine filename from "Media/PhotoData/Mutations/PhotoData/CPLAssets/group104/F723E37A-5299-4605-ADDC-9471FF5652C0/Adjustments/FullSizeRender.jpg"
fileID: b19c5ad3a6cef98fd9d1db31585f429af0985872
Warning: Cannot determine filename from "Media/PhotoData/Mutations/PhotoData/CPLAssets/group106/DE86D399-9158-4155-9C5A-CF683A2E6C2E/Adjustments/FullSizeRender.jpg"
fileID: a706eec72add6039b2da502ed5c67ff6c1084a41
Warning: Cannot determine filename from "Media/PhotoData/Mutations/PhotoData/CPLAssets/group108/3DDD1A3B-3AB5-4ECB-AFDB-693F36867AD1/Adjustments/FullSizeRender.jpg"
fileID: 403e8053981f4fb497dcd5fc46f8f8d015e8a929
Warning: Cannot determine filename from "Media/PhotoData/Mutations/PhotoData/CPLAssets/group109/793C95F1-CC99-4C4D-92A0-3B3B6CC26C33/Adjustments/FullSizeRender.jpg"
fileID: d489f167757589aadfbfd0277bb889270e268699
Warning: Cannot determine filename from "Media/PhotoData/Mutations/PhotoData/CPLAssets/group111/717D9F00-40AB-4057-99CF-ED506D8A8752/Adjustments/FullSizeRender.jpg"
fileID: 5d70c198821517c63542d805aecfe2086be60066
Warning: Cannot determine filename from "Media/PhotoData/Mutations/PhotoData/CPLAssets/group118/E680C1FF-4AE3-4B5F-8D27-A0B017B1273F/Adjustments/FullSizeRender.jpg"
fileID: 69ee8ae42b1e10bd3eb217a6a71b0b4079119dcb
Warning: Cannot determine filename from "Media/PhotoData/Mutations/PhotoData/CPLAssets/group118/FC645C4D-A431-4DA2-B5C7-715299CCBA88/Adjustments/FullSizeRender.jpg"
fileID: 21b66be315d9d43d0de86687831d0d1cf39e66f8
Warning: Cannot determine filename from "Media/PhotoData/Mutations/PhotoData/CPLAssets/group12/780205BF-AF2B-4FD4-BC22-06C4AD70B1B6/Adjustments/FullSizeRender.jpg"
fileID: 841f0a7001b0e390063794b042fe473ed092c3e7
Warning: Cannot determine filename from "Media/PhotoData/Mutations/PhotoData/CPLAssets/group12/D756A69F-0253-4A42-9C24-4EFDED7262C5/Adjustments/FullSizeRender.jpg"
fileID: 54ddb9917ba339a29ee27596cd04225e6970659f
Warning: Cannot determine filename from "Media/PhotoData/Mutations/PhotoData/CPLAssets/group12/ED56E331-A74D-4811-917F-9BA4D1C18E5D/Adjustments/FullSizeRender.jpg"
fileID: 8a26b8fe531e555d41eaa354c1b03f4b9a62302d
Warning: Cannot determine filename from "Media/PhotoData/Mutations/PhotoData/CPLAssets/group120/764C8C68-8017-458A-A085-994C094B0D92/Adjustments/FullSizeRender.jpg"
fileID: 75c1de37d8b484378318e902b6834bfceb3d32b5
Warning: Cannot determine filename from "Media/PhotoData/Mutations/PhotoData/CPLAssets/group121/6E992A61-8D12-4B81-BEB3-F157D4CEA907/Adjustments/FullSizeRender.jpg"
fileID: c97d5f0634e0bb8a6d7209dd01c9dc3d7c642624
Warning: Cannot determine filename from "Media/PhotoData/Mutations/PhotoData/CPLAssets/group127/7B8E47AB-88BE-4D48-881D-0BC836658FB2/Adjustments/FullSizeRender.jpg"
fileID: 59b51c3d110b072eeeb9bbd803be04005e463035
Warning: Cannot determine filename from "Media/PhotoData/Mutations/PhotoData/CPLAssets/group129/BAB82298-0529-4F56-BDC5-82385177C305/Adjustments/FullSizeRender.jpg"
fileID: f4626d4c650a029412cde040d2f690696d9bb106
Warning: Cannot determine filename from "Media/PhotoData/Mutations/PhotoData/CPLAssets/group129/D55C28A9-57E2-4D5C-BE27-35F5426FB240/Adjustments/FullSizeRender.jpg"
fileID: 04f0b84cbe72fb1dccd1f11324bf34d2b2d6727e
Warning: Cannot determine filename from "Media/PhotoData/Mutations/PhotoData/CPLAssets/group130/AB597174-0B9A-47FA-BE4E-BE339E33D537/Adjustments/FullSizeRender.jpg"
fileID: def3cfe02e290c3b1fd388fef47083b2c4e18949
Warning: Cannot determine filename from "Media/PhotoData/Mutations/PhotoData/CPLAssets/group131/22CE7DA7-5BB9-41BF-81E6-5C6433996993/Adjustments/FullSizeRender.jpg"
fileID: 85851a33b22cb5e3817f87f186d59a5d1a336ffd
Warning: Cannot determine filename from "Media/PhotoData/Mutations/PhotoData/CPLAssets/group132/C03E764D-495E-403B-A24C-5C9B5B607218/Adjustments/FullSizeRender.jpg"
fileID: 7bd3d031a5a350e4fc2ee6557340a8f3d9310298
Warning: Cannot determine filename from "Media/PhotoData/Mutations/PhotoData/CPLAssets/group133/342EADF1-0A71-4DFB-87C6-2E38F4620217/Adjustments/FullSizeRender.jpg"
fileID: 8b24c6921e08f99fb7c187b6e7c989a871aee6d8
Warning: Cannot determine filename from "Media/PhotoData/Mutations/PhotoData/CPLAssets/group135/BA48C8DD-96C6-46D1-9205-FCFE96ED129B/Adjustments/FullSizeRender.jpg"
fileID: cb08c93f4335f28136b199e97c63af08d73542b7
Warning: Cannot determine filename from "Media/PhotoData/Mutations/PhotoData/CPLAssets/group136/85F73F60-D3CE-4D8B-8FB5-C6D21114D298/Adjustments/FullSizeRender.jpg"
fileID: 4b937a59ddf8169283111e651cc398468b3de6f1
Warning: Cannot determine filename from "Media/PhotoData/Mutations/PhotoData/CPLAssets/group137/8899DE2D-2CF3-4ED7-8C61-4DE29017B7B1/Adjustments/FullSizeRender.jpg"
fileID: b2325dcd1a8625294623c3b617b44d099a9bb722
Warning: Cannot determine filename from "Media/PhotoData/Mutations/PhotoData/CPLAssets/group137/E823355A-E102-4C8B-9C20-6ED069A5055D/Adjustments/FullSizeRender.jpg"
fileID: dec0258f9af0e9ef5a304998fe8b71390cc07368
Warning: Cannot determine filename from "Media/PhotoData/Mutations/PhotoData/CPLAssets/group138/7138D318-744C-4E9B-8145-B2ACA99F5292/Adjustments/FullSizeRender.jpg"
fileID: 43d9d0c9cfc0142b7f31f0c11bed377d2baa7d81
Warning: Cannot determine filename from "Media/PhotoData/Mutations/PhotoData/CPLAssets/group140/3523F422-36C1-4BEF-8A99-5F4422C34CD4/Adjustments/FullSizeRender.jpg"
fileID: 59e6885440cc96314e4eb73fd50edd7c009b2abc
Warning: Cannot determine filename from "Media/PhotoData/Mutations/PhotoData/CPLAssets/group140/64774B37-F7DE-43E6-9D1A-C2EBE0E26B8E/Adjustments/FullSizeRender.jpg"

[joz-k]

Hi. Thank you. That is interesting and potentially very useful. It appears that you previously had iCloud photos enabled on this phone. Please make sure they are all downloaded back to your phone by enabling "Download and Keep originals" in the Photos settings. You can also temporarily turn on "Airplane Mode" on your phone and see if you can still access full-size versions of all your photos without an internet connection.

If all the above conditions are met, then my hypothesis is that photos, which were previously stored in iCloud and downloaded back to the phone, are now stored in a different location. An example of such a location might be:

Media/PhotoData/CPLAssets/group99/FA216BA5-A025-42EF-87A8-27DEDABB4BF7.JPG
Media/PhotoData/Mutations/PhotoData/CPLAssets/group12/ED56E331-A74D-4811-917F-9BA4D1C18E5D/Adjustments/FullSizeRender.jpg

To help me to confirm this hypothesis, can you please navigate to (on Windows):

• %APPDATA%\Apple Computer\MobileSync\Backup\<phone Id> (if you use iTunes)
• %USERPROFILE%\Apple\MobileSync\Backup\<phone Id> (if you use Apple Devices app)

and use a search to find a file named f6b395c158d1819f146f0c4bb48e343a104ff735. Copy it to your HOME folder and rename it to add the .jpg extension to it and see if it's an example of the full size version of the photo you're missing.

I will modify this extractor tool to account for this location if all of the above appears to be correct.