Life in the age of Social Distancing - what are you up to?

digital paradise wrote in post #19044645
That was a lot of work. 6 is not bad at all.

I have around 45,000 raw files, so 6 out of 45k is not bad, you could say, but I still don't want 6. Oddly enough, 3 of the 6 looked perfect in LR after re-importing them, despite a few hundred bad bytes (several thousand in one of the files). The other 3 looked very bad in LR.

So this was for ONE of my backup drives. Now to test the others.

Just curious, how did you find them? I've been looking for a decent checksum program for a while so I can automate the process.

gjl711 wrote in post #19044636
Hmm.. odd. I have been cleaning out some old memory cards many with pics I wasn't really interested in keeping but were still on my card. From 2 cards, there have been a total of 5 corrupted files, all of them .xmp files. The raw and jpegs are fine, it's just the .xmp files.

Interesting. Were you able to confirm differences in the data?

(I didn't know there would be xmp files on memory cards.)

gjl711 wrote in post #19044656
Just curious, how did you find them? I've been looking for a decent checksum program for a while so I can automate the process.

I just did a Compare using FreeFileSync after setting the comparison method to "content". It takes a long time for GB of data - the compare of my raw files took overnight. I'm pretty sure you could do it with Beyond Compare too, as well as with other file compare programs.

Archibald wrote in post #19044657
Interesting. Were you able to confirm differences in the data?

(I didn't know there would be xmp files on memory cards.)

Usually I cull images on the card before downloading the ones I want to keep. I have become quite selective on what I put onto my PC as the library just gets too big. I spent almost 3 years going through old images and really cleaning things up deleting 10s of thousands of images that were never going to go anywhere but just take up space on my drives. Sometimes a image is in that questionable category, is it worth saving or not, so, I load it into camera-raw and play with it a bit before deciding if I'm deleting it or keeping it. That leaves a .xmp file on the card if I decide not to move the file. So the oldest file on this one card is December 12th 2017 and there were maybe 1000 or so images on the card that failed my copy over to pc test but I didn't delete them. I was just going through them again before formatting the card and starting clean. During the review, some images are moving and the vast majority I am deleting. I can't delete the .xmp as it's corrupted.

digital paradise wrote in post #19044586
Seen this advertisement on TV last night so I checked out. I have been a supporter of this for the last 5 years or so. I knew something was going on but it really took off when I attended a social media disinformation presentation by a professor of slavic languages from our province's university.

https://spotfakenews.c​a

https://nmc-mic.ca …ine/small-space-campaign/

There is an excellent series available on youtube from the BBC - one of the few organizations I trust.

Dr Aleks Krotoski was the first person to get her doctorate studying the evolution and characteristics of the Word Wide Web and presents a series of documentaries about the history, benefits and risks of the web and how we use it. She also looks at how we have changed our society as a result of the global community it has created.

Here is a link to the BBC webpage: https://www.bbc.co.uk/​programmes/p0067vwv for podcasts
Link to the episodes on Youtube: https://www.youtube.co​m …t?list=PL289282​B5A4F3F07A
These episodes include updates to the original 2010 series. It's worth a look, especially the episodes on 'The Cost of Free'

gjl711 wrote in post #19044661
Usually I cull images on the card before downloading the ones I want to keep. I have become quite selective on what I put onto my PC as the library just gets too big. I spent almost 3 years going through old images and really cleaning things up deleting 10s of thousands of images that were never going to go anywhere but just take up space on my drives. Sometimes a image is in that questionable category, is it worth saving or not, so, I load it into camera-raw and play with it a bit before deciding if I'm deleting it or keeping it. That leaves a .xmp file on the card if I decide not to move the file. So the oldest file on this one card is December 12th 2017 and there were maybe 1000 or so images on the card that failed my copy over to pc test but I didn't delete them. I was just going through them again before formatting the card and starting clean. During the review, some images are moving and the vast majority I am deleting. I can't delete the .xmp as it's corrupted.

I see. OK, that would explain it. I wouldn't normally write to a memory card this way, but also can't imagine that the corruption would be because of this.

Edit - unless you removed the card too soon.

Tronhard wrote in post #19044686
There is an excellent series available on youtube from the BBC - one of the few organizations I trust.

Dr Aleks Krotoski was the first person to get her doctorate studying the evolution and characteristics of the Word Wide Web and presents a series of documentaries about the history, benefits and risks of the web and how we use it. She also looks at how we have changed our society as a result of the global community it has created.

Here is a link to the BBC webpage: https://www.bbc.co.uk/​programmes/p0067vwv for podcasts
Link to the episodes on Youtube: https://www.youtube.co​m …t?list=PL289282​B5A4F3F07A
These episodes include updates to the original 2010 series. It's worth a look, especially the episodes on 'The Cost of Free'

Thanks

Archibald wrote in post #19044690
I see. OK, that would explain it. I wouldn't normally write to a memory card this way, but also can't imagine that the corruption would be because of this.

Edit - unless you removed the card too soon.

It's not me writing to the memory card but an automatic function of camera raw. Well, I guess indirectly it's me, but it's not something I care about, just evaluating the file before moving it or skipping it. If I skip it, sometimes I delete outright and sometimes I just leave it as I can't fully decide. These are skip it leftovers.

gjl711 wrote in post #19044714
It's not me writing to the memory card but an automatic function of camera raw. Well, I guess indirectly it's me, but it's not something I care about, just evaluating the file before moving it or skipping it. If I skip it, sometimes I delete outright and sometimes I just leave it as I can't fully decide. These are skip it leftovers.

What brand and model of camera writes RAW files and XMP files to the memory card?!

Wilt wrote in post #19044737
What brand and model of camera writes RAW files and XMP files to the memory card?!

Any camera that generates a raw file.

gjl711 wrote in post #19044661
... Sometimes a image is in that questionable category, is it worth saving or not, so, I load it into camera-raw and play with it a bit before deciding if I'm deleting it or keeping it. That leaves a .xmp file on the card if I decide not to move the file. .....

gjl711 wrote in post #19044750
Any camera that generates a raw file.

https://fileinfo.com/e​xtension/xmp

"An XMP file is a metadata file used by Adobe programs such as Photoshop and Bridge. It contains the edits made to a camera raw file, such as a . CR2 or . NEF file, and is automatically generated and saved in the same directory as the corresponding camera raw file."

https://shuttermuse.co​m/glossary/xmp/

"WHAT IS AN XMP FILE AND HOW IS IT USED IN PHOTOGRAPHY?
In photography, specifically in post-processing and editing, XMP Data is the data standard for Adobe’s Extensible Metadata Platform. In XMP enabled applications photographers and editors are able to embed metadata directly into popular image file formats such as JPEG files. Using XMP means that so-called ‘sidecar’ metadata files are no longer required, vastly simplifying the file organization and storage workflow for photographers. Files containing XMP data are still able to be opened and edited in applications that do not support XMP data, the metadata contained within the file however is only editable within XMP compatible applications such as Adobe’s photoshop suite."

Wilt wrote in post #19044767
https://fileinfo.com/e​xtension/xmp

"An XMP file is a metadata file used by Adobe programs such as Photoshop and Bridge. It contains the edits made to a camera raw file, such as a . CR2 or . NEF file, and is automatically generated and saved in the same directory as the corresponding camera raw file."

https://shuttermuse.co​m/glossary/xmp/

"WHAT IS AN XMP FILE AND HOW IS IT USED IN PHOTOGRAPHY?
In photography, specifically in post-processing and editing, XMP Data is the data standard for Adobe’s Extensible Metadata Platform. In XMP enabled applications photographers and editors are able to embed metadata directly into popular image file formats such as JPEG files. Using XMP means that so-called ‘sidecar’ metadata files are no longer required, vastly simplifying the file organization and storage workflow for photographers. Files containing XMP data are still able to be opened and edited in applications that do not support XMP data, the metadata contained within the file however is only editable within XMP compatible applications such as Adobe’s photoshop suite."

Yes, I know well what a .xmp file is. Read the second sentence. I know it's there. I don't care that it's there. I was surprised at how many of them are corrupted. I don't care that they are, just surprised. They are all getting deleted anyway.

gjl711 wrote in post #19044772
Yes, I know well what a .xmp file is. Read the second sentence. I know it's there. I don't care that it's there. I was surprised at how many of them are corrupted. I don't care that they are, just surprised. They are all getting deleted anyway.

No, apparently you don't know where it comes from, although you state you know what it is for. You said, "Any camera that generates a raw file." But it does not....that is why I asked you what brand & model camera did that, in case my own information was outdated by recent changes by one manufacturer making XMP files in the camera.

Two independent discussions aabout XMP, one of them Adode's:

https://itstillworks.c​om/create-xmp-file-10032775.html

"How to Create an XMP File
BY TAMMY CLEVENGER
A file with the XMP file extension is an Adobe Extensible Metadata Platform file. An XMP file contains a metadata template to assist users in organizing multiple files. You can create an XMP metadata template file from an Adobe application, such as Photoshop or Fireworks, and then import the metadata into other files with the Adobe XMP platform installed. To create an XMP template file, you first need to select an Adobe graphic or document that contains metadata in the format you want to use."

https://helpx.adobe.co​m …etadata-adobe-bridge.html

"About the XMP standard

Metadata information is stored using the Extensible Metadata Platform (XMP) standard, on which Adobe Bridge, Adobe Illustrator, Adobe InDesign, and Adobe Photoshop are built. Adjustments made to images with Photoshop Camera Raw are stored as XMP metadata. XMP is built on XML, and in most cases the metadata is stored in the file. If it isn’t possible to store the information in the file, metadata is stored in a separate file called a sidecar file. XMP facilitates the exchange of metadata between Adobe applications and across publishing workflows. For example, you can save metadata from one file as a template, and then import the metadata into other files."

If you have any XMP file on a camera's memory card, the camera did not put it there, but an Adobe application created it and the XMP got inadvertantly copied to the memory card.

Are you mistakenly calling a RAW file an 'XMP' file (which it is not)?!

Wilt wrote in post #19044797
No, apparently you don't know where it comes from, although you state you know what it is for. You said, "Any camera that generates a raw file." But it does not....that is why I asked you what brand & model camera did that, in case my own information was outdated by recent changes by one manufacturer making XMP files in the camera.

Two independent discussions aabout XMP, one of them Adode's:

https://itstillworks.c​om/create-xmp-file-10032775.html

"How to Create an XMP File
BY TAMMY CLEVENGER
A file with the XMP file extension is an Adobe Extensible Metadata Platform file. An XMP file contains a metadata template to assist users in organizing multiple files. You can create an XMP metadata template file from an Adobe application, such as Photoshop or Fireworks, and then import the metadata into other files with the Adobe XMP platform installed. To create an XMP template file, you first need to select an Adobe graphic or document that contains metadata in the format you want to use."

https://helpx.adobe.co​m …etadata-adobe-bridge.html

"About the XMP standard

Metadata information is stored using the Extensible Metadata Platform (XMP) standard, on which Adobe Bridge, Adobe Illustrator, Adobe InDesign, and Adobe Photoshop are built. Adjustments made to images with Photoshop Camera Raw are stored as XMP metadata. XMP is built on XML, and in most cases the metadata is stored in the file. If it isn’t possible to store the information in the file, metadata is stored in a separate file called a sidecar file. XMP facilitates the exchange of metadata between Adobe applications and across publishing workflows. For example, you can save metadata from one file as a template, and then import the metadata into other files."

Man, this is enough to make me wilt.